This study selected the catchment areas of (a) Chung-Chih village catchment (C1) in New Taipei City’s Wulai District, and (b) Dong-Yen village catchment (C2) in Kaohsiung City’s Yan-Chao District as model testing areas. Furthermore, it adopted the shallow landslide events that occurred between January 1, 2010 and October 15, 2017 for follow-up analysis. The model’s application and analysis mainly comprised the following three parts: (1) through adopting six typhoon events as testing examples, this study applied the QPF with radar data assimilation method and ensemble mean precipitation forecast method to produce 6-hr precipitation forecasts and analysis. (2) This study employed the observed rainfall depth as the input condition for the SIMTOP landslide model and conducted a long-term systematic evaluation to test the accuracy of the SIMTOP model. (3) It integrated very short-term precipitation forecasts into the SIMTOP landslide model to analyze the model’s warning performance for the next 6 hours.
3.1 Description of study areas
(a) Chung-Chih village catchment (C1)
In 2015, Typhoon Soudelor devastated Wu-Lai in northern Taiwan and caused severe shallow landslides and mudflows occurred on No. 9A Highway at 10.2 K. This study referenced the disaster record information of the Highway Bureau and Agency of Rural Development and Soil Conservation in Taiwan. Subsequently, Chung-Chih Village catchment (C1) is selected to the study area. Figure 2 displays the geographic location of said slope area in the Nan-Shih river basin. This study selected the Shang-Gui-Shan Bridge flow gauge station in the basin to verify the parameters of the SIMTOP model.
Chung-Chih village catchment (C1) is on the No. 9A Highway at 10.2 K (Fig. 2) and adopted 5-m resolution DEM. The DEM analysis results revealed that the catchment area was 0.59 km2 and the average slope angle was 35.9°. According to the traffic block information of the Directorate General of Highways displayed, three severe shallow landslide disaster events occurred on the No. 9A Highway at 10.2 K between 2010 and 2017, which were caused by Typhoons Soudelor (2015), Dujuan (2015), and Megi (2016). In the follow-up analysis, this study adopted the traffic congestion times on No. 9A Highway as the landslide occurrence times.
(b) Dong-Yen village catchment (C2)
In 2016, strong wind and heavy rainfall caused by Typhoon Megi induced numerous disasters in Taiwan. The most notable hillslope disaster occurred on September 28 when a shallow landslide occurred in Dong-Yen village catchment (C2) in in Kaohsiung City. Approximately 8,700 m3 of soil slid for approximately 20 m, burying one house and three persons were killed.
Dong-Yen village (C2) is located close to the Yen-Feng bridge watershed (Fig. 3). The Yen-Feng bridge watershed is 17 km2. The detail rainfall and flow discharge data of the Yeng-Feng Bridge watershed were also used to verify the hydrological parameters of SIMTOP model. C2 area is 0.58 km2 and average slope is 0.574. According to the 1/250,000 scale geological map from the Geological Survey and Mining Management Agency in Taiwan, the area is composed of sandstone, mud rock, and shale.
3.2 Analysis and discussion of rainfall forecasts
As shown in Table 1, this study first evaluated the accuracy of the rainfall forecast results and adopted six typhoon-induced heavy rainfall events for analysis. It separately applied the QPF with radar data assimilation method and ensemble mean precipitation forecast method with real-time rainfall observation information from the physical rainfall stations to produce rolling updates of 1- to 6-hr forecast information. Furthermore, this study employed the coefficient of efficiency (CER) and coefficient of correlation (CCR) to verify the feasibility of adopting precipitation forecasts to predict the cumulative rainfall. The calculation of CER is displayed as follows:
Table 1
Storm events and landslide occurrence records analyzed in this study
Typhoon Event | Warning period | Duration (hr) | Landslide occurrence |
Megi | 2016-09-25 23:30 2016-09-28 17:30 | 66 | C1、C2 |
Meranti | 2016-09-12 23:30 2016-09-15 11:30 | 36 | - |
Nepartak | 2016-07-06 14:30 2016-07-09 14:30 | 72 | - |
Dujuan | 2015-09-27 08:30 2015-09-29 17:30 | 57 | C1 |
Soudelor | 2015-08-06 11:30 2015-08-09 08:30 | 71 | C1 |
Linfa | 2015-07-06 08:30 2015-07-09 05:30 | 69 | - |
Table 2
Geomorphologic factors of the study watersheds.
Watershed | i | Ni | \({\overline{A}}_{i}\) (km2) | \({{\overline{L}}_{c}}_{i}\) (km) | \({\overline{S}}_{{o}_{i}}\) (m/m) | \({\overline{S}}_{{c}_{i}}\) (m/m) |
Shang-Gui-Shan Bridge (C1) | 1 | 680 | 0.28 | 0.45 | 0.6656 | 0.3456 |
2 | 145 | 1.29 | 1.03 | 0.7154 | 0.2290 |
3 | 33 | 6.34 | 2.72 | 0.7170 | 0.0947 |
4 | 9 | 24.06 | 4.31 | 0.6869 | 0.0415 |
5 | 3 | 72.48 | 7.52 | 0.7268 | 0.0169 |
6 | 1 | 334.83 | 23.82 | 0.6847 | 0.0121 |
Yan-Feng Bridge (C2) | 1 | 8 | 1.27 | 1.46 | 0.3218 | 0.0173 |
2 | 2 | 5.17 | 2.34 | 0.2406 | 0.0062 |
3 | 1 | 16.68 | 7.84 | 0.1483 | 0.0019 |
Notes: Ni is the number of ith-order streams; \({\overline{A}}_{i}\) is the mean ith-order subwatershed area; \({{\overline{L}}_{c}}_{i }\)is the mean ith-order channel length; \({\overline{S}}_{{o}_{i}}\) is the mean ith -order hillslope slope; \({\overline{S}}_{{c}_{i}}\) is the mean ith -order channel slope. |
$${\text{CE}}_{\text{R}}\text{=1}-\frac{\sum _{\text{t}\text{=}\text{1}}^{\text{n}}{\left({\text{RA}}_{\text{t}}-{\widehat{\text{RA}}}_{\text{t}}\right)}^{\text{2}}}{\sum _{\text{t}\text{=}\text{1}}^{\text{n}}{\left({\text{RA}}_{\text{t}}-{\stackrel{\text{-}}{\text{RA}}}_{\text{t}}\right)}^{\text{2}}}$$
2
where RAt, \({\widehat{\text{RA}}}_{\text{t}}\), and \(\overline{RA}\) represent the historical records of the cumulative rainfall at time t, the predicted cumulative rainfall at time t, and the average of recorded cumulative rainfall, respectively. A CER value closer to 1 demonstrates greater forecast accuracy. Additionally, the calculation of CCR is displayed as follows:
$${\text{CC}}_{\text{R}}\text{=}\frac{\sum _{\text{t=1}}^{\text{n}}\left({\text{RA}}_{\text{t}}-\stackrel{\text{-}}{\text{RA}}\right)\left({\widehat{\text{RA}}}_{\text{t}}-\stackrel{\text{-}}{\widehat{\text{R}}\text{A}}\right)}{\sqrt{\sum _{\text{t=1}}^{\text{n}}{\left({\text{RA}}_{\text{t}}-\stackrel{\text{-}}{\text{RA}}\right)}^{\text{2}}\text{∙}\sum _{\text{t=1}}^{\text{n}}{\left({\widehat{\text{RA}}}_{\text{t}}-\stackrel{\text{-}}{\widehat{\text{R}}\text{A}}\right)}^{\text{2}}}}$$
3
where \(\stackrel{\text{-}}{\widehat{\text{R}}\text{A}}\) represents the mean of the predicted cumulative rainfall. A CCR value closer to 1 represents greater forecast accuracy.
This study selected two rainfall stations that are close to the research areas, namely those at Da-Tung-Shan rainfall station in C1, and Heng-Shan Elementary School stations in C2, for coefficient of efficiency (Eq. (2)) and correlation (Eq. (3)) analyses. Figures 4 and 5 display the analyses’ results. The correlation of efficiency (CER) and coefficient of correlation (CCR) results indicated that the 1-hr to 3-hr forecasts of the two forecast methods were adequate. However, the two methods started to yield considerably different results in 4-hr to 6-hr. A possible cause of this disparity was the growing randomness of rainfall, which made rainfall development or recession increasingly difficult to predict as forecast time lengthened. By adopting the radar data assimilation method to constantly update the initial forecast background field, the progressive 6-hr precipitation forecast accuracy of the very short-term precipitation forecast was improved. Furthermore, the coefficient of correlation results of the QPF with radar data assimilation method signified a high correlation between actual and predicted cumulative rainfalls. Therefore, the rainfall characteristics forecast of this method was mostly adequate. Furthermore, the 6-hr precipitation forecasts of the six typhoons events revealed that the accuracy of this method was greater than that of the ensemble mean precipitation forecast method.
This study adopted Typhoon Soudelor from 2015 as an example (Fig. 6) and selected the duration between warning period as the analysis period. In Fig. 7, the horizontal and vertical axes represent the observed and predicted cumulative rainfall depth, respectively. When the predicted cumulative rainfall matches the observed cumulative rainfall, the curve has a gradient of 45°. This study compared the observed cumulative rainfall of the rainfall station with the 1-hr to 6-hr forecasts of the cumulative rainfall values produced by the two forecast methods. The results indicate that the cumulative rainfall prediction of the QPF with radar data assimilation method is adequate. In comparison, the cumulative depth prediction of the ensemble mean precipitation forecast method often underestimated the accumulated rainfall. Subsequently, the two precipitation methods are separately integrated with the SIMTOP model to compute the 1-hr to 6-hr forecasts of the catchment area’s mean FS.
3.2 SIMTOP model’s parameter calibration
Because the SIMTOP model required numerous geomorphological factors of the catchment area, this study adopted high-resolution 5 × 5 m DEM for computation. The method of Lee (1998) was employed to construct a DEM for acquiring the required geomorphological factors for the hydrographical model, including the watershed area, river lengths, and average slope angles of the catchment area overland and channel flows. Data from the Shang-Gui-Shan Bridge station in C1 and Yan-Feng stations were adopted to evaluate and verify the model variables. Figures 2 & 3 display the geographic locations of the rainfall stations. Table 1 shows the geomorphologic factors of the watersheds.
To perform runoff simulation of typhoon and flooding events in the SIMTOP model, this study conducted hourly rainfall-runoff simulation and analysis of the Shang-Gui-Shan Bridge and Yan-Feng Bridge watershed during different typhoon events. The analysis results revealed that the recession parameter (m) of the sample catchment area was 0.06 m; the hydraulic conductivity (K0) of the saturated soil was 5×10–3 m/s2; and the maximum storage in the root zone (SRZmax) was 0.02 m. The variables required for infinite slope stability analysis are accessible through on-site soil ampling and digital elevation model. This study set the soil friction angle as 30°, the effective cohesion as 2000 kN/m2, and the soil bulk density as 19.62 kN/m3. Many studies (Montgomery et al., 1994; Casadei et al., 2003; Ho and Lee, 2017; Ho et al., 2022) have indicated that these soil parameters are within a reasonable range. Please refer Ho et al. (2022) for more details on rainfall-runoff simulation and SIMTOP model’s landslide prediction. This study employed this set of parameters in the SIMTOP model to conduct long-term systematic evaluations of the selected catchment areas.
3.3 Integrating precipitation forecasts with SIMTOP landslide model analysis
This study analyzed the Chung-Chih village catchment (C1) and Dong-Yen village catchment (C2) during the interval between the announcement and dismissal of the offshore warning for Typhoon events. The QPF with radar data assimilation method and ensemble mean precipitation forecast method were separately integrated with the SIMTOP landslide model to compute factor of safety variation for the next 6-hr at each hour. Figure 7 indicates that when making forecasts on typhoon events, the peak rainfall occurrence time prediction of the QPF with radar data assimilation method was largely accurate. However, the method slightly overestimated the total rainfall. Alternatively, ensemble mean precipitation forecast method produced comprehensive precipitation type forecasts that were occasionally delayed compared with historical records and underestimated the total rainfall. By integrating the QPF with radar data assimilation method into the SIMTOP model, the proposed model became capable of generating effective landslide warnings as well as demonstrated greater landslide prediction performance than the SIMTOP model integrated with the ensemble mean precipitation forecast method.
This study also adopted Typhoon Soudelor from 2015 as an example and selected the duration between warning period as the analysis period to show the integrating precipitation forecasts with SIMTOP landslide model analysis. In Fig. 8, the blue line represented the and mean FS of this catchment using the historical hourly rainfall, and, black line with six red dots (6-hr prediction) represented mean FS of this catchment using the precipitation forecasts. Furthermore, the mean FS values changed in accordance with rainfall intensity and cumulated rainfall depth. This is because increased rainfall results in a greater amount of water infiltrating the soil. When the accumulated rainfall exceeds the infiltration capacity, the saturated water level gradually rises, and then the possibilities of shallow landslides will increase. The solid and hollow red arrows represent the landslide events that did and did not occur within the catchment area, respectively.
To compare the model prediction results with the simulated results, an error matrix was adopted to determine the accuracy of each model. As shown in Table 3, the error matrix produces four types of result conditions, namely hits, false alarms, misses, and no events, which refer to the model accurately predicting a simulated landslide occurrence, predicting a landslide occurrence despite no simulated landslide occurring, failing to predict a simulated landslide occurrence, and accurately predicting the simulated non-occurrence of a landslide, respectively. Finally, the frequency or time-sequence FS of each result condition was compared to establish the following variables to evaluate the suitability of the integrating precipitation forecasts with SIMTOP landslide model: probability of detection (POD), false alarm ratio (FAR), threat score (TS), and accuracy (ACC). The computing equations are listed as follows (Wilks 2011; Schaefer 1990):
\(\text{POD=}\frac{\text{Hits}}{\text{Hits+Misses}}\) | (4) |
\(\text{FAR}=\frac{\text{False alarms}}{\text{Hits}+\text{False alarms}}\) | (5) |
\(\text{TS}=\frac{\text{Hits}}{\text{Hits}+\text{False alarms}+\text{Misses}}\) | (6) |
\(\text{ACC}=\frac{\text{Hits}+\text{No events}}{\text{Hits}+\text{False alarms}+\text{Misses}+\text{No events}}\) | (7) |
Table 3
simulation prediction | \(\overline{FS}\)<1 | \(\overline{FS}\ge 1\) |
\(\overline{FS}\ge 1\) | Misses | No events |
\(\overline{FS}\)<1 | Hits | False alarms |
The POD, as presented in Eq. (4), ranges between 0 and 1 and represents the proportion of successful predictions of shallow landslide events. A POD value closer to 1 indicates higher model prediction performance. However, because the POD is derived by considering only hits while ignoring false alarms, a smaller sample size may generate an overstated POD value. Therefore, the FAR is typically included in performance assessments. The FAR, as presented in Eq. (5), represents the proportion of false alarms for an event under evaluation. An FAR value closer to 0 indicates higher model prediction performance. The TS, as presented in Eq. (6), ranges between 0 and 1 and is evaluated by considering both false alarms and misses; this index can be considered as representing the model prediction accuracy. The TS value closer to 1 indicates higher model prediction performance; the TS value is equal to 0 when the model exhibits no predictive capability. Finally, the ACC, as presented in Eq. (7), ranges between 0 and 1 and represents the all of successful and unsuccessful predictions of shallow landslide events. A ACC value closer to 1 indicates higher model prediction accuracy.
Figure 9 displays the error matrix analysis (Table 3) of the simulated mean FS and prediction results. The results indicated that the 1- to 4-hr mean FS predictions of the model were highly accurate; however, the 5- to 6-hr predictions of the mean FS barely achieved the required accuracy. This is because longer prediction times resulted in greater randomness of rainfall, which made rainfall development or recession difficult to predict. Therefore, acquiring accurate forecasts for longer forecast times is difficult.
To thoroughly understand the landslide prediction performance of this forecast model in the C1 and C2 during various typhoon events, this study further adopted six typhoons (Megi, Meranti, and Nepartak in 2016 and Dujuan, Soudelor, and Linfa in 2015) for testing as shown in Table 1. Table 4 displays the analysis results. Regarding the 1- to 4-hr landslide prediction performance of the radar data assimilation method, its POD, FAR, TS, and ACC values were 0.813, 0.480, 0.131, and 0.979, respectively, which were adequate prediction results. However, longer forecast times result in greater variations in precipitation forecasts. Furthermore, POD, FAR, TS, and ACC values of the 5- to 6-hr forecasts were reduced to 0.625, 0.545, 0.357, and 0.974, respectively. By contrast, in terms of the 1- to 4-hr landslide forecasts using the ensemble mean precipitation forecast method, the POD, FAR, TS, and ACC values were 0.412, 0.533, 0.280, and 0.974, respectively. The analysis results revealed that regardless of which QPF method was integrated into the landslide prediction evaluation model, prediction performance deteriorated as forecast time increased. Nevertheless, the combination of QPF with radar data assimilation method and with the SIMTOP model landslide warning system outperformed the combination of ensemble QPF and the SIMTOP model landslide warning system. Therefore, this warning system is suitable for generating 1- to 6-hr predictions of slope stability, and thus, can win more response time and reduce the loss of lives and property.
Table 4
Results of landslide prediction using two kinds of precipitation forecasts
Method | Ahead time | Misses | No events | Hits | False alarms | POD | FAR | TS | ACC |
QPF with radar data assimulation | 1 hr | 0 | 724 | 16 | 1 | 1.000 | 0.059 | 0.941 | 0.999 |
2 hr | 0 | 712 | 16 | 1 | 1.000 | 0.059 | 0.941 | 0.999 |
3 hr | 1 | 691 | 15 | 10 | 0.938 | 0.400 | 0.577 | 0.985 |
4 hr | 3 | 677 | 13 | 12 | 0.813 | 0.480 | 0.464 | 0.979 |
5 hr | 6 | 666 | 10 | 11 | 0.625 | 0.524 | 0.370 | 0.975 |
6 hr | 6 | 654 | 10 | 12 | 0.625 | 0.545 | 0.357 | 0.974 |
Ensemble mean | 1 hr | 1 | 723 | 16 | 1 | 0.941 | 0.059 | 0.889 | 0.997 |
2 hr | 1 | 711 | 16 | 1 | 0.941 | 0.059 | 0.889 | 0.997 |
3 hr | 7 | 696 | 10 | 4 | 0.588 | 0.286 | 0.476 | 0.985 |
4 hr | 10 | 680 | 7 | 8 | 0.412 | 0.533 | 0.280 | 0.974 |
5 hr | 13 | 669 | 4 | 7 | 0.235 | 0.636 | 0.167 | 0.971 |
6 hr | 14 | 656 | 3 | 9 | 0.176 | 0.750 | 0.115 | 0.966 |