3.1 Variations in Spatial Extent of Different DEM-derived ARAs
Riparian basezone is the dominant component of the active river area in all spatial resolutions and sources of DEM-derived ARA results. The proportion of riparian basezone located on the “wet” area is greater than that on the “non-wet” area in all DEM-derived ARA results (Table 2). This is to be expected, since riparian basezones are generally low-gradient areas with hydric soils, having the same features as riparian wetlands. However, riparian basezones derived from different LiDAR-DEMs vary in their spatial extent (Table 2), especially in creek and headwater areas (Fig. 11 and Fig. 12). A negative relationship between the LiDAR-DEM spatial resolution and the total area of the riparian basezone can be detected in both study watersheds. For instance, the total basezone areas (wet and non-wet) in the Miramichi River Basin range from 1711.66 km2 (30-m resolution) to 3238.17 km2 (3-m resolution) (Table 2b). Additionally, while similar boundary extents were detected for riparian basezones of great, medium and small rivers (Fig. 6), more blank areas (i.e., no riparian basezone delineated) were found within the extents of high-resolution LiDAR DEM derived riparian basezones (Fig. 11). By visually inspecting the aerial photo of those blank areas, it was evident that most of the blank areas are human infrastructural features with sharp boundaries. Because high-resolution LiDAR DEMs can generate more detailed slope grids and have the ability to model subtle topographic transitions, human infrastructure with sharp boundaries can be represented and will receive high-cost distance values, which will ultimately exclude them from the extent of riparian basezone, resulting in a more precise riparian basezone extent. Accordingly, it is reasonable to suspect that low-resolution LiDAR DEMs will overpredict the riparian basezone extent at certain areas (e.g., human encroachment areas).
LiDAR DEMs in 3-m and 5-m spatial resolution were found to provide sufficiently detailed elevational and horizontal distance changes in river valleys to allow differentiation of terraces from floodplains for great, medium and small rivers. The floodplain and terrace separation results show that the floodplain is the dominant component within the riparian basezone for rivers in those size classes (Fig. 7). Similar to floodplain distribution, larger proportions of terraces are located on “wet” areas than “non-wet” areas in both study watersheds (Table 2). However, due to the appearance of excessive local surface roughness (Fig. 8), accurate valley morphology information for small streams (i.e., creeks and headwaters) was not able to be extracted, as causes (i.e., presence of terraces or surface roughness) of abrupt slope changes were indistinguishable.
By visually comparing the riparian wetland extents derived from different LiDAR-DEMs, it was found that the extents of high-resolution riparian wetland match better than those of low-resolution with the provincial wetland inventory (Fig. 9). Low-resolution LiDAR DEMs and SRTM DEM based analyses were found to underpredict the extent of riparian wetland and overlapping areas of riparian basezone and riparian wetland (Table 2). Such overlapping areas are considered important in conservation planning because highly productive and diverse riparian plant communities tend to establish themselves in areas with rich alluvial soils (Smith et al., 2008). The underprediction issue in low quality DEM-based analyses can therefore be problematic in riparian conservation planning.
Steep slope areas are concentrated in relatively small portions of both study watersheds (Fig. 10). The area of steep slope MCZs increases as the resolution of LiDAR DEM becomes higher, with the same trend in both watersheds (Table 2). For example, the area of steep slope MCZs increases from 671.7 km2 (30-m LiDAR) to 1003.65 km2 (3-m LiDAR) in the Lower St. John River Watershed. This result is not surprising, since high-resolution LiDAR DEM can generate more detailed slope grid and pick up subtle topographic changes on the bare Earth, while low-resolution LiDAR DEMs and SRTM DEM will eliminate subtle topographic transitions when converting into slope grids. Given this limitation, only extremely-steep slope areas will be identified from low-resolution slope grids, while less-steep slope areas will remain undetected and thus excluded from steep slope MCZ delineation.
Table 2 Total area (sq km) for each ARA components by DEM resolution
a Lower St. John River Watershed
DEM source and resolution
|
Basezone (floodplain)
(wet | non-wet)
|
Terraces
(wet | non-wet)
|
Wetland
|
Steep slope
|
MCZs (60-m)
|
SRTM 30-m
|
1240.59
|
687.44
|
–
|
597.36
|
616.77
|
394.62
|
LiDAR 30-m
|
1452.14
|
881.18
|
–
|
660.67
|
671.7
|
459.09
|
LiDAR 15-m
|
1993.14
|
959.43
|
–
|
821.89
|
802.43
|
395.94
|
LiDAR 10-m
|
2033.78
|
737.94
|
–
|
905.70
|
902.72
|
467.23
|
LiDAR 5-m
|
2625.84
|
504.32
|
244.47
|
157.91
|
1181.33
|
906.85
|
418.82
|
LiDAR 3-m
|
3246.26
|
544.78
|
447.93
|
206.88
|
1370.5
|
1003.6
|
407.39
|
b Miramichi River Basin
DEM source and resolution
|
Basezone (floodplain)
(wet | non-wet)
|
Terraces
(wet | non-wet)
|
Wetland
|
Steep slope
|
MCZs (60-m)
|
SRTM 30-m
|
1228.72
|
159.14
|
–
|
653.51
|
542.74
|
196.13
|
LiDAR 30-m
|
1474.43
|
237.23
|
–
|
950.78
|
622.03
|
184.49
|
LiDAR 15-m
|
1816.63
|
187.20
|
–
|
1004.64
|
726.53
|
170.23
|
LiDAR 10-m
|
1994.09
|
144.41
|
–
|
1041.6
|
792.17
|
196.50
|
LiDAR 5-m
|
2452.88
|
94.84
|
220.31
|
52.36
|
1200.37
|
778.82
|
178.12
|
LiDAR 3-m
|
3075.09
|
163.08
|
258.08
|
57.07
|
1337.34
|
883.67
|
196.03
|
3.2 High-Spatial Resolution LiDAR DEM Smoothing
The FPDEMS method effectively subdued topographic complexity at local scales in both 3-m and 5-m LiDAR DEMs, while retaining the complexity of macro-scale landforms (Fig. 13). The rough appearance of raw high-resolution LiDAR DEMs was successfully removed, while the boundaries of important topographic features (i.e., channel edges) were preserved (Fig. 13 c, d). Moreover, the run time of the FPDEMS method is acceptable—~5 minutes and 25 minutes for 5-m LiDAR DEM and 3-m LiDAR DEM, respectively, in both study watersheds—with the aid of a high-end laptop (i.e., 6-core 2.2 GHz processor and 24 GB of memory).
Smoothed high-resolution LiDAR DEMs generated more realistic creek and headwater basezones in comparison to raw LiDAR DEMs (Fig. 14). Raw high-resolution LiDAR DEMs exhibited many cut-off planforms or so-called “padi terraces” at the local scale (Fig. 13). These areas are typical of closed contours where all the surrounding pixels exhibit the same elevation and slope value. Accordingly, all pixels inside the closed contours were assigned the same cost distance value and thus the determined cost thresholds did not necessarily cut off accurate basezone extents for creeks and headwaters. Through visual inspection, the widths of creeks and headwaters modelled by raw high-resolution LiDAR DEMs appear much greater than the general widths of creek and headwater floodplains, reported as ranging from 5 m to 50 m (Benda et al. 2007). Furthermore, many creek and headwater basezones are connected to each other and cover a large portion of the watersheds, thereby magnifying the problem of overprediction (Fig. 11, Fig. 12). The FPDEMS method successfully removed these cut-off planforms; pixels therefore received accurate cost distance values given their location to source cells. As a result, the determined cost distance thresholds effectively cut off areas that are not likely to be dynamically linked to creeks or headwaters (Fig. 14).
The area of floodplain derived from smoothed DEM was considerably smaller than those derived from raw LiDAR DEMs. For instance, in the Lower St. John River Watershed, total floodplain areas (wet and non-wet) derived from raw and smoothed 5-m LiDAR DEMs are approximately 3130.16 km2 and 1552.98 km2, respectively, a decrease of 1577.18 km2 (>50%) (Table 3). The area of riparian wetland shows a similar trend in both study watersheds: in the Miramichi River Basin, the area of riparian wetland decreases from 1200.37 km2 to 889.88 km2 (25%) with smoothing of 5-m LiDAR DEM (Table 3). This result is not surprising, since the FPDEMS algorithm removed many cut-off planforms (i.e., areas of low slope likely to be misidentified as riparian wetlands). An increasing trend in area of steep slope with smoothing can be found in both watersheds (Table 3), also explained by removal of cut-off planforms.
Table 3 A comparison of raw DEM-derived ARA and smoothed DEM derived ARA (in sq km)
a Lower St. John River Watershed
DEM resolution
|
Floodplain
(wet) (non-wet)
|
Terraces
(wet) (non-wet)
|
Wetland
|
Steep slope
|
MCZs (60-m)
|
5-m
|
2625.84
|
504.32
|
244.47
|
157.91
|
1181.33
|
906.85
|
418.82
|
3-m
|
3246.26
|
544.78
|
447.93
|
206.88
|
1370.5
|
1003.65
|
407.39
|
smoothed 5-m
|
1314.33
|
238.65
|
227.21
|
170.74
|
826.17
|
992.02
|
529.36
|
smoothed 3-m
|
1415.77
|
281.91
|
215.94
|
132.01
|
1008.62
|
1034.96
|
531.4
|
b Miramichi River Basin
DEM resolution
|
Floodplain
(wet) (non-wet)
|
Terraces
(wet) (non-wet)
|
Wetland
|
Steep slope
|
MCZs (60-m)
|
5-m
|
2452.88
|
94.84
|
220.31
|
52.36
|
1200.37
|
778.82
|
178.12
|
3-m
|
3075.09
|
163.08
|
258.08
|
57.07
|
1337.34
|
883.67
|
196.03
|
smoothed 5-m
|
1235.28
|
39.37
|
166.84
|
46.3
|
889.88
|
851.3
|
218.86
|
smoothed 3-m
|
1289.5
|
51.1
|
205.73
|
46.58
|
967.37
|
886.08
|
214.18
|
3.3 Effects of DEM Error on Topographic and Hydrologic Modelling
3.3.1 DEM error and uncertainty
RMSE values increased with decreasing resolution of resampled LiDAR DEMs, indicating lower accuracy of lower- as compared to higher-resolution LiDAR DEMs, with the same trend found in both study watersheds. For instance, in the Lower St. John River Watershed, RMSEs range from 0.2588 m to 1.0281 m, increasing for all resampled LiDAR DEMs as the resolution decreases from 3-m to 30-m (Table 4). Additionally, RMSEs for SRTM 30-m DEMs are significantly higher than for resampled 30-m LiDAR DEMs, by approximately 4 times in both study watersheds, indicating overall low accuracy of SRTM DEMs as compared to LiDAR DEMs of the same resolution. It is also interesting to note that RMSEs of smoothed high-resolution DEMs and raw high-resolution DEMs differ only marginally (Table 4), indicating the ability of the FPDEMS method to preserve original elevation values.
Table 4 RMSE of different DEM datasets
|
Lower St. John River Watershed
|
Miramichi River Basin
|
SRTM-30m
|
4.1855
1.0281
0.6132
0.4626
0.3376
0.2588
0.4443
0.3067
|
3.8066
0.8854
0.6148
0.4539
0.3550
0.2702
0.4509
0.3018
|
30-m
|
15-m
|
10-m
|
5-m
|
3-m
|
5-m smooth
|
3-m smooth
|
3.3.2 Effects of DEM Error on Topographic Modelling
Maximum slope values increase dramatically as the resolutions of resampled LiDAR DEMs increase (or RMSE values decrease) (Fig. 15). For example, maximum slope value increases from approximately 60 to 80 degrees as LiDAR DEM resolution increases from 30-m (RMSE = 1.0281) to 3-m (RMSE= 0.2588) in the Lower St. John River Watershed (Fig. 15). Because smoothed and raw high-resolution LiDAR DEMs have similar RMSE values, the ranges of their slope values are similar to each other (Fig. 15), reflecting an ideal characteristic of the FPDEMS in terms of important topographic feature preservation. The inner value distributions of slope grids, however, differ between smoothed and raw high-resolution LiDAR DEMs (Fig. 15). For instance, in both study watersheds, interquartile ranges (i.e., 25th to 75th quartiles) of derived slopes from smoothed high-resolution LiDAR DEMs are smaller than those from raw high-resolution LiDAR DEMs, as the FPDEMS method removed several planforms with low-slope values.
3.3.2 Effects of DEM Error and Uncertainty on Hydrologic Modelling
TMIs derived from DEMs with low RMSEs tend to follow a normal distribution; in contrast, TMIs derived from DEMs with high RMSEs are positively skewed, though it is difficult to comment on the accuracy of one distribution over another in the absence of reference data. In the Miramichi River Basin, for instance, the difference between median (744) and mean (747) values of 5-m LiDAR DEM (RMSE = 0.3550) derived TMI is 3; differences between mean and median TMI value increase to 162.32 and 217.89, respectively, for the TMIs derived from 30-m LiDAR DEM (RMSE = 0.8854) and 30-m SRTM DEM (RMSE = 3.8066) (Table 5). A declining trend can be seen in both mean and median TMI values as DEM RMSEs increase; a similar trend can be found in both study watersheds (Table 5), indicating that more pixels received lower TMI values in the low-quality DEM-based parallel analyses, possibly explaining in part the underprediction issue of riparian wetland. Additionally, the DEM smoothing algorithm lowered the mean and median values of TMI in both study watersheds, which partially explains the declining trend in the area of riparian wetland shown in the Table 3, as more pixels received lower TMI values and were considered dry areas.
Table 5 Distribution of different DEM-derived TMIs
|
Lower St. John River Watershed
|
Miramichi River Basin
|
|
Mean
|
Median
|
Std. Dev
|
Mean
|
Median
|
Std. Dev
|
SRTM 30-m
|
109.87
|
-127
|
1132.13
|
87.89
|
-130
|
1066.91
|
30-m
|
396.9
|
140
|
1335.21
|
294.32
|
132
|
1120.74
|
15-m
|
491.51
|
309
|
1213.4
|
432.74
|
341
|
945.1
|
10-m
|
504.27
|
426
|
971.19
|
514.63
|
455
|
912.5
|
5-m
|
762.74
|
721
|
990.53
|
747
|
744
|
908.28
|
3-m
|
1037.87
|
1006
|
1001.8
|
991.37
|
1005
|
900.09
|
5-m smooth
|
585.06
|
567
|
867.53
|
413.19
|
410
|
654.09
|
3-m smooth
|
767.53
|
734
|
891.33
|
447.06
|
440
|
629.36
|
3.4 Accuracy-Efficiency Trade-Off Analysis
3.4.1 Accuracy Assessment
The correlation coefficients (R2) between Kappa Coefficient and RMSE in the watersheds are approximately 0.6 and 0.75, indicating that the overall accuracy (i.e., Kappa Coefficient) of ARA results is subject to the input DEM quality (i.e., RMSE) (Fig. 16). The correlation between RMSEs and Kappa Coefficients of raw high-resolution LiDAR-DEM derived ARAs, however, does not fit this trend (Fig. 16), as the creek and headwater basezone extents are grossly inaccurate due to over-detailed topographic representation (Fig. 14). In addition to the reference ARA, the 5-m smoothed LiDAR DEM-derived ARAs achieved highest overall accuracies in final ARA output, with Kappa Coefficients near 0.8 in both study watersheds (Table 6). Since the SRTM-DEM has the highest RMSE value, the Kappa Coefficients of 30-m SRTM-DEM derived ARAs are smaller than those of 30-m LiDAR DEM derived ARAs in both study watersheds, reflecting the weak ability of SRTM-DEM in terms of ARA delineation as compared to LiDAR DEM of the same spatial resolution.
Table 6 Kappa Coefficients of different DEM-derived ARAs
|
Kappa Coefficient
|
|
Lower St. John River Watershed
|
Miramichi River Basin
|
SRTM 30-m
|
0.5187
|
0.4564
|
30-m
|
0.5952
|
0.5903
|
15-m
|
0.6251
|
0.6611
|
10-m
|
0.6647
|
0.6789
|
5-m
|
0.6387
|
0.6092
|
3-m
|
0.5252
|
0.4822
|
5-m smooth
|
0.7884
|
0.8247
|
3-m smooth
|
1.0000
|
1.0000
|
3.4.2 Efficiency Assessment
Using consistent computational power (i.e., laptop with 6-core 2.2 GHz processor and 24 GB of memory), there are moderate differences in total runtime for key geoprocessing tools among low-resolution LiDAR DEM-based analyses (Table 7). In contrast, a significant increase in runtime is evident once LiDAR DEM spatial resolution reaches 5-m. Accordingly, the 5-m LiDAR DEM can be assumed as a turning point in runtime in both study watersheds. The overall accuracy of 5-m LiDAR DEM derived ARA, however, is relatively low due to the inaccurate delineation of creek and headwater basezones. It is also interesting to note that the DEM smoothing algorithm saves ~30% in data processing time by smoothing noisy microtopographic detail. For instance, in the Miramichi River Basin, total runtime decreases from 591 to 414 minutes for raw 3-m and smoothed 3-m DEM, respectively (Table 7).
Table 7 Runtime (minutes) of key geoprocessing tools
|
Lower St. John River Watershed
|
Miramichi River Basin
|
|
Batch cost distance
|
Flow accumulation
|
Batch cost distance
|
Flow accumulation
|
SRTM 30-m
|
N 3 mins9s
|
2 mins
|
4 mins
|
2 mins
|
30-m
|
3 mins
|
2 mins
|
4 mins
|
2 mins
|
15-m
|
9 mins
|
6 mins
|
12 mins
|
7 mins
|
10-m
|
25 mins
|
12 mins
|
25 mins
|
13 mins
|
5-m
|
152 mins
|
38 mins
|
141 mins
|
32 mins
|
3-m
|
521 mins
|
80 mins
|
516 mins
|
75 mins
|
5-m smooth
|
89 mins
|
46 mins
|
73 mins
|
99 mins
|
3-m smooth
|
277 mins
|
103 mins
|
261 mins
|
153 mins
|
3.4.3 Accuracy-Efficiency Trade-Off
The accuracy-efficiency curve was created using runtime and Kappa Coefficient as variables. A strong correlational relationship was detected between the accuracy and efficiency variables, with the coefficient greater than 0.9 in both study watersheds (Fig. 17). The inflection point exists at the 5-m smoothed LiDAR DEM, with Kappa Coefficient at approximately 0.8 while data processing time remains low (Fig. 17). As indicated by Cohen (1960), Kappa Coefficient greater than “0.8” represents perfect agreement between delineation and observation (i.e., 3-m smoothed DEM-derived ARA). The 5-m smoothed LiDAR DEMs therefore achieves high accuracy in ARA results. Although 3-m smoothed LiDAR DEMs can achieve the most accurate ARA results in both watersheds, runtimes to process 3-m and 5-m smoothed LiDAR DEMs differ greatly (by almost 3 times), indicating that 3-m smoothed LiDAR DEM is less efficient than 5-m smoothed LiDAR DEM. To balance accuracy and efficiency, 5-m smoothed LiDAR DEMs are recommended for future ARA delineations, especially across large spatial extents or multiple watersheds.
This recommendation should be applied carefully, however, since the accuracy-efficiency trade-off analysis is not without limitations. Although it has been well acknowledged in the literature that high-resolution LiDAR DEMs can achieve higher accuracy in results in terms of floodplain delineation (Zhao et al., 2010, Tan et al., 2018), there is no reference literature to demonstrate that ARA studies also fit this trend. The reliability of the reference ARA (i.e., 3-m smoothed LiDAR DEM derived ARA) needs further examination; and, the result of trade-off analyses may differ if the reference ARA changes. Nevertheless, the accuracy assessment framework provides a unique lens through which to effectively assess ARA accuracy. In future studies, ground reference surveys are recommended to verify and enhance the reliability of the reference ARA. Additionally, ground reference surveys can enhance the accuracy of RMSE values calculated for different DEMs by replacing the reference elevation values extracted from 1-m LiDAR DEM with elevation values measured in the field.
The RMSE was applied to indicate DEM quality in this study, which assumes error to be aspatial. Error related to the DEM, however, varies spatially and cannot be sufficiently assessed by a global metric such as RMSE (Hawker et al. 2018). Indeed, scientists have observed that local DEM error can be large and spatially correlated, though global RMSE is small (Holmes et al. 2000, Bater and Coops 2009), and thus it is possible that the optimal DEM resolution for ARA delineation is landscape specific. More comprehensive ways to consider DEM error from a spatial perspective (or landscape perspective), such as Classification and Regression Tree (CART) analysis (Bater and Coops 2009) and Monte Carlo-based Sequential Gaussian Simulation (SGS) analysis (Fereshtehpour and Karamouz 2018), is therefore required. Such analyses can allow the DEM user to better understand the relationship between DEM quality and accuracy of ARA. Optimal DEM for ARA delineation may also vary with differences in landscape features, and thus, ideally, or eventually, it is anticipated that optimal DEM will be identified for specific landscape contexts in future applications.