Accuracy Assessment of DEMs in Different Topographic Complexity Based on an Optimum Number of GCP Formulation and Error Propagation Analysis
Publication: Journal of Surveying Engineering
Volume 146, Issue 1
Abstract
One of the main concerns during digital elevation model (DEM) evaluation is the number of ground control points (GCP). Accordingly, in this paper, a new method is proposed for calculating the appropriate number of GCPs for DEM evaluation based on a confidence interval (CI) of the root-mean-square error (RMSE). This method was employed to determine the CI of the estimated vertical accuracy of Advanced Land Observing Satellite (ALOS) World 3D-30m (AW3D30), Shuttle Radar Topography Mission (SRTM), and Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER) Global Digital Elevation Model (GDEM) Free 30 m resolution global DEMs in mountainous, hilly, flat, and urban regions of two study areas. To provide a more reliable estimation of errors, robust statistical methods, including median, normalized median absolute deviation (NMAD), and Huber’s and were also investigated. Furthermore, a new formulation was developed to analyze the propagation of the errors in the slope and aspect products of DEM. The results showed that, to evaluate the accuracy of AW3D30, ASTER GDEM, and SRTM with a CI of and the probability of 99%, in the study area, a minimum number of 2,110, 1,483 and 750 GCPs are required, respectively. The results also showed that, in the flat, hilly, and mountainous study areas, AW3D30 was the most accurate DEM. However, SRTM fit better to the urban study area. Finally, the results of the error propagation analysis illustrated that the slope and aspect errors bore a striking relation to the surface gradient.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
•
Some or all data, models, or code used during this study were provided by a third party (3D coordinates of GCPs). Direct requests for these materials may be made to the provider indicated in the Acknowledgments.
•
Some or all data, models, or code generated or used during the study are available from the corresponding author by request (the corresponding elevation of GCPs from SRTM, AW3D30, and ASTER GDEM).
Acknowledgments
The authors would like to thank the municipality of Isfahan and the Exploration Management of the National Iranian Oil Company for providing the GCPs for the urban area as well as the altimetry points for the mountainous, hilly, and the flat study areas in the west of Iran.
References
Amiri-Simkooei, A. 2003. “Formulation of norm minimization in Gauss-Markov models.” J. Surv. Eng. 129 (1): 37–43. https://doi.org/10.1061/(ASCE)0733-9453(2003)129:1(37).
Becek, K., W. Koppe, and Ş. H. Kutoğlu. 2016. “Evaluation of vertical accuracy of the WorldDEM™ using the runway method.” Remote Sens. Environ. 8 (11): 934. https://doi.org/10.3390/rs8110934.
Bolkas, D., G. Fotopoulos, A. Braun, and I. N. Tziavos. 2016. “Assessing digital elevation model uncertainty using GPS survey data.” J. Surv. Eng. 142 (3): 04016001. https://doi.org/10.1061/(ASCE)SU.1943-5428.0000169.
Cai, X., and D. Wang. 2006. “Spatial autocorrelation of topographic index in catchments.” J. Hydrol. 328 (3): 581–591. https://doi.org/10.1016/j.jhydrol.2006.01.009.
Chappell, N. A., S. Vongtanaboon, Y. Jiang, and N. Tangtham. 2006. “Return-flow prediction and buffer designation in two rainforest headwaters.” For. Ecol. Manage. 224 (1): 131–146. https://doi.org/10.1016/j.foreco.2005.12.013.
Darnell, A. R., N. J. Tate, and C. Brunsdon. 2008. “Improving user assessment of error implications in digital elevation models.” Comput. Environ. Urban Syst. 32 (4): 268–277. https://doi.org/10.1016/j.compenvurbsys.2008.02.003.
DeMers, M. N. 2002. GIS modeling in raster. New York: Wiley.
Dragut, L., and C. Eisank. 2011. “Object representations at multiple scales from digital elevation models.” Geomorphology 129 (3): 183–189. https://doi.org/10.1016/j.geomorph.2011.03.003.
Du, X., H. Guo, X. Fan, J. Zhu, Z. Yan, and Q. Zhan. 2016. “Vertical accuracy assessment of freely available digital elevation models over low-lying coastal plains.” Int. J. Digital Earth 9 (3): 252–271. https://doi.org/10.1080/17538947.2015.1026853.
Eckert, S., T. Kellenberger, and K. Itten. 2005. “Accuracy assessment of automatically derived digital elevation models from ASTER data in mountainous terrain.” Int. J. Remote Sens. 26 (9): 1943–1957. https://doi.org/10.1080/0143116042000298306.
Elkhrachy, I. 2017. “Vertical accuracy assessment for SRTM and ASTER digital elevation models: A case study of Najran City, Saudi Arabia.” Ain Shams Eng. J. 9 (4): 1807–1817. https://doi.org/10.1016/j.asej.2017.01.007.
El-Sheimy, N., C. Valeo, and A. Habib. 2005. Digital terrain modeling: Acquisition, manipulation, and application. Norwood, MA: Artech House.
Frey, H., and F. Paul. 2012. “On the suitability of the SRTM DEM and ASTER GDEM for the compilation of topographic parameters in glacier inventories.” Int. J. Appl. Earth Obs. Geoinf. 18 (Aug): 480–490. https://doi.org/10.1016/j.jag.2011.09.020.
Gesch, D. B., M. J. Oimoen, J. J. Danielson, and D. Meyer. 2016. “Validation of the ASTER global digital elevation model version 3 over the conterminous United States.” In Proc., 23rd ISPRS Congress, 143–148. Prague, Czech Republic: International Society for Photogrammetry and Remote Sensing.
Glennie, C. 2018. “Arctic high-resolution elevation models: Accuracy in sloped and vegetated terrain.” J. Surv. Eng. 144 (1): 06017003. https://doi.org/10.1061/(ASCE)SU.1943-5428.0000245.
Hladik, C., and M. Alber. 2012. “Accuracy assessment and correction of a LIDAR-derived salt marsh digital elevation model.” Remote Sens. Environ. 121 (Jun): 224–235. https://doi.org/10.1016/j.rse.2012.01.018.
Höhle, J., and M. Höhle. 2009. “Accuracy assessment of digital elevation models by means of robust statistical methods.” ISPRS J. Photogramm. Remote Sens. 64 (4): 398–406. https://doi.org/10.1016/j.isprsjprs.2009.02.003.
Hu, Z., J. Peng, Y. Hou, and J. Shan. 2017. “Evaluation of recently released open global digital elevation models of Hubei, China.” Remote Sens. 9 (3): 262. https://doi.org/10.3390/rs9030262.
Huber, P. J. 2011. Robust statistics. Berlin: Springer.
Isfahan Municipality Information and Communication Technology (ICT) Organization. 2014. Design and construction of GPS-leveling network in Isfahan City. [In Persian.] Isfahan, Iran: Isfahan Municipality ICT Organization.
Jain, A. O., T. Thaker, A. Chaurasia, P. Patel, and A. K. Singh. 2017. “Vertical accuracy evaluation of SRTM-GL1, GDEM-V2, AW3D30 and CartoDEM-V3.1 of 30-m resolution with dual frequency GNSS for lower Tapi Basin India.” Geocarto Int. 33 (11): 1237–1256. https://doi.org/10.1080/10106049.2017.1343392.
JAXA (Japan Aerospace Exploratory Agency). 2018. “ALOS global digital surface model ‘ALOS World 3D-30m (AW3D30)’.” Accessed November 20, 2018. https://www.eorc.jaxa.jp/ALOS/en/aw3d30/.
Kenward, T., D. P. Lettenmaier, E. F. Wood, and E. Fielding. 2000. “Effects of digital elevation model accuracy on hydrologic predictions.” Remote Sens. Environ. 74 (3): 432–444. https://doi.org/10.1016/S0034-4257(00)00136-X.
Kiamehr, R., and L. Sjöberg. 2005. “Effect of the SRTM global DEM on the determination of a high-resolution geoid model: A case study in Iran.” J. Geod. 79 (9): 540–551. https://doi.org/10.1007/s00190-005-0006-8.
Li, Z., C. Zhu, and C. Gold. 2004. Digital terrain modeling: Principles and methodology. Boca Raton, FL: CRC Press.
Liu, X. H., H. Hu, and P. Hu. 2015. “Accuracy assessment of LIDAR-derived digital elevation models based on approximation theory.” Remote Sens. 7 (6): 7062–7079. https://doi.org/10.3390/rs70607062.
Merry, C. 2003. “DEM-induced errors in developing a quasi-geoid model for Africa.” J. Geod. 77 (9): 537–542. https://doi.org/10.1007/s00190-003-0353-2.
Mispan, M. R., M. Z. A. Rasid, N. F. A. Rahman, K. Khalid, S. H. Haron, and N. Ahmad. 2015. “Assessment of ASTER and SRTM derived digital elevation model for highland areas of Peninsular Malaysia region.” Int. Res. J. Eng. Technol. 2 (6): 316–320.
Montgomery, D. C., and G. C. Runger. 2010. Applied statistics and probability for engineers. New York: Wiley.
Muir, J., N. Goodwin, J. Armston, S. Phinn, and P. Scarth. 2017. “An accuracy assessment of derived digital elevation models from terrestrial laser scanning in a sub-tropical forested environment.” Remote Sens. 9 (8): 843. https://doi.org/10.3390/rs9080843.
Mukherjee, S., P. Joshi, S. Mukherjee, A. Ghosh, R. Garg, and A. Mukhopadhyay. 2013. “Evaluation of vertical accuracy of open source digital elevation model (DEM).” Int. J. Appl. Earth Obs. Geoinf. 21: 205–217. https://doi.org/10.1016/j.jag.2012.09.004.
NASA (National Aeronautical Space Administration). 2018b. “Earthdata search application: SRTM.” Accessed November 20, 2018. https://search.earthdata.nasa.gov/search/granules?p=C1000000240-LPDAAC_ECS&g=G1004581359-LPDAAC_ECS&m=29.7421875!49.04296875!4!1!0!0%2C2.
NASA (National Aeronautical Space Administration). 2018a. “Earthdata search application: ASTER GDEM.” Accessed November 20, 2018. https://search.earthdata.nasa.gov/search/granules?p=C197265171-LPDAAC_ECS&m=31.078125!50.9765625!4!1!0!0%2C2.
NASA (National Aeronautics and Space Administration). 2018. “EGM96: The NASA GSFC and NIMA joint geopotential model.” Accessed September 16, 2019. https://cddis.nasa.gov/926/egm96/egm96.html.
National Iranian Oil Company. 2016. GPS-leveling point grid construction for exploration porposes. [In Persian.] Teharn, Iran: National Iranian Oil Company.
Nguyen, T. 2015. “Optimal ground control points for geometric correction using genetic algorithm with global accuracy.” Eur. J. Remote Sens. 48 (1): 101–120. https://doi.org/10.5721/EuJRS20154807.
Oniga, V. E., A. I. Breaban, and F. Statescu. 2018. “Determining the optimum number of ground control points for obtaining high precision results based on UAS images.” In Vol. 2 of Proc., Int. Electronic Conf. on Remote Sensing, 352. Basel, Switzerland: Multidisciplinary Digital Publishing Institute.
Patel, A., S. K. Katiyar, and V. Prasad. 2016. “Performances evaluation of different open source DEM using differential global positioning system (DGPS).” Egypt. J. Remote Sens. Space. Sci. 19 (1): 7–16. https://doi.org/10.1016/j.ejrs.2015.12.004.
Ramlal, B., and S. M. Baban. 2008. “Developing a GIS based integrated approach to flood management in Trinidad, West Indies.” J. Environ. Manage. 88 (4): 1131–1140. https://doi.org/10.1016/j.jenvman.2007.06.010.
Rexer, M., and C. Hirt. 2014. “Comparison of free high resolution digital elevation data sets (ASTER GDEM2, SRTM v2.1/v4.1) and validation against accurate heights from the Australian national gravity database.” Aust. J. Earth Sci. 61 (2): 213–226. https://doi.org/10.1080/08120099.2014.884983.
Rodriguez, E., C. S. Morris, and J. E. Belz. 2006. “A global assessment of the SRTM performance.” Photogramm. Eng. Remote Sens. 72 (3): 249–260. https://doi.org/10.14358/PERS.72.3.249.
Rodriguez, E., C. S. Morris, J. E. Belz, E. C. Chapin, J. M. Martin, W. Daffer, and S. Hensley. 2005. An assessment of the SRTM topographic product. Pasadena, CA: Jet Propulsion Laboratory.
Romanowicz, R. J., P. C. Young, K. J. Beven, and F. Pappenberger. 2008. “A data based mechanistic approach to nonlinear flood routing and adaptive flood level forecasting.” Adv. Water Resour. 31 (8): 1048–1056. https://doi.org/10.1016/j.advwatres.2008.04.015.
Rudin, W. 1964. Principles of mathematical analysis. New York: McGraw-Hill.
Shan, J., M. Zaheer, and E. Hussain. 2003. “Study on accuracy of 1-degree DEM versus topographic complexity using GIS zonal analysis.” J. Surv. Eng. 29 (2): 85–95. https://doi.org/10.1061/(ASCE)0733-9453(2003)129:2(85).
Sun, G., K. J. Ranson, V. I. Kharuk, and K. Kovacs. 2003. “Validation of surface height from shuttle radar topography mission using shuttle laser altimeter.” Remote Sens. Environ. 88 (4): 401–411. https://doi.org/10.1016/j.rse.2003.09.001.
Szabó, G., S. K. Singh, and S. Szabó. 2015. “Slope angle and aspect as influencing factors on the accuracy of the SRTM and the ASTER GDEM databases.” Phys. Chem. Earth. 83–84: 137–145. https://doi.org/10.1016/j.pce.2015.06.003.
Tachikawa, T., M. Kaku, A. Iwasaki, D. Gesch, M. Oimoen, Z. Zhang, J. Danielson, T. Krieger, B. Curtis, and J. Haase. 2011. ASTER global digital elevation model version 2—Summary of validation results. Edited by M. Dave. Washington, DC: NASA.
Tadono, T., H. Ishida, F. Oda, S. Naito, K. Minakawa, and H. Iwamoto. 2014. “Precise global DEM generation by ALOS PRISM.” In Proc., ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 71–76. Heipke, Germany: International Society for Photogrammetry and Remote Sensing.
Tadono, T., H. Nagai, H. Ishida, F. Oda, S. Naito, K. Minakawa, and H. Iwamoto. 2016. “Generation of the 30m mesh global digital surface model by ALOS PRISM.” In Proc., Int. Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 157–162. Heipke, Germany: International Society for Photogrammetry and Remote Sensing.
Takaku, J., and T. Tadono. 2017. “Quality updates of ‘AW3D’global DSM generated from ALOS PRISM.” In Proc., Geoscience and Remote Sensing Symposium (IGARSS), 5666–5669. New York: IEEE.
Varga, M., and T. Bašić. 2015. “Accuracy validation and comparison of global digital elevation models over Croatia.” Int. J. Remote Sens. 36 (1): 170–189. https://doi.org/10.1080/01431161.2014.994720.
Wang, B., W. Shi, and E. Liu. 2015. “Robust methods for assessing the accuracy of linear interpolated dem.” Int. J. Appl. Earth Obs. Geoinf. 34 (Feb): 198–206. https://doi.org/10.1016/j.jag.2014.08.012.
Wessel, B., M. Huber, C. Wohlfart, U. Marschalk, D. Kosmann, and A. Roth. 2018. “Accuracy assessment of the global TanDEM-X digital elevation model with GPS data.” ISPRS J. Photogramm. Remote Sens. 139 (May): 171–182. https://doi.org/10.1016/j.isprsjprs.2018.02.017.
Wilcox, R. 2012. Introduction to robust estimation and hypothesis testing. 3rd ed. Boston: Academic.
Wolock, D. M., and C. V. Price. 1994. “Effects of digital elevation model map scale and data resolution.” Water Resour. Res. 30 (11): 3041–3052. https://doi.org/10.1029/94WR01971.
Yap, L., L. H. Kandé, R. Nouayou, J. Kamguia, N. A. Ngouh, and M. B. Makuate. 2018. “Vertical accuracy evaluation of freely available latest high-resolution (30 m) global digital elevation models over Cameroon (Central Africa) with GPS/leveling ground control points.” Int. J. Digital Earth 12 (5): 500–524. https://doi.org/10.1080/17538947.2018.1458163.
Zandbergen, P. A. 2008. “Positional accuracy of spatial data: Non-normal distributions and a critique of the national standard for spatial data accuracy.” Trans. GIS 12 (1): 103–130. https://doi.org/10.1111/j.1467-9671.2008.01088.x.
Zhao, S., W. Cheng, C. Zhou, X. Chen, S. Zhang, Z. Zhou, H. Liu, and H. Chai. 2011. “Accuracy assessment of the ASTER GDEM and SRTM3 DEM: An example in the Loess Plateau and North China Plain of China.” Int. J. Remote Sens. 32 (23): 8081–8093. https://doi.org/10.1080/01431161.2010.532176.
Zhu, L., and C. Jekeli. 2009. “Gravity gradient modeling using gravity and DEM.” J. Geod. 83 (6): 557–567. https://doi.org/10.1007/s00190-008-0273-2.
Information & Authors
Information
Published In
Journal of Surveying Engineering
Volume 146 • Issue 1 • February 2020
Copyright
©2019 American Society of Civil Engineers.
History
Received: Sep 14, 2018
Accepted: Jun 12, 2019
Published online: Oct 30, 2019
Published in print: Feb 1, 2020
Discussion open until: Mar 30, 2020
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.