Abstract

Sedimentation processes in reservoirs can jeopardize their functionality and compromise dam safety. Climate change and associated hydrologic uncertainty are introducing additional stressors to US reservoirs, and data-driven indicators of climate impacts on upstream soil erosion and reservoir sedimentation processes are crucial to evaluate their aggradation and life expectancy. The US Army Corps of Engineers developed the Enhancing Reservoir Sedimentation Information for Climate Preparedness and Resilience (RSI) system to consolidate historical information of elevation-capacity surveys. However, the multiple surveying technologies, protocols, and computational analysis methods used over the service life of reservoirs can impact the quality of reservoir survey data in the RSI system. The objective of this study was to develop a methodology to detect anomalous records and identify multivariate relationships between historical sedimentation data for 184 US reservoirs and associated watershed variables. For this purpose, unsupervised machine learning techniques including principal component analysis (PCA), autonomous anomaly detection, and Kolmogorov–Smirnov and Efron anomaly detection were assembled in an anomaly detection protocol that led to the detection of 20 reservoirs with anomalous records. The variables contributing most to anomaly detection were related to elevation characteristics (watershed and channel slopes, and minimum elevation), precipitation (maximum and cumulative monthly precipitation), dam properties (time since dam completion and initial trap efficiency), and curve number (CN). PCA results indicated that reservoirs in the Mediterranean California ecoregion, although experiencing substantial extreme precipitation events, had small basin areas and CN values that reflected in small capacity losses, contrasting with larger capacity losses found at reservoirs in the Great Plains and Eastern Temperate Forests ecoregions. The developed anomaly detection protocol represents a powerful tool for the analysis and monitoring of this large and heterogeneous data set with the potential of providing reliable information on the impacts of historical climate and watershed properties on erosion and sedimentation processes in US reservoirs.

Practical Applications

The US Army Corps of Engineers created the Reservoir Sedimentation Information (RSI) system to compile historical reservoir elevation-capacity data collected using various measurement protocols, instruments, and analysis methods. These differences in data collection and analysis methods, in addition to any human error, can result in anomalies that require detection and correction before the dissemination of the data set for further usage. Data anomalies are values that deviate from normal or expected patterns. Apparent erroneous data, related to duplicate records or increases in reservoir capacities, can be flagged through a preliminary analysis. However, the detection of anomalies in an automated and fully data-driven way represents a powerful tool for the maintenance and monitoring of this large and heterogeneous data set. A depurated RSI data set is a potential major data source for large-scale and long-term studies related to sedimentation rates and suspended solid loads in freshwater systems due to the spatial and temporal scale of its records. This kind of data set will allow the development of effective management plans for reservoir operation, maintenance, and upstream erosion control as well as enabling the indirect monitoring of suspended sediment loads in freshwater systems at a nationwide scale.

Get full access to this article

View all available purchase options and get full access to this article.

Data Availability Statement

Data from the USACE RSI system are not currently publicly available. The USACE is conducting quality control of the database and plans to publicly release the data following completion of that effort. Watershed related data were derived from publicly available resources cited accordingly in the “Data Set Development” section.

Acknowledgments

This research was supported by the US National Science Foundation (Award # 1948940) and the WATER Institute at Saint Louis University.

References

Aguado, D., T. Montoya, L. Borras, A. Seco, and J. Ferrer. 2008. “Using SOM and PCA for analysing and interpreting data from a P-removal SBR.” Eng. Appl. Artif. Intell. 21 (6): 919–930. https://doi.org/10.1016/j.engappai.2007.08.001.
Ahmadi, A., M. A. Zolfagharipoor, and A. A. Afzali. 2019. “Stability analysis of stakeholders’ cooperation in inter-basin water transfer projects: A case study.” Water Resour. Manage. 33 (1): 1–18. https://doi.org/10.1007/s11269-018-2065-7.
Ahmed, N. K., A. F. Atiya, N. El Gayar, and H. El-Shishiny. 2010. “An empirical comparison of machine learning models for time series forecasting.” Econom. Rev. 29 (5–6): 594–621. https://doi.org/10.1080/07474938.2010.481556.
Angelov, P., X. Gu, D. Kangin, and J. Principe. 2016. “Empirical data analysis: A new tool for data analytics.” In Proc., 2016 IEEE Int. Conf. on Systems, Man, and Cybernetics (SMC), 52–59. New York: IEEE.
ASCE. 1975. Sedimentation engineering. Reston, VA: ASCE.
Avendaño Salas, C., M. E. Sanz Montero, R. Cobo Rayán, and J. L. Gómez Montaña. 1997. “Sediment yield at Spanish reservoirs and its relationships with the drainage basin area.” In Vol. 74 of Proc., 19th Symp. on Large Dams. Florence, Italy: International Committee on Large Dams.
Azamathulla, H. M., A. Ab Ghani, C. K. Chang, Z. Abu Hasan, and N. A. Zakaria. 2010. “Machine learning approach to predict sediment load—A case study.” Clean-Soil Air Water 38 (10): 969–976. https://doi.org/10.1002/clen.201000068.
Barnes, B. B., C. M. Hu, C. Kovach, and R. N. Silverstein. 2015. “Sediment plumes induced by the Port of Miami dredging: Analysis and interpretation using Landsat and MODIS data.” Remote Sens. Environ. 170 (Mar): 328–339. https://doi.org/10.1016/j.rse.2015.09.023.
Bolshakova, N., and F. Azuaje. 2003. “Cluster validation techniques for genome expression data.” Signal Process. 83 (4): 825–833. https://doi.org/10.1016/S0165-1684(02)00475-9.
Brakstad, F. 1992. “A comprehensive pollution survey of polychlorinated dibenzo-p-dioxins and dibenzofurans by means of principal component analysis and partial least-squares regression.” Chemosphere 25 (11): 1611–1629. https://doi.org/10.1016/0045-6535(92)90309-F.
Brown, C. B. 1944. “Sedimentation in reservoirs.” Trans. Am. Soc. Civ. Eng. 109: 1080–1086.
Brune, G. M. 1953. “Trap efficiency of reservoirs.” Trans. Am. Geophys. Union 34 (Jul): 407–418. https://doi.org/10.1029/TR034i003p00407.
Cheng, B., S. Qian, J. Cao, G. Xue, J. Yu, Y. Zhu, and M. Li. 2019. “DOAD: An online dredging operation anomaly detection method based on AIS data.” In Proc., 2019 Int. Joint Conf. on Neural Networks (IJCNN), 1–7. New York: IEEE.
Chiomento, J. L. T., E. P. Lima, M. D’Agostini, F. S. De Nardi, T. D. Trentin, A. G. Dornelles, J. Huzar-Novakowiski, and E. O. Calvete. 2021. “Horticultural potential of nine strawberry cultivars by greenhouse production in Brazil: A view through multivariate analysis.” Sci. Hortic. 279 (Mar): 109738. https://doi.org/10.1016/j.scienta.2020.109738.
Chong, Y. S., and Y. H. Tay. 2017. Abnormal event detection in videos using spatiotemporal autoencoder.” In Proc., Int. Symp. on Neural Networks, 189–196. New York: Springer.
Choubin, B., H. Darabi, O. Rahmati, F. Sajedi-Hosseini, and B. Klove. 2018. “River suspended sediment modelling using the CART model: A comparative study of machine learning techniques.” Sci. Total Environ. 615 (Dec): 272–281. https://doi.org/10.1016/j.scitotenv.2017.09.293.
Cox, A. L., D. Meyer, A. Botero-Acosta, V. Sagan, I. Demir, M. Muste, P. Boyd, and C. Pathak. 2024. “Estimating reservoir sedimentation using machine learning.” J. Hydrol. Eng. 29 (4): 04024016. https://doi.org/10.1061/JHYEFF.HEENG-6135.
Daly, C., J. I. Smith, and K. V. Olson. 2015. “Mapping atmospheric moisture climatologies across the conterminous United States.” PLoS One 10 (10): e0141140. https://doi.org/10.1371/journal.pone.0141140.
Daszykowski, M., K. Kaczmarek, Y. V. Heyden, and B. Walczak. 2007. “Robust statistics in data analysis—A review: Basic concepts.” Chemom. Intell. Lab. Syst. 85 (2): 203–219. https://doi.org/10.1016/j.chemolab.2006.06.016.
Davies, D. L., and D. W. Bouldin. 1979. “A cluster separation measure.” IEEE Trans. Pattern Anal. Mach. Intell. PAMI-1 (2): 224–227. https://doi.org/10.1109/TPAMI.1979.4766909.
Demiray, B. Z., M. Sit, and I. Demir. 2021. “D-SRGAN: DEM super-resolution with generative adversarial networks.” SN Comput. Sci. 2 (Dec): 1–11. https://doi.org/10.1007/s42979-020-00442-2.
Derbew, S. 2020. “Multivariate analysis of hulled barley (Hordeum vulgare L.) landraces of Southern Ethiopia.” Cogent Food Agric. 6 (1): 1841357. https://doi.org/10.1080/23311932.2020.1841357.
Dumicic, K., A. C. Casni, and I. Palic. 2015. “Multivariate analysis of determinants of Internet banking use in European Union countries.” Cent. Eur. Oper. Res. 23 (3): 563–578. https://doi.org/10.1007/s10100-014-0371-6.
Emmerson, R. H. C., S. B. O’Reilly-Wiese, C. L. Macleod, and J. N. Lester. 1997. “A multivariate assessment of metal distribution in inter-tidal sediments of the Blackwater Estuary, UK.” Mar. Pollut. Bull. 34 (11): 960–968. https://doi.org/10.1016/S0025-326X(97)00067-2.
EPA. 2021. “Ecoregions.” Accessed December 1, 2021. https://www.epa.gov/eco-research/ecoregions.
Foster, M. 2020. Developing predictive equations to forecast reservoir sedimentation rates. Washington, DC: Bureau of Reclamation.
Garg, V., and V. Jothiprakash. 2008. “Trap efficiency estimation of a large reservoir.” ISH J. Hydraul. Eng. 14 (2): 88–101. https://doi.org/10.1080/09715010.2008.10514907.
Gautam, A., M. Sit, and I. Demir. 2022. “Realistic river image synthesis using deep generative adversarial networks.” Front. Water 4 (Mar): 10. https://doi.org/10.3389/frwa.2022.784441.
Graf, W. L., E. Wohl, T. Sinha, and J. L. Sabo. 2010. “Sedimentation and sustainability of western American reservoirs.” Water Resour. Res. 46 (12): 1–13. https://doi.org/10.1029/2009WR008836.
Gu, X., and P. Angelov. 2017. “Autonomous anomaly detection.” In Evolving and adaptive intelligent systems (EAIS), 1–8. New York: IEEE. https://doi.org/10.1109/EAIS.2017.7954831.
Haimi, H., M. Mulas, F. Corona, S. Marsili-Libelli, P. Lindell, M. Heinonen, and R. Vahala. 2016. “Adaptive data-derived anomaly detection in the activated sludge process of a large-scale wastewater treatment plant.” Eng. Appl. Artif. Intell. 52 (Mar): 65–80. https://doi.org/10.1016/j.engappai.2016.02.003.
Hazarika, B. B., D. Gupta, and M. Berlin. 2020. “Modeling suspended sediment load in a river using extreme learning machine and twin support vector regression with wavelet conjunction.” Environ. Earth Sci. 79 (10): 234. https://doi.org/10.1007/s12665-020-08949-w.
Huang, J. L., Y. F. Li, and M. Xie. 2015. “An empirical analysis of data preprocessing for machine learning-based software cost estimation.” Inf. Software Technol. 67 (Apr): 108–127. https://doi.org/10.1016/j.infsof.2015.07.004.
Jiang, Y., B. Cukic, and T. Menzies. 2008. “Can data transformation help in the detection of fault-prone modules?” In Proc., 2008 Workshop on Defects in Large Software Systems, 16–20. New York: Association for Computing Machinery.
Jirachan, T., and K. Piromsopa. 2015. “Applying KSE-test and k-means clustering towards scalable unsupervised intrusion detection.” In Proc., 2015 12th Int. Joint Conf. on Computer Science and Software Engineering (JCSSE), 82–87. New York: IEEE.
Jolliffe, I. T., and J. Cadima. 2016. “Principal component analysis: A review and recent developments.” Phil. Trans. R. Soc. A 374 (2065): 20150202. https://doi.org/10.1098/rsta.2015.0202.
Kim, M. S. 2013. “Robust, scalable anomaly detection for large collections of images.” In Proc., Int. Conf. on Social Computing, 1054–1058. New York: IEEE.
Kiran, B. R., D. M. Thomas, and R. Parakkal. 2018. “An overview of deep learning based methods for unsupervised and semi-supervised anomaly detection in videos.” J. Imaging 4 (2): 36. https://doi.org/10.3390/jimaging4020036.
Kocaguneli, E., T. Menzies, and J. W. Keung. 2012. “On the value of ensemble effort estimation.” IEEE Trans. Software Eng. 38 (6): 1403–1416. https://doi.org/10.1109/TSE.2011.111.
Li, Z., and I. Demir. 2023. “U-net-based semantic classification for flood extent extraction using SAR imagery and GEE platform: A case study for 2019 central US flooding.” Sci. Total Environ. 869 (Mar): 161757. https://doi.org/10.1016/j.scitotenv.2023.161757.
Lu, H., C. J. Moran, and M. Sivapalan. 2005. “A theoretical exploration of catchment-scale sediment delivery.” Water Resour. Res. 41 (9). https://doi.org/10.1029/2005WR004018.
Martinez, A. M., and A. C. Kak. 2001. “PCA versus LDA.” IEEE Trans. Pattern Anal. Mach. Intell. 23 (2): 228–233. https://doi.org/10.1109/34.908974.
Meharie, M. G., and N. Shaik. 2020. “Predicting highway construction costs: Comparison of the performance of random forest, neural network and support vector machine models.” J. Soft Comput. Civ. Eng. 4 (2): 103–112. https://doi.org/10.22115/scce.2020.226883.1205.
Minear, J. T., and G. M. Kondolf. 2009. “Estimating reservoir sedimentation rates at large spatial and temporal scales: A case study of California.” Water Resour. Res. 45 (12): 1–8. https://doi.org/10.1029/2007WR006703.
Moonesinghe, H. D. K., and P. Tan. 2006. “Outlier detection using random walks.” In Proc., 2006 18th IEEE Int. Conf. on Tools with Artificial Intelligence (ICTAI’06), 532–539. New York: IEEE.
Morris, G. L. 2015. “Collection and interpretation of reservoir data to support sustainable use.” In Proc., 3rd Joint Federal Interagency Conf. on Sedimentation and Hydrologic Modeling. St. Louis: SEDHYD, INC.
NRCS-USDA. 2002. Technical guide to RUSLE use in Michigan. East Lansing, MI: NRCS-USDA State Office of Michigan.
Omernik, J. M., and G. E. Griffith. 2014. “Ecoregions of the conterminous United States: Evolution of a hierarchical spatial framework.” Environ. Manage. 54 (Mar): 1249–1266. https://doi.org/10.1007/s00267-014-0364-1.
Patro, S. G. K., and K. K. Sahu. 2015. “Normalization: A preprocessing stage.” Preprint, submitted March 19, 2015. http://arxiv.org/abs/1503.06462.
Peterson, K. T., V. Sagan, P. Sidike, A. L. Cox, and M. Martinez. 2018. “Suspended sediment concentration estimation from Landsat imagery along the lower Missouri and middle Mississippi rivers using an extreme learning machine.” Remote Sens. 10 (10): 1503. https://doi.org/10.3390/rs10101503.
Peterson, K. T., V. Sagan, and J. J. Sloan. 2020. “Deep learning-based water quality estimation and anomaly detection using Landsat-8/Sentinel-2 virtual constellation and cloud computing.” GISci. Remote Sens. 57 (4): 510–525. https://doi.org/10.1080/15481603.2020.1738061.
Pinson, A., B. Baker, P. Boyd, R. Grandpre, K. D. White, and M. Jonas. 2016. US Army Corps of Engineers reservoir sedimentation in the context of climate change. Washington, DC: USACE.
Reid, M. K., and K. L. Spencer. 2009. “Use of principal components analysis (PCA) on estuarine sediment datasets: The effect of data pre-treatment.” Environ. Pollut. 157 (8–9): 2275–2281. https://doi.org/10.1016/j.envpol.2009.03.033.
Richards, K. 1993. “Sediment delivery and drainage network.” In Channel network hydrology, edited by K. Benen and M. J. Krikby, 221–254. New York: Wiley.
Rousseeuw, P. J. 1987. “Silhouettes: A graphical aid to the interpretation and validation of cluster analysis.” J. Comput. Appl. Math. 20 (Nov): 53–65. https://doi.org/10.1016/0377-0427(87)90125-7.
Sholtes, J. S., C. Ubing, T. J. Randle, J. Fripp, D. Cenderelli, and D. C. Baird. 2018. “Managing infrastructure in the stream environment.” J. Am. Water Resour. Assoc. 54 (6): 1172–1184. https://doi.org/10.1111/1752-1688.12692.
Teppola, P., S.-P. Mujunen, and P. Minkkinen. 1999. “Adaptive fuzzy C-means clustering in process monitoring.” Chemom. Intell. Lab. Syst. 45 (1): 23–38. https://doi.org/10.1016/S0169-7439(98)00087-2.
Thomas, C., and N. Balakrishnan. 2009. “Improvement in intrusion detection with advances in sensor fusion.” IEEE Trans. Inf. Forensics Secur. 4 (3): 542–551. https://doi.org/10.1109/TIFS.2009.2026954.
Tillman, F. D. 2015. Documentation of input datasets for the soil-water balance groundwater recharge model of the Upper Colorado River Basin. Reston, VA: USGS.
USACE. 2020. “National inventory of dams.” Accessed January 10, 2022. https://nid.sec.usace.army.mil/#/.
USDA. 1986. “Urban hydrology for small watersheds.” Accessed July 1, 2022. https://www.nrc.gov/docs/ML1421/ML14219A437.pdf.
US Department of Energy. 2012. “IECC climate zone map image.” Accessed December 1, 2020. https://basc.pnnl.gov/images/iecc-climate-zone-map.
USGS. 2017. “1/3rd arc-second digital elevation models (DEMs)–USGS national map 3DEP downloadable data collection.” Accessed January 30, 2022.
Viger, R., and A. Bock. 2014. GIS features of the geospatial fabric for national hydrologic modeling. Reston, VA: USGS.
Walling, D. E. 1983. “The sediment delivery problem.” J. Hydrol. 65 (1–3): 209–237. https://doi.org/10.1016/0022-1694(83)90217-2.
Wang, Z. Y., and C. H. Hu. 2009. “Strategies for managing reservoir sedimentation.” Int. J. Sediment Res. 24 (4): 369–384. https://doi.org/10.1016/S1001-6279(10)60011-X.
Xu, H. 2019. Data-driven framework for forecasting sedimentation at culverts. Iowa City, IA: Univ. of Iowa.
Xu, H., I. Demir, C. Koylu, and M. Muste. 2019. “A web-based geovisual analytics platform for identifying potential contributors to culvert sedimentation.” Sci. Total Environ. 692 (Nov): 806–817. https://doi.org/10.1016/j.scitotenv.2019.07.157.

Information & Authors

Information

Published In

Go to Journal of Hydrologic Engineering
Journal of Hydrologic Engineering
Volume 29Issue 5October 2024

History

Received: Nov 10, 2023
Accepted: Apr 1, 2024
Published online: Jul 18, 2024
Published in print: Oct 1, 2024
Discussion open until: Dec 18, 2024

Permissions

Request permissions for this article.

ASCE Technical Topics:

Authors

Affiliations

Research Scientist, WATER Institute, Saint Louis Univ., St. Louis, MO 63103 (corresponding author). ORCID: https://orcid.org/0000-0002-8458-0326. Email: [email protected]
Associate Professor, WATER Institute, Saint Louis Univ., St. Louis, MO 63103. ORCID: https://orcid.org/0000-0003-0719-2669. Email: [email protected]
Associate Professor, Taylor Geospatial Institute, Saint Louis Univ., St. Louis, MO 63103. ORCID: https://orcid.org/0000-0003-4375-2096. Email: [email protected]
Associate Professor, Dept. of Civil and Environmental Engineering, Univ. of Iowa, Iowa City, IA 52242. ORCID: https://orcid.org/0000-0002-0461-1242. Email: [email protected]
Marian Muste [email protected]
Research Engineer, IIHR Hydroscience and Engineering, Univ. of Iowa, Iowa City, IA 52242. Email: [email protected]
Paul Boyd, M.ASCE [email protected]
Hydraulic Engineer, US Army Corps of Engineers, 1616 Capitol Ave., Ste. 9000, Omaha, NE 68102. Email: [email protected]
Chandra Pathak, F.ASCE [email protected]
Hydrologic and Hydraulic Engineer, US Army Corps of Engineers Headquarters, 441 G St. NW, Washington, DC 20314-1000. Email: [email protected]

Metrics & Citations

Metrics

Citations

Download citation

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

View Options

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share