Calibration and Validation of Watershed Models and Advances in Uncertainty Analysis in TMDL Studies
Publication: Journal of Hydrologic Engineering
Volume 24, Issue 7
Abstract
Watershed models are widely used in total maximum daily load (TMDL) studies to predict the impacts of pollutant discharges on the biochemical functioning and assimilative capacity of water bodies. The reliability of a TMDL is therefore tightly linked with the predictive capability of these models. While there has been an increasing availability and application of watershed models for TMDL studies, guidelines for model evaluation, including recommendations for an appropriate selection and implementation of calibration, validation, and uncertainty analysis strategies, remain at present limited. The ASCE Environmental and Water Resources Institute (EWRI) TMDL Analysis and Modeling Task Committee was established in part to identify existing and emerging challenges encountered by water resources professionals during any phase of a TMDL development and to produce documentation to address these challenges. This paper reviews existing approaches for model calibration, validation, and uncertainty analysis, including recommendations to establish baseline modeling practices to obtain a satisfactory watershed model.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
The paper is based on the work of the ASCE-EWRI TMDL Analysis and Modeling Task Committee. This paper has not been subject to USEPA review and therefore does not necessarily reflect the views of the agency and no official endorsement should be inferred.
References
Abbaspour, K. C. 2015. SWAT-CUP: SWAT calibration and uncertainty programs: A user manual. Dübendorf, Switzerland: Swiss Federal Institute of Aquatic Science and Technology.
Alamdari, N., and D. J. Sample. 2019. “A multiobjective simulation-optimization tool for assisting in urban watershed restoration planning.” J. Cleaner Prod. 213: 251–261. https://doi.org/10.1016/j.jclepro.2018.12.108.
Alamdari, N., D. J. Sample, P. Steinberg, A. C. Ross, and Z. M. Easton. 2017. “Assessing the effects of climate change on water quantity and quality in an urban watershed using a calibrated stormwater model.” Water 9 (7): 464. https://doi.org/10.3390/w9070464.
Allen, J. I., P. Somerfield, and F. Gilbert. 2007. “Quantifying uncertainty in high-resolution coupled hydrodynamic-ecosystem models.” J. Mar. Syst. 64 (1–4): 3–14. https://doi.org/10.1016/j.jmarsys.2006.02.010.
Ambrose, R. B., T. A. Wool, and J. L. Martin. 1993. The water quality analysis simulation program, WASP5, Part A: Model documentation. Athens, GA: USEPA Center for Exposure Assessment Modeling.
Ames, D. P., and U. Lall. 2008. “Developing total maximum daily loads under uncertainty: Decision analysis and the margin of safety.” J. Contemp. Water Res. Educ. 140 (1): 37–52. https://doi.org/10.1111/j.1936-704X.2008.00027.x.
Aquatic Informatics. 2017. AQUARIUS WebPortal Version 2017.2 user manual. Vancouver, Canada: Aquatic Informatics, Inc.
Arabi, M., R. S. Govindaraju, B. Engel, and M. Hantush. 2007. “Multiobjective sensitivity analysis of sediment and nitrogen processes with a watershed model.” Water Resour. Res. 43 (6): W06409. https://doi.org/10.1029/2006WR005463.
Arnold, J. G., et al. 2012. “SWAT: Model use, calibration, and validation.” Trans. ASABE 55 (4): 1491–1508. https://doi.org/10.13031/2013.42256.
ASCE-EWRI (Environmental and Water Resources Institute) TMDL Analysis and Modeling Task Committee. 2017. Total maximum daily load analysis and modeling: Assessment of the practice. Reston, VA: ASCE.
Beasley, D., L. Huggins, and A. Monke. 1980. “ANSWERS: A model for watershed planning.” Trans. ASAE 23 (4): 938–944. https://doi.org/10.13031/2013.34692.
Beck, M. B. 1987. “Water quality modeling: A review of the analysis of uncertainty.” Water Resour. Res. 23 (8): 1393–1442. https://doi.org/10.1029/WR023i008p01393.
Beven, K. 2005. “On the concept of model structural error.” Water Sci. Technol. 52 (6): 167–175. https://doi.org/10.2166/wst.2005.0165.
Beven, K. 2009. Environmental modelling: An uncertainty future? London: Routledge.
Beven, K., and A. Binley. 1992. “The future of distributed models: Model calibration and uncertainty prediction.” Hydrol. Process. 6 (3): 279–298. https://doi.org/10.1002/hyp.3360060305.
Bicknell, B., J. Imhoff, J. Kittle Jr., T. Jobes, and A. Donigian Jr. 2005. Hydrological Simulation Program—Fortran (HSPF) user’s manual for release 12.2. Athens, GA: USEPA National Exposure Research Laboratory.
Bingner, R., and F. Theurer. 2001. AnnAGNPS technical processes: Documentation version 3. Oxford, MS: Agricultural Research Service and USDA.
Blumberg, A. F., and N. Georgas. 2008. “Quantifying uncertainty in estuarine and coastal ocean circulation modeling.” J. Hydraul. Eng. 134 (4): 403–415. https://doi.org/10.1061/(ASCE)0733-9429(2008)134:4(403).
Bobba, A. G., V. P. Singh, and L. Bengtsson. 1996. “Application of first-order and Monte Carlo analysis in watershed water quality models.” Water Resour. Manage. 10 (3): 219–240. https://doi.org/10.1007/BF00424204.
Bolster, C. H., and P. A. Vadas. 2013. “Sensitivity and uncertainty analysis for the annual phosphorus loss estimator model.” J. Environ. Qual. 42 (4): 1109–1118. https://doi.org/10.2134/jeq2012.0418.
Borah, D. K., E. Ahmadisharaf, G. Padmanabhan, S. Imen, and Y. M. Mohamoud. 2019. “Watershed models for development and implementation of total maximum daily loads.” J. Hydrol. Eng. 24 (1): 03118001. https://doi.org/10.1061/(ASCE)HE.1943-5584.0001724.
Borah, D. K., G. Yagow, A. Saleh, P. Barnes, W. Rosenthal, E. Krug, and L. Hauck. 2006. “Sediment and nutrient modeling for TMDL development and implementation.” Trans. ASABE 49 (4): 967–986. https://doi.org/10.13031/2013.21742.
Borsuk, M. E., and C. A. Stow. 2000. “Bayesian parameter estimation in a mixed-order model of BOD decay.” Water Res. 34 (6): 1830–1836. https://doi.org/10.1016/S0043-1354(99)00346-2.
Borsuk, M. E., C. A. Stow, and K. H. Reckhow. 2002. “Predicting the frequency of water quality standard violations: A probabilistic approach for TMDL development.” Environ. Sci. Technol. 36 (10): 2109–2115. https://doi.org/10.1021/es011246m.
Bouraoui, F. 1994. “Development of a continuous, physically-based distributed parameter, nonpoint source model.” Ph.D. thesis, Dept. of Biological Systems Engineering, Virginia Tech.
Brown, J. D., and G. B. Heuvelink. 2006. “Assessing uncertainty propagation through physically based models of soil water flow and solute transport.” In Encyclopedia of hydrological sciences. New York: Wiley.
Burges, S. J., and D. P. Lettenmaier. 1975. “Probabilistic methods in stream quality management.” J. Am. Water Resour. Assoc. 11 (1): 115–130. https://doi.org/10.1111/j.1752-1688.1975.tb00664.x.
Camacho, R. A., J. L. Martin, J. Diaz, W. H. McAnally, H. Rodriguez, P. Suscy, and S. Zhang. 2014a. “Uncertainty analysis of estuarine hydrodynamic models: An evaluation of input data uncertainty in the Weeks Bay estuary, Alabama.” Appl. Ocean Res. 47: 138–153. https://doi.org/10.1016/j.apor.2014.04.004.
Camacho, R. A., J. L. Martin, W. McAnally, J. Díaz-Ramirez, H. Rodriguez, P. Sucsy, and S. Zhang. 2015. “A comparison of Bayesian methods for uncertainty analysis in hydraulic and hydrodynamic modeling.” J. Am. Water Resour. Assoc. 51 (5): 1372–1393. https://doi.org/10.1111/1752-1688.12319.
Camacho, R. A., J. L. Martin, B. Watson, M. Paul, L. Zheng, and J. Stribling. 2014b. “Modeling the factors controlling phytoplankton in the St. Louis Bay estuary, Mississippi and evaluating estuarine responses to nutrient load modifications.” J. Environ. Eng. 141 (3): 04014067. https://doi.org/10.1061/(ASCE)EE.1943-7870.0000892.
Camacho, R. A., J. L. Martin, T. Wool, and V. P. Singh. 2018. “A framework for uncertainty and risk analysis in total maximum daily load applications.” Environ. Modell. Software 101: 218–235. https://doi.org/10.1016/j.envsoft.2017.12.007.
Chahor, Y., J. Casalí, R. Giménez, R. Bingner, M. Campo, and M. Goñi. 2014. “Evaluation of the AnnAGNPS model for predicting runoff and sediment yield in a small Mediterranean agricultural watershed in Navarre (Spain).” Agric. Water Manage. 134: 24–37. https://doi.org/10.1016/j.agwat.2013.11.014.
Chapra, S. C. 1997. Surface water-quality modeling. Long Grove, IL: Waveland Press.
Chapra, S. C. 2003. “Engineering water quality models and TMDLs.” J. Water Resour. Plann. Manage. 129 (4): 247–256. https://doi.org/10.1061/(ASCE)0733-9496(2003)129:4(247).
Chaudhary, A., and M. M. Hantush. 2017. “Bayesian Monte Carlo and maximum likelihood approach for uncertainty estimation and risk management: Application to lake oxygen recovery model.” Water Res. 108: 301–311. https://doi.org/10.1016/j.watres.2016.11.012.
Chen, C. W., J. Herr, and L. Ziemelis. 1998. Watershed analysis risk management framework: A decision support system for watershed approach and TMDL calculation. Palo Alto, CA: Electric Power Research Institute.
Chin, D. A. 2009. “Predictive uncertainty in water-quality modeling.” J. Environ. Eng. 135 (12): 1315–1325. https://doi.org/10.1061/(ASCE)EE.1943-7870.0000101.
Cho, E., G. B. Arhonditsis, J. Khim, S. Chung, and T.-Y. Heo. 2016. “Modeling metal-sediment interaction processes: Parameter sensitivity assessment and uncertainty analysis.” Environ. Modell. Software 80: 159–174. https://doi.org/10.1016/j.envsoft.2016.02.026.
Cho, K. H., Y. A. Pachepsky, J. H. Kim, A. K. Guber, D. R. Shelton, and R. Rowland. 2010. “Release of Escherichia coli from the bottom sediment in a first-order creek: Experiment and reach-specific modeling.” J. Hydrol. 391 (3–4): 322–332. https://doi.org/10.1016/j.jhydrol.2010.07.033.
Conrad, Y., and N. Fohrer. 2009. “A test of CoupModel for assessing the nitrogen leaching in grassland systems with two different fertilization levels.” J. Plant Nutr. Soil Sci. 172 (6): 745–756. https://doi.org/10.1002/jpln.200800264.
Daggupati, P., N. Pai, S. Ale, K. R. Douglas-Mankin, R. W. Zeckoski, J. Jeong, P. B. Parajuli, D. Saraswat, and M. A. Youssef. 2015. “A recommended calibration and validation strategy for hydrologic and water quality models.” Trans. ASABE 58 (6): 1705–1719. https://doi.org/10.13031/trans.58.10712.
DHI (Danish Hydraulic Institute). 2014. MIKE SHE user manual. Volume 2: Reference guide. Hørsholm, Denmark: DHI.
Dilks, D. W., R. P. Canale, and P. G. Meier. 1992. “Development of Bayesian Monte Carlo techniques for water quality model uncertainty.” Ecol. Modell. 62 (1–3): 149–162. https://doi.org/10.1016/0304-3800(92)90087-U.
Dilks, D. W., and P. L. Freedman. 2004. “Improved consideration of the margin of safety in total maximum daily load development.” J. Environ. Eng. 130 (6): 690–694. https://doi.org/10.1061/(ASCE)0733-9372(2004)130:6(690).
Donigian, A. 2002. “Watershed model calibration and validation: The HSPF experience.” Proc. Water Environ. Fed. 2002 (8): 44–73.
Dorner, S. M., W. B. Anderson, R. M. Slawson, N. Kouwen, and P. M. Huck. 2006. “Hydrologic modeling of pathogen fate and transport.” Environ. Sci. Technol. 40 (15): 4746–4753. https://doi.org/10.1021/es060426z.
Downer, C. W., and F. L. Ogden. 2004. “GSSHA: Model to simulate diverse stream flow producing processes.” J. Hydrol. Eng. 9 (3): 161–174. https://doi.org/10.1061/(ASCE)1084-0699(2004)9:3(161).
Downer, C. W., and F. L. Ogden. 2006. Gridded surface subsurface hydrologic analysis (GSSHA) user’s manual. Washington, DC: USACE.
Downer, C. W., N. R. Pradhan, F. L. Ogden, and A. R. Byrd. 2014. “Testing the effects of detachment limits and transport capacity formulation on sediment runoff predictions using the US Army Corps of Engineers GSSHA model.” J. Hydrol. Eng. 20 (7): 04014082. https://doi.org/10.1061/(ASCE)HE.1943-5584.0001104.
Duan, Q. Y., V. K. Gupta, and S. Sorooshian. 1993. “Shuffled complex evolution approach for effective and efficient global minimization.” J. Optim. Theor. Appl. 76 (3): 501–521. https://doi.org/10.1007/BF00939380.
Duda, P., P. Hummel, A. Donigian Jr., and J. Imhoff. 2012. “BASINS/HSPF: Model use, calibration, and validation.” Trans. ASABE 55 (4): 1523–1547. https://doi.org/10.13031/2013.42261.
Engel, B., D. Storm, M. White, J. Arnold, and M. Arabi. 2007. “A hydrologic/water quality model application protocol.” J. Am. Water Resour. Assoc. 43 (5): 1223–1236. https://doi.org/10.1111/j.1752-1688.2007.00105.x.
Engeland, K., C. Y. Xu, and L. Gottschalk. 2005. “Assessing uncertainties in a conceptual water balance model using Bayesian methodology.” Hydrol. Sci. J. 50 (1): 45–63. https://doi.org/10.1623/hysj.50.1.45.56334.
Gao, P., D. Borah, and C. Yi. 2015. “Storm event flow and sediment simulations in a central New York watershed: Model testing and parameter analyses.” Trans. ASABE 85 (5): 1241–1252. https://doi.org/10.13031/trans.58.11018.
García, A., J. A. Juanes, C. Álvarez, J. A. Revilla, and R. Medina. 2010. “Assesment of the response of a shallow macrotidal estuary to changes in hydrological and wastewater inputs through numerical modelling.” Ecol. Modell. 221 (8): 1194–1208. https://doi.org/10.1016/j.ecolmodel.2009.12.027.
Gelman, A., J. B. Carlin, H. S. Stern, and D. B. Rubin. 2004. Bayesian data analysis. Boca Raton, FL: Chapman and Hall/CRC Press.
Gilks, W. R., S. Richardson, and D. J. Spiegelhalter. 1996. Markov chain Monte Carlo in practice. London: Chapman and Hall.
Goodrich, D., I. Burns, C. Unkrich, D. Semmens, D. Guertin, M. Hernandez, S. Yatheendradas, J. Kennedy, and L. Levick. 2012. “KINEROS2/AGWA: Model use, calibration, and validation.” Trans. ASABE 55 (4): 1561–1574. https://doi.org/10.13031/2013.42264.
Guzman, J. A., et al. 2015. “Uncertainty considerations in calibration and validation of hydrologic and water quality models.” Trans. ASABE 58 (6): 1745–1762. https://doi.org/10.13031/trans.58.10710.
Haan, C. T. 2002. Statistical methods in hydrology. Ames, IA: Iowa State University Press.
Haith, D. A., R. Mandel, and R. S. Wu. 1992. GWLF, generalized watershed loading functions, version 2.0, user’s manual. Ithaca, NY: Cornell Univ.
Hamrick, J. M. 1992. A three-dimensional environmental fluid dynamics computer code: Theoretical and computational aspects. Williamsburg, VA: College of William and Mary, Virginia Institute of Marine Science.
Han, F., and Y. Zheng. 2016. “Multiple-response Bayesian calibration of watershed water quality models with significant input and model structure errors.” Adv. Water Resour. 88: 109–123. https://doi.org/10.1016/j.advwatres.2015.12.007.
Hanson, K. M. 1999. “A framework for assessing uncertainties in simulation predictions.” Physica D 133 (1–4): 179–188. https://doi.org/10.1016/S0167-2789(99)00090-1.
Hantush, M. M., and A. Chaudhary. 2014. “Bayesian framework for water quality model uncertainty estimation and risk management.” J. Hydrol. Eng. 19 (9): 04014015. https://doi.org/10.1061/(ASCE)HE.1943-5584.0000900.
Hantush, M. M., and L. Kalin. 2005. “Uncertainty and sensitivity analysis of runoff and sediment yield in a small agricultural watershed with KINEROS2.” Hydrol. Sci. J. 50 (6): 1151–1172. https://doi.org/10.1623/hysj.2005.50.6.1151.
Harmel, R. D., and P. K. Smith. 2007. “Consideration of measurement uncertainty in the evaluation of goodness-of-fit in hydrologic and water quality modeling.” J. Hydrol. 337 (3): 326–336. https://doi.org/10.1016/j.jhydrol.2007.01.043.
Harmel, R. D., P. K. Smith, K. W. Migliaccio, I. Chaubey, K. R. Douglas-Mankin, B. Benham, S. Shukla, R. Muñoz-Carpena, and B. J. Robson. 2014. “Evaluating, interpreting, and communicating performance of hydrologic/water quality models considering intended use: A review and recommendations.” Environ. Modell. Software 57: 40–51. https://doi.org/10.1016/j.envsoft.2014.02.013.
Helton, J. C., and F. J. Davis. 2003. “Latin hypercube sampling and the propagation of uncertainty in analyses of complex systems.” Reliab. Eng. Syst. Saf. 81 (1): 23–69. https://doi.org/10.1016/S0951-8320(03)00058-9.
Herr, J., and C. Chen. 2012. “WARMF: Model use, calibration, and validation.” Trans. ASABE 55 (4): 1387–1394. https://doi.org/10.13031/2013.42249.
Hornberger, G. M., and R. C. Spear. 1981. “Approach to the preliminary analysis of environmental systems.” J. Environ. Manage. 12 (1): 7–18. https://doi.org/10.1029/2006WR005756.
Jaber, F., and S. Shukla. 2012. “MIKE SHE: Model use, calibration, and validation.” Trans. ASABE 55 (4): 1479–1489. https://doi.org/10.13031/2013.42255.
Janssen, H. 2013. “Monte-Carlo based uncertainty analysis: Sampling efficiency and sampling convergence.” Reliab. Eng. Syst. Saf. 109: 123–132. https://doi.org/10.1016/j.ress.2012.08.003.
Jia, Y., and T. B. Culver. 2008. “Uncertainty analysis for watershed modeling using generalized likelihood uncertainty estimation with multiple calibration measures.” J. Water Resour. Plann. Manage. 134 (2): 97–106. https://doi.org/10.1061/(ASCE)0733-9496(2008)134:2(97).
Kennedy, M. C., and A. O’Hagan. 2001. “Bayesian calibration of computer models.” J. Royal Stat. Soc. B 63 (3): 425–464. https://doi.org/10.1111/1467-9868.00294.
Kim, S. M., B. L. Benham, K. M. Brannan, R. W. Zeckoski, and G. R. Yagow. 2007. “Water quality calibration criteria for bacteria TMDL development.” Appl. Eng. Agric. 23 (2): 171–176. https://doi.org/10.13031/2013.22610.
KISTERS. 2013. WISKI hydrological data management software (user manual). Citrus Heights, CA: KISTERS, Inc.
Kuria, F., and R. Vogel. 2015. “Uncertainty analysis for water supply reservoir yields.” J. Hydrol. 529: 257–264. https://doi.org/10.1016/j.jhydrol.2015.07.025.
Lee, K.-Y., T. R. Fisher, T. E. Jordan, D. L. Correll, and D. E. Weller. 2000. “Modeling the hydrochemistry of the Choptank River Basin using GWLF and Arc/Info: 1. Model calibration and validation.” Biogeochemistry 49 (2): 143–173. https://doi.org/10.1023/A:1006375530844.
Le Maître, O. P., and O. M. Knio. 2010. “Introduction: Uncertainty quantification and propagation.” In Spectral methods for uncertainty quantification, 1–13. New York: Springer.
Lin, J., L. Xie, L. J. Pietrafesa, J. S. Ramus, and H. W. Paerl. 2007. “Water quality gradients across Albemarle-Pamlico estuarine system: Seasonal variations and model applications.” J. Coastal Res. 231: 213–229. https://doi.org/10.2112/05-0507.1.
Lin, J., L. Xie, L. J. Pietrafesa, H. Xu, W. Woods, M. A. Mallin, and M. J. Durako. 2008. “Water quality responses to simulated flow and nutrient reductions in the Cape Fear river estuary and adjacent coastal region, North Carolina.” Ecol. Modell. 212 (3–4): 200–217. https://doi.org/10.1016/j.ecolmodel.2007.10.026.
Liu, Y., and H. V. Gupta. 2007. “Uncertainty in hydrologic modeling: Toward an integrated data assimilation framework.” Water Resour. Res. 43 (7): W07401. https://doi.org/10.1029/2006WR005756.
Loosvelt, L., H. Vernieuwe, V. Pauwels, B. D. Baets, and N. Verhoest. 2013. “Local sensitivity analysis for compositional data with application to soil texture in hydrologic modelling.” Hydrol. Earth Syst. Sci. 17 (2): 461–478. https://doi.org/10.5194/hess-17-461-2013.
Loucks, D. P., and E. van Beek. 2005. Water resources systems planning and management: An introduction to methods, models and applications. Delft, Netherlands: Deltares and UNESCO-IHE.
Madani, K., and J. R. Lund. 2011. “A Monte-Carlo game theoretic approach for multi-criteria decision making under uncertainty.” Adv. Water Resour. 34 (5): 607–616. https://doi.org/10.1016/j.advwatres.2011.02.009.
Malone, R., D. S. Bowles, M. Windham, and W. Grenney. 1983. “Comparison of techniques for assessing effects of loading uncertainty upon a long term phosphorous model.” Appl. Math. Modell. 7 (1): 11–18. https://doi.org/10.1016/0307-904X(83)90157-9.
Mannina, G., and G. Viviani. 2010. “An urban drainage stormwater quality model: Model development and uncertainty quantification.” J. Hydrol. 381 (3–4): 248–265. https://doi.org/10.1016/j.jhydrol.2009.11.047.
Mantovan, P., and E. Todini. 2006. “Hydrological forecasting uncertainty assessment: Incoherence of the GLUE methodology.” J. Hydrol. 330 (1–2): 368–381. https://doi.org/10.1016/j.jhydrol.2006.04.046.
Maranzano, C. J., and R. Krzysztofowicz. 2004. “Identification of likelihood and prior dependence structures for hydrologic uncertainty processor.” J. Hydrol. 290 (1–2): 1–21. https://doi.org/10.1016/j.jhydrol.2003.11.021.
Maréchal, D. 2004. “A soil-based approach to rainfall-runoff modelling in ungauged catchments for England and Wales.” Ph.D. thesis, Institute of Water and Environment, Cranfield Univ.
Martin, J. L., and S. C. McCutcheon. 1999. Hydrodynamics and transport for water quality modeling. Boca Raton, FL: CRC Press.
Matott, L. S., J. E. Babendreier, and S. T. Purucker. 2009. “Evaluating uncertainty in integrated environmental models: A review of concepts and tools.” Water Resour. Res. 45 (6): W06421. https://doi.org/10.1029/2008WR007301.
McCutcheon, S. C. 1989. Water quality modeling: Volume I, river transport and surface exchange. Boca Raton, FL: CRC Press.
McCutcheon, S. C., Z. Donwei, and S. Bird. 1990. “Model calibration, validation and use.” In Manual for performing waste load allocations, Book III (Estuaries), Part 2, 5.1–5.77. Washington, DC: USEPA.
McKay, M. D., R. J. Beckman, and W. J. Conover. 1979. “Comparison of three methods for selecting values of input variables in the analysis of output from a computer code.” Technometrics 21 (2): 239–245. https://doi.org/10.1080/00401706.1979.10489755.
Melching, C. S. 1992. “An improved first-order reliability approach for assessing uncertainties in hydrologic modeling.” J. Hydrol. 132 (1–4): 157–177. https://doi.org/10.1016/0022-1694(92)90177-W.
Melching, C. S. 1995. “Reliability estimation.” In Computer models of watershed hydrology, edited by V. P. Singh, 69–118. Littleton, CO: Water Resources Publications.
Melching, C. S., and C. G. Yoon. 1996. “Key sources of uncertainty in QUAL2E model of Passaic River.” J. Water Resour. Plann. Manage. 122 (2): 105–113. https://doi.org/10.1061/(ASCE)0733-9496(1996)122:2(105).
Mishra, A., E. Ahmadisharaf, B. L. Benham, D. L. Gallagher, K. H. Reckhow, and E. P. Smith. 2019. “Two-phase Monte Carlo simulation for partitioning the effects of epistemic and aleatory uncertainty in TMDL modeling.” J. Hydrol. Eng. 24 (1): 04018058. https://doi.org/10.1061/(ASCE)HE.1943-5584.0001731.
Mishra, A., E. Ahmadisharaf, B. L. Benham, M. L. Wolfe, S. C. Leman, D. L. Gallagher, K. H. Reckhow, and E. P. Smith. 2018. “Generalized likelihood uncertainty estimation and Markov chain Monte Carlo simulation to prioritize TMDL pollutant allocations.” J. Hydrol. Eng. 23 (12): 05018025. https://doi.org/10.1061/(ASCE)HE.1943-5584.0001720.
Mishra, A., B. R. Bicknell, P. Duda, T. Donigian, and M. H. Gray. 2017. “HSPEXP+: An enhanced expert system for HSPF model calibration—A case study of the Snake River Watershed in Minnesota.” J. Water Manage. Model. 25: C422. https://doi.org/10.14796/JWMM.C422.
Mitsova-Boneva, D., and X. Wang. 2007. “Exploring the variability in suspended sediment yield using BASINS-HSPF and probabilistic modeling: Implications for land use planning.” J. Environ. Inf. 9 (1): 29–40. https://doi.org/10.3808/jei.200700085.
Mokhtari, A., and H. C. Frey. 2005. “Sensitivity analysis of a two-dimensional probabilistic risk assessment model using analysis of variance.” Risk Anal. 25 (6): 1511–1529. https://doi.org/10.1111/j.1539-6924.2005.00679.x.
Moriasi, D. N., et al. 2015a. “Hydrologic and water quality models: Key calibration and validation topics.” Trans. ASABE 58 (6): 1609–1618. https://doi.org/10.13031/trans.58.11075.
Moriasi, D. N., J. G. Arnold, M. W. Van Liew, R. L. Bingner, R. D. Harmel, and T. L. Veith. 2007. “Model evaluation guidelines for systematic quantification of accuracy in watershed simulations.” Trans. ASABE 50 (3): 885–900. https://doi.org/10.13031/2013.23153.
Moriasi, D. N., M. W. Gitau, N. Pai, and P. Daggupati. 2015b. “Hydrologic and water quality models: Performance measures and evaluation criteria.” Trans. ASABE 58 (6): 1763–1785. https://doi.org/10.13031/trans.58.10715.
Moriasi, D. N., B. Wilson, K. Douglas-Mankin, J. Arnold, and P. Gowda. 2012. “Hydrologic and water quality models: Use, calibration, and validation.” Trans. ASABE 55 (4): 1241–1247.
Nash, J. E., and J. V. Sutcliffe. 1970. “River flow forecasting through conceptual models Part I—A discussion of principles.” J. Hydrol. 10 (3): 282–290. https://doi.org/10.1016/0022-1694(70)90255-6.
Neitsch, S. L., J. G. Arnold, J. R. Kiniry, and J. R. Williams. 2011. Soil and water assessment tool theoretical documentation version 2009. College Station, TX: Texas Water Resources Institute.
Nguyen, T. T., and P. Willems. 2016. “The influence of model structure uncertainty on water quality assessment.” Water Resour. Manage. 30 (9): 3043–3061. https://doi.org/10.1007/s11269-016-1330-x.
Novotny, V. 2003. Water quality: Diffuse pollution and watershed management. New York: Wiley.
NRC (National Research Council). 2001. Assessing the TMDL approach to water quality management. Washington, DC: Water Science and Technology Board and Division of Earth and Life Studies.
Olson, C. C. 2017. “Stormwater control measure modeling and uncertainty analysis for total maximum daily load compliance.” Ph.D. dissertation, Dept. of Civil and Environmental Engineering, Colorado State Univ.
Pak, J., K. Ramos, M. Fleming, W. Scharffenberg, and S. Gibson. 2015. “Sensitivity analysis for sediment transport in the hydrologic modeling system (HEC-HMS).” In Proc., Joint Federal Interagency Conf. on Sedimentation and Hydrologic Modeling. Reno, NV.
Pandey, P. K., M. L. Soupir, M. Haddad, and J. J. Rothwell. 2012. “Assessing the impacts of watershed indexes and precipitation on spatial in-stream E. coli concentrations.” Ecol. Indic. 23: 641–652. https://doi.org/10.1016/j.ecolind.2012.05.023.
Parajuli, P. B., K. R. Douglas-Mankin, P. L. Barnes, and C. G. Rossi. 2009. “Fecal bacteria source characterization and sensitivity analysis of SWAT 2005.” Trans. ASABE 52 (6): 1847–1858. https://doi.org/10.13031/2013.29213.
Park, D., and L. A. Roesner. 2012. “Evaluation of pollutant loads from stormwater BMPs to receiving water using load frequency curves with uncertainty analysis.” Water Res. 46 (20): 6881–6890. https://doi.org/10.1016/j.watres.2012.04.023.
Park, K., H.-S. Jung, H.-S. Kim, and S.-M. Ahn. 2005. “Three-dimensional hydrodynamic-eutrophication model (HEM-3D): Application to Kwang-Yang Bay, Korea.” Marine Environmental Research 60 (2): 171–193. https://doi.org/10.1016/j.marenvres.2004.10.003.
Park, Y. S., B. A. Engel, and J. Harbor. 2014. “A web-based model to estimate the impact of best management practices.” Water 6 (3): 455–471. https://doi.org/10.3390/w6030455.
Patil, A., and Z.-Q. Deng. 2011. “Bayesian approach to estimating margin of safety for total maximum daily load development.” J. Environ. Manage. 92 (3): 910–918. https://doi.org/10.1016/j.jenvman.2010.10.049.
Paul, S., P. Haan, M. Matlock, S. Mukhtar, and S. Pillai. 2004. “Analysis of the HSPF water quality parameter uncertainty in predicting peak in-stream fecal coliform concentrations.” Trans. ASAE 47 (1): 69–78. https://doi.org/10.13031/2013.15872.
Peng, M., and L. Zhang. 2012. “Analysis of human risks due to dam-break floods—Part 1: A new model based on Bayesian networks.” Nat. Hazard. 64 (1): 903–933. https://doi.org/10.1007/s11069-012-0275-5.
Perumal, T. M., and R. Gunawan. 2011. “Understanding dynamics using sensitivity analysis: Caveat and solution.” BMC Syst. Biol. 5: 41. https://doi.org/10.1186/1752-0509-5-41.
Pushpalatha, R., C. Perrin, N. Le Moine, and V. Andréassian. 2012. “A review of efficiency criteria suitable for evaluating low-flow simulations.” J. Hydrol. 420-421: 171–182. https://doi.org/10.1016/j.jhydrol.2011.11.055.
Qian, S. S., C. A. Stow, and M. E. Borsuk. 2003. “On Monte Carlo methods for Bayesian inference.” Ecol. Modell. 159 (2–3): 269–277. https://doi.org/10.1016/S0304-3800(02)00299-5.
Quader, A., and Y. Guo. 2009. “Relative importance of hydrological and sediment-transport characteristics affecting effective discharge of small urban streams in southern Ontario.” J. Hydrol. Eng. 14 (7): 698–710. https://doi.org/10.1061/(ASCE)HE.1943-5584.0000042.
Rajabi, M. M., and B. Ataie-Ashtiani. 2014. “Sampling efficiency in Monte Carlo based uncertainty propagation strategies: Application in seawater intrusion simulations.” Adv. Water Resour. 67: 46–64. https://doi.org/10.1016/j.advwatres.2014.02.004.
Reckhow, K. H. 2003. “On the need for uncertainty assessment in TMDL modeling and implementation.” J. Water Resour. Plann. Manage. 129 (4): 245–246. https://doi.org/10.1061/(ASCE)0733-9496(2003)129:4(245).
Refsgaard, J. C., and H. J. Henriksen. 2004. “Modelling guidelines—Terminology and guiding principles.” Adv. Water Resour. 27 (1): 71–82. https://doi.org/10.1016/j.advwatres.2003.08.006.
Refsgaard, J. C., J. P. van der Sluijs, J. Brown, and P. van der Keur. 2006. “A framework for dealing with uncertainty due to model structure error.” Adv. Water Resour. 29 (11): 1586–1597. https://doi.org/10.1016/j.advwatres.2005.11.013.
Refsgaard, J. C., J. P. van der Sluijs, A. L. Hojberg, and P. A. Vanrolleghem. 2007. “Uncertainty in the environmental modelling process: A framework and guidance.” Environ. Modell. Software 22 (11): 1543–1556. https://doi.org/10.1016/j.envsoft.2007.02.004.
Ritter, A., and R. Muñoz-Carpena. 2013. “Performance evaluation of hydrological models: Statistical significance for reducing subjectivity in goodness-of-fit assessments.” J. Hydrol. 480: 33–45. https://doi.org/10.1016/j.jhydrol.2012.12.004.
Rossman, L. A. 2015. Storm water management model reference manual. Volume I—Hydrology. Cincinnati: National Risk Management Research Laboratory, Office of Research and Development, and USEPA.
Rossman, L. A. 2016. Storm water management model reference manual. Volume III—Water quality. Cincinnati: National Risk Management Research Laboratory, Office of Research and Development, USEPA.
Saleh, A., and B. Du. 2004. “Evaluation of SWAT and HSPF within BASINS program for the upper North Bosque River watershed in central Texas.” Trans. ASAE 47 (4): 1039–1049. https://doi.org/10.13031/2013.16577.
Saltelli, A., K. Chan, and E. M. Scott. 2000. Sensitivity analysis. New York: Wiley.
Saltelli, A., M. Ratto, S. Tarantola, and F. Campolongo. 2006. “Sensitivity analysis practices: Strategies for model-based inference.” Reliab. Eng. Syst. Saf. 91 (10): 1109–1125. https://doi.org/10.1016/j.ress.2005.11.014.
Saltelli, A., and I. M. Sobol. 1995. “About the use of rank transformation in sensitivity analysis of model output.” Reliab. Eng. Syst. Saf. 50 (3): 225–239. https://doi.org/10.1016/0951-8320(95)00099-2.
Samanta, S., D. Mackay, M. Clayton, E. Kruger, and B. Ewers. 2007. “Bayesian analysis for uncertainty estimation of a canopy transpiration model.” Water Resour. Res. 43 (4): W04424. https://doi.org/10.1029/2006WR005028.
Santhi, C., J. G. Arnold, J. R. Williams, W. A. Dugas, R. Srinivasan, and L. M. Hauck. 2001. “Validation of the swat model on a large RWER basin with point and nonpoint sources 1.” J. Am. Water Resour. Assoc. 37 (5): 1169–1188. https://doi.org/10.1111/j.1752-1688.2001.tb03630.x.
Scavia, D., W. F. Powers, R. P. Canale, and J. L. Moody. 1981. “Comparison of first-order error analysis and Monte Carlo simulation in time-dependent lake eutrophication models.” Water Resour. Res. 17 (4): 1051–1059. https://doi.org/10.1029/WR017i004p01051.
Schnoor, J. L. 1996. Environmental modeling: Fate and transport of pollutants in water, air, and soil. New York: Wiley.
Schoups, G., and J. A. Vrugt. 2010. “A formal likelihood function for parameter and predictive inference of hydrologic models with correlated, heteroscedastic, and non-Gaussian errors.” Water Resour. Res. 46 (10): W10531. https://doi.org/10.1029/2009WR008933.
Shirmohammadi, A., et al. 2006. “Uncertainty in TMDL models.” Trans. ASABE 49 (4): 1033–1049. https://doi.org/10.13031/2013.21741.
Shoemaker, L., T. Dai, J. Koenig, and M. Hantush. 2005. TMDL model evaluation and research needs. Washington, DC: National Risk Management Research Laboratory and USEPA.
Sobol, I. M. 1993. “Sensitivity estimates for nonlinear mathematical models.” Math. Modell. Comput. Exp. 1 (4): 407–414.
Song, X., J. Zhang, C. Zhan, Y. Xuan, M. Ye, and C. Xu. 2015. “Global sensitivity analysis in hydrological modeling: Review of concepts, methods, theoretical framework, and applications.” J. Hydrol. 523: 739–757. https://doi.org/10.1016/j.jhydrol.2015.02.013.
Spear, R., and G. Hornberger. 1980. “Eutrophication in Peel Inlet—II. Identification of critical uncertainties via generalized sensitivity analysis.” Water Res. 14 (1): 43–49. https://doi.org/10.1016/0043-1354(80)90040-8.
Stedinger, J. R., R. M. Vogel, S. U. Lee, and R. Batchelder. 2008. “Appraisal of the generalized likelihood uncertainty estimation (GLUE) method.” Water Resour. Res. 44: W00B06. https://doi.org/10.1029/2008WR006822.
Stow, C. A., K. H. Reckhow, S. S. Qian, E. C. Lamon, G. B. Arhonditsis, M. E. Borsuk, and D. Seo. 2007. “Approaches to evaluate water quality model parameter uncertainty for adaptive TMDL implementation.” J. Am. Water Resour. Assoc. 43 (6): 1499–1507. https://doi.org/10.1111/j.1752-1688.2007.00123.x.
Stow, C. A., C. Roessler, M. E. Borsuk, J. D. Bowen, and K. H. Reckhow. 2003. “Comparison of estuarine water quality models for total maximum daily load development in Neuse River estuary.” J. Water Resour. Plann. Manage. 129 (4): 307–314. https://doi.org/10.1061/(ASCE)0733-9496(2003)129:4(307).
Tang, T., P. Reed, T. Wagener, and K. van Werkhoven. 2006. “Comparing sensitivity analysis methods to advance lumped watershed model identification and evaluation.” Hydrol. Earth Syst. Sci. Discuss. 3 (6): 3333–3395. https://doi.org/10.5194/hessd-3-3333-2006.
Thiemann, M., M. Trosset, H. Gupta, and S. Sorooshian. 2001. “Bayesian recursive parameter estimation for hydrologic models.” Water Resour. Res. 37 (10): 2521–2535. https://doi.org/10.1029/2000WR900405.
Tolson, B. A., and C. A. Shoemaker. 2007. “Dynamically dimensioned search algorithm for computationally efficient watershed model calibration.” Water Resour. Res. 43 (1): W01413. https://doi.org/10.1029/2005WR004723.
USACE. 2010. “HEC-DSS add-in excel data exchange for excel 2007–2010.” In User’s manual. Davis, CA: USACE, Institute for Water Resources, Hydrologic Engineering Center.
USACE. 2016. Hydrologic modeling system HEC-HMS: User’s manual. Davis, CA: Hydrologic Engineering Center.
USEPA. 1991. Guidance for water quality-based decisions: The TMDL process. Washington, DC: USEPA.
USEPA. 2000. BASINS Technical Note 6: Estimating hydrology and hydraulic parameters for HSPF. Washington, DC: USEPA.
USEPA. 2002. Guidance for quality assurance project plans for modeling. Washington, DC: USEPA.
USEPA. 2006. BASINS Technical Note 8: Sediment parameter and calibration guidance for HSPF. Washington, DC: USEPA.
USEPA. 2013a. Better assessment science integrating point and nonpoint sources. Washington, DC: USEPA.
USEPA. 2013b. “A long-term vision for assessment, restoration, and protection under the Clean Water Act Section 303(d) program.” Accessed July 24, 2018. https://www.epa.gov/sites/production/files/2015-07/documents/vision_303d_program_dec_2013.pdf.
van Griensven, A., and T. Meixner. 2007. “A global and efficient multi-objective auto-calibration and uncertainty estimation method for water quality catchment models.” J. Hydroinf. 9 (4): 277–291. https://doi.org/10.2166/hydro.2007.104.
Van Straten, G. T., and K. J. Keesman. 1991. “Uncertainty propagation and speculation in projective forecasts of environmental change: A lake-eutrophication example.” J. Forecasting 10 (1–2): 163–190. https://doi.org/10.1002/for.3980100110.
Vrugt, J. A., C. J. ter Braak, H. V. Gupta, and B. A. Robinson. 2009. “Equifinality of formal (DREAM) and informal (GLUE) Bayesian approaches in hydrologic modeling?” Stochastic Environ. Res. Risk Assess. 23 (7): 1011–1026. https://doi.org/10.1007/s00477-008-0274-y.
Walker, W. E., P. Harremoes, J. Rotmans, J. P. van der Sluijs, M. B. van Asselt, P. Janssen, and M. P. Krayer von Krauss. 2003. “Defining uncertainty a conceptual basis for uncertainty management in model-based decision support.” Integr. Assess. 4 (1): 5–17. https://doi.org/10.1076/iaij.4.1.5.16466.
White, K. L., and I. Chaubey. 2005. “Sensitivity analysis, calibration, and validations for a multisite and multivariable SWAT model.” J. Am. Water Resour. Assoc. 41 (5): 1077–1089. https://doi.org/10.1111/j.1752-1688.2005.tb03786.x.
Wiener, N. 1938. “The homogeneous chaos.” Am. J. Math. 60 (4): 897–936. https://doi.org/10.2307/2371268.
Willmott, C. J. 1981. “On the validation of models.” Phys. Geogr. 2 (2): 184–194. https://doi.org/10.1080/02723646.1981.10642213.
Wool, A. T., R. B. Ambrose, J. L. Martin, and E. A. Corner. 2003. Water quality analysis simulation program (WASP), Version 6: Draft users manual. Athens, GA: Environmental Research Laboratory and USEPA.
Woolhiser, D. A., R. Smith, and D. C. Goodrich. 1990. KINEROS, a kinematic runoff and erosion model: Documentation and user manual. Fort Collins, CO: USDA Agricultural Research Service.
Wu, S. H., P.-E. Jansson, and P. Kolari. 2011. “Modeling seasonal course of carbon fluxes and evapotranspiration in response to low temperature and moisture in a boreal Scots pine ecosystem.” Ecol. Modell. 222 (17): 3103–3119. https://doi.org/10.1016/j.ecolmodel.2011.05.023.
Yen, B. C., S. T. Cheng, and C. S. Melchin. 1986. “First-order reliability analysis.” In Stochastic and risk analysis in hydraulic engineering, edited by B. C. Yen, 1–36. Highlands Ranch, CO: Water Resources Publications.
Yuan, Y., Y. Khare, X. Wang, P. B. Parajuli, I. Kisekka, and S. Finsterle. 2015. “Hydrologic and water quality models: Sensitivity.” Trans. ASABE 58 (6): 1721–1744. https://doi.org/10.13031/trans.58.10611.
Zhang, H. X., and S. L. Yu. 2004. “Applying the first-order error analysis in determining the margin of safety for total maximum daily load computations.” J. Environ. Eng. 130 (6): 664–673. https://doi.org/10.1061/(ASCE)0733-9372(2004)130:6(664).
Zheng, Y., and F. Han. 2016. “Markov chain Monte Carlo (MCMC) uncertainty analysis for watershed water quality modeling and management.” Stochastic Environ. Res. Risk Assess. 30 (1): 293–308. https://doi.org/10.1007/s00477-015-1091-8.
Zheng, Y., and A. A. Keller. 2008. “Stochastic watershed water quality simulation for TMDL development—A case study in the Newport Bay Watershed.” J. Am. Water Resourc. Assoc. 44 (6): 1397–1410. https://doi.org/10.1111/j.1752-1688.2008.00232.x.
Zheng, Y., W. Wang, F. Han, and J. Ping. 2011. “Uncertainty assessment for watershed water quality modeling: A probabilistic collocation method based approach.” Adv. Water Resour. 34 (7): 887–898. https://doi.org/10.1016/j.advwatres.2011.04.016.
Information & Authors
Information
Published In
Journal of Hydrologic Engineering
Volume 24 • Issue 7 • July 2019
Copyright
©2019 American Society of Civil Engineers.
History
Published online: Apr 25, 2019
Published in print: Jul 1, 2019
Discussion open until: Sep 25, 2019
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.