Uncertainty Analyses in Hydrologic/Hydraulic Modeling: Challenges and Proposed Resolutions
Publication: Journal of Hydrologic Engineering
Volume 20, Issue 10
Abstract
Forum papers are thought-provoking opinion pieces or essays founded in fact, sometimes containing speculation, on a civil engineering topic of general interest and relevance to the readership of the journal. The views expressed in this Forum article do not necessarily reflect the views of ASCE or the Editorial Board of the journal.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
This paper was developed by the members of ASCE/EWRI’s Surface Water Hydrology Technical Committee–Uncertainty Analysis Approaches in Hydrologic/Hydraulic Modeling Application Task Committee. The authors are grateful for peer review comments provided by Dr. Stephanie Bray (Institute of Water Resources, U.S. Army Corps of Engineers), Dr. David T. Williams (DTW and Associates, LLC), Dr. Mohamed Hantush (National Risk Management Research Laboratory, U.S. Environmental Protection Agency), Dr. Aaron Byrd (Engineering Research and Development Center, U.S. Army Corps of Engineers), and Dr. R. Scott Huebner (South Florida Water Management District). In addition, the authors are grateful to the three anonymous reviewers who provided constructive review comments to improve this paper.
References
Ang, A. H.-S., and Tang, W. H. (1984). Probability concepts in engineering planning and design, Vol. II, Wiley, New York.
Apel, H., Thieken, A. H., Merz, B., and Bloschl, G. (2004). “Flood risk assessment and associated uncertainty.” Nat. Hazards Earth Syst. Sci., 4(2), 295–308.
Balin, D., Lee, H., and Rode, M. (2011). “Is point uncertain rainfall likely to have a great impact on distributed complex hydrological modeling?” Water Resour. Res., 46(11), 1–11.
Bear, J., Beljin, M. S., and Ross, R. R. (1992). “Fundamentals of groundwater modeling.”, U.S. Environmental Protection Agency, OK.
Beven, K. J. (1993). “Prophecy, reality and uncertainty in distributed hydrological modeling.” Adv. Water Resour., 16(1), 41–51.
Beven, K. J. (2000a). “On model uncertainty, risk and decision making.” Hydrol. Process., 14(14), 2605–2606.
Beven, K. J. (2000b). “Uniqueness of place and process representations in hydrological modelling.” Hydrol. Earth Syst. Sci., 4(2), 203–213.
Beven, K. J. (2007). “Towards integrated environmental models of everywhere: Uncertainty, data and modeling as a learning process.” Hydrol. Earth Syst. Sci., 11(1), 460–467.
Beven, K. J. (2009). Environmental modeling: An uncertain future?, Routledge, New York.
Beven, K. J., and Binley, A. M. (1992). “The future of distributed models: Model calibration and uncertainty prediction.” Hydrol. Process., 6(3), 279–298.
Beven, K. J., Buytaert, W., and Smith, L. A. (2012). “On virtual observatories and modelled realities (or why discharge must be treated as a virtual variable).” Hydrol. Process., 26(12), 1905–1908.
Beven, K. J., and Freer, J. (2001). “Equifinality, data assimilation, and uncertainty estimation in mechanistic modelling of complex environmental systems using the GLUE methodology.” J. Hydrol., 249(1–4), 11–29.
Beven, K. J., and Westerberg, I. K. (2011). “On red herrings and real herrings: Disinformation and information in hydrological inference.” Hydrol. Process., 25(10), 1676–1680.
Bloschl, G., and Grayson, R. (2000). Spatial patterns in catchment hydrology: Observations and modeling, Cambridge University Press, Cambridge.
Brugnach, M., et al. (2008). “Complexity and uncertainty: Rethinking the modelling activity.” Environmental modeling, software and decision support: State of the art and new perspectives, A. J. Jakeman, A. A. Voinov, A. E. Rizzoli, and S. H. Chen, eds., Elsevier, Netherlands.
Clark, M. P., Kavetski, D., and Fenicia, F. (2011). “Pursuing the method of multiple working hypotheses for hydrological modeling.” Water Resour. Res., 47(9), W09301.
Clark, M. P., and Slater, A. G. (2006). “Probabilistic quantitative precipitation estimation in complex terrain.” J. Hydrometeorol., 7(1), 3–22.
Coron, L., Andreassian, V., Perrin, C., Bourqui, M., and Hendrickx, F. (2014). “On the lack of robustness of hydrologic models regarding water balance simulation.” Hydrol. Earth Syst. Sci., 18(2), 727–746.
Delhomme, J. P. (1979). “Spatial variability and uncertainty in ground water flow parameters: A geostatistical approach.” Water Resour. Res., 15(2), 269–280.
Dettinger, M. D., and Wilson, J. L. (1981). “First order analysis of uncertainty in numerical models of groundwater flow.” Water Resour. Res., 17(1), 149–161.
Di Baldassarre, G., Laio, F., and Montanari, A. (2011). “Effect of observation errors on the uncertainty of design floods.” Phys. Chem. Earth., 42–44(2012), 85–90.
Gupta, H. V., Bastidas, L. A., Sorroshian, S., Shuttleworth, W. J., and Yang, Z. L. (1999). “Parameter estimation of a land surface scheme using multicriteria methods.” J. Geophys. Res., 104(D16), 19491–19503.
Gupta, H. V., Clark, M. P., Vrugt, J. A., Abramowitz, G., and Ye, M. (2012). “Towards a comprehensive assessment of model structural adequacy.” Water Resour. Res., 48(8), W08301.
Harr, M. E. (1989). “Probabilistic estimates for multivariate analyses.” Appl. Math. Model., 13 (5), 313–318.
Helton, J. C. (2006). “Uncertainty and sensitivity analysis for models of complex system.” Proc., Society for Experimental Mechanics: IMAC-XXIV, Conf., Society of Experimental Mechanics, Bethel, CT.
Hill, M. C., and Tiedeman, C. R. (2007). Effective groundwater model calibration with analysis of data, sensitivities, predictions and uncertainty, Wiley, New York.
Hoeksema, R. J., and Kitanidis, P. K. (1989). “Predictions of transmissivities, heads, and seepage velocities using mathematical models and geostatistics.” Adv. Water Res., 12(2), 90–102.
Hunt, R. J., Doherty, J., and Tonkin, J. (2007). “Are models too simple? Arguments for increased parameterization.” Groundwater, 45(3), 254–262.
Iman, R. L., and Conover, W. J. (1982). “A distribution free approach to inducing rank correlation among inputs.” Commun. Stat. Simul. Comput., 11(3), 335–360.
Kessler, J. H., and McGuire, R. M. (1999). “Total system performance assessment using a logic tree approach.” Risk Anal., 19(5), 915–932.
Lal, A. M. W. (1998a). “Performance comparison of overland flow algorithms.” J. Hydraul. Eng., 342–349.
Lal, A. M. W. (1998b). “Selection of spatial and temporal discretization in wetland modeling.” Proc., Int. Water Resources Engineering Conf., Memphis, TN, 604–609.
Lal, A. M. W. (2000). “Numerical errors in groundwater and overland flow models.” Water Resour. Res., 36(5), 1237–1247.
Lal, A. M. W. (2001). “Selection of time step and grid size in modeling integrated stream-aquifer interaction.” Proc., World Environmental Congress, ASCE/EWRI, Reston, VA.
Lal, A. M. W. (2008). “Optimal mesh design for groundwater models based on cost and error criteria.” Proc., EWRI World Environmental and Water Resources Conf., Honolulu.
Lal, A. M. W. (2012). “Numerical errors in diffusion wave models when simulating kinematic flow.” Proc., World Environmental and Water Resources Congress, ASCE/EWRI, Reston, VA.
Lal, A. M. W., and Van Zee, R. (2003). “Error analysis of the finite volume based regional simulation model RSM.” Proc., World Water and Environmental Resources Congress, ASCE/EWRI, Reston, VA.
Levin, R. (2006). “Adequacy conditions for reporting uncertainty in chemical risk assessments.” Human Ecol. Risk Assess., 12(5), 834–855.
Liu, X., and Kitanidis, P. K. (2011). “Large-scale inverse modeling with an application in hydraulic tomography.” Water Resour. Res., 47(2), W02501.
Liu, Y., and Gupta, H. V. (2007). “Uncertainty in hydrologic modeling: Toward an integrated data assimilation framework.” Water Resour. Res., 43(7), W07401.
Madsen, H. (2000). “Automatic calibration of a conceptual rainfall-runoff model using multiple objectives.” J. Hydrol., 235(3–4), 276–288.
Mantovan, P., and Todini, E. (2006). “Hydrological forecasting uncertainty assessment: Incoherence of the GLUE methodology.” J. Hydrol., 330(1–2), 368–381.
Maxim, L, and van der Sluijs, J. P. (2011). “Quality in environmental science for policy: Assessing uncertainty as a component of policy analysis.” Environ. Sci. Policy, 14(4), 482–492.
McCann, M. (2013). “Seismic risk of co-located critical facilities—Effects of correlation and uncertainty.” Proc., Workshop on Probabilistic Flood Hazards Assessment, Nuclear Regulatory Commission, Rockville, MD.
McKay, M. D., Conover, W. J., and Beckman, R. J. (1979). “A comparison of three methods for selecting values of input variables in the analysis of output from a computer code.” Technometrics, 21(3), 239–245.
McMillan, H., Krueger, T., and Freer, J. (2012). “Benchmarking observational uncertainties for hydrology: Rainfall, river discharge and water quality.” Hydrol. Process., 26(26), 4078–4111.
Mishra, S. (2009). “Uncertainty and sensitivity analysis techniques for hydrologic modeling.” J. Hydroinform., 11(3), 282–296.
Moradkhani, H., and Sorooshian, S. (2009). “General review of rainfall-runoff modeling: Model calibration, data assimilation, and uncertainty analysis.” Hydrological modeling and the water cycle, S. Sorooshian, E. Kuo-lin-Hsu, B. Coppola, M. Tomasseti, and G. Verdecchia Visconti, eds., Springer, Berlin.
Myšiak, J., Brown, J. D., Jansen, J. M. L., and Quinn, N. W. T. (2008). “Environmental policy aid under uncertainty.” Environmental modeling, software and decision support: State of the art and new perspectives, A. J. Jakeman, A. A. Voinov, A. E. Rizzoli, and S. H. Chen, eds., Univ. of Nebraska, Lincoln, NE.
Neuman, S. P. (1982). “Statistical characterization of aquifer heterogeneities: An overview.” Recent trends in hydrogeology, Geological Society of America, Boulder, CO, 81–102.
Neuman, S. P. (2003). “Maximum likelihood Bayesian averaging of uncertain model predictions.” Stochastic Environ. Res. Risk Assess., 17(5), 291–305.
Neuman, S. P., and Wierenga, P. J. (2003). “A comprehensive strategy of hydrogeologic modeling and uncertainty analysis for nuclear facilities and sites.”, U.S. Nuclear Regulatory Commission, Washington, DC.
NRC (National Research Council). (1994). Science and judgment in risk assessment, National Academy Press, Washington, DC.
Oudin, L., Perrin, C., Mathevet, T., Andreassian, V., and Michel, C. (2006). “Impact of biased and randomly corrupted inputs on the efficiency and the parameters of watershed models.” J. Hydrol., 320(1–2), 62–83.
PEST (Parameter Estimation Tool) [Computer software]. Reinholds, PA, Environmental Simulations, 〈http://www.pesthomepage.org/〉.
Poeter, E., and, Anderson, D. (2005). “Multimodel ranking and inference in ground water modeling.” Ground Water, 43(4), 597–605.
Recktenwald, G. (2006). “Uncertainty estimation and calculation.” Dept. of Mechanical Engineering, Portland State Univ., Portland, OR.
Refsgaard, J. C., and Storm, B. (1996). “Construction, calibration and validation of hydrological models.” Distributed hydrological modelling water science and technology library, M. B. Abbot and J. C. Refsgaard, eds., Springer, Netherlands.
Refsgaard, J. C., van der Sluijs, J. P., Højberg, A. L., and Vanrolleghem, P. A. (2007). Uncertainty in the environmental modelling process–a framework and guidance.” Environ. Model. Software, 22(11), 1543–1556.
Romanowicz, R., and Beven, K. J. (1998). “Dynamic real-time prediction of flood inundation probabilities.” Hydrol. Sci. J., 43(2), 181–196.
Singh, A., Mishra, S., and Ruskauff, G. (2010). “Model averaging techniques for quantifying conceptual model uncertainty.” Ground Water, 48(5), 701–715.
Skahill, B. (2013a). “Initial development and testing of a state-of-art method to quantify hydrologic model uncertainty.”, U.S. Army Corps of Engineers, Vicksburg, MS.
Skahill, B. (2013b). “Practice driven and state-of-the-art methods to quantify hydrologic model uncertainty.”, U.S. Army Corps of Engineers, Vicksburg, MS.
Sobol, I. M. (2001). “Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates.” Math. Comput. Simul., 55(1–3), 271–280.
Stedinger, J. R., Vogel, R. M., Lee, S. U., and Batchelder, R. (2008). “Appraisal of the generalized likelihood uncertainty estimation (GLUE) method.” Water Resour. Res., 44(12), W00B06.
Teegavarapu, R. S. V. (2010). “Modeling climate change uncertainties in water resources management models.” Environ. Model. Software, 25(10), 1261–1265.
Teegavarapu, R. S. V. (2013). “Climate change-sensitive hydrologic design under uncertain future precipitation extremes.” Water Resour. Res., 49(11), 7804–7814.
Teegavarapu, R. S. V., Senarath, S., and Pathak, C. (2010). “Sampling schemes for uncertainty assessment of a hydrologic simulation model.” Proc., World Environmental and Water Resources Congress 2010, ASCE/EWRI, Reston, VA, 4769–4778.
Teegavarapu, R. S. V., and Simonovic, S. P. (1999). “Modeling reservoir loss functions using fuzzy sets.” Water Resour. Res., 35(9), 2815–2823.
Thiemann, M., Trosset, M., Gupta, H., and Sorooshian, S. (2001). “Bayesian recursive parameter estimation for hydrologic models.” Water Resour. Res., 37(10), 2521–2535.
Tsai, F. T.-C., and Li, X. (2008). “Ground water inverse modeling for hydraulic conductivity estimation using Bayesian model averaging and variance window.” Water Resour. Res., 44(9), W09434.
Tung, Y.-K., and Ben, B.-C. (2005). Hydrosystems engineering uncertainty analysis, McGraw-Hill, New York.
USACE (U.S. Army Corps of Engineers). (2013). “Risk analysis for flood risk management studies.”, Washington, DC.
Van Griensven, A., Meixner, T., Grunwald, S., Bishop, T., Diluzio, M., and Srinivasan, R. (2006). “A global sensitivity analysis tool for the parameters of multi-variable catchment models.” J. Hydrol., 324(1–4), 10–23.
Vrugt, J. A., ter Braak, C. J. F., Clark, M. P., Hyman, J. M., and Robinson, B. A. (2008). “Treatment of input uncertainty in hydrologic modeling: Doing hydrology backward with Markov chain Monte Carlo simulation.” Water Resour. Res., 44(12), W00B09.
Wagner, B. J., and Gorelick, S. M. (1989). “Reliable aquifer remediation in the presence of spatially variable hydraulic conductivity: From data to design.” Water Resour. Res., 25(10), 2211–2225.
Willis, R., and Yeh, W. W.-G. (1987). Groundwater systems planning and management, Prentice-Hall, New York.
Xu, C., Tunemar, L., Chen, Y. D., and Singh, V. P. (2006). “Evaluation of seasonal and spatial variations of lumped water balance model sensitivity to precipitation data errors.” J. Hydrol., 324(1–4), 80–93.
Yapo, P. O., Gupta, H. V., and Sorooshian, S. (1998). “Multi-objective global optimization for hydrologic models.” J. Hydrol., 204(1–4), 83–97.
Ye, M., Meyer, P. D., and Neuman, S. P. (2008). “On model selection criteria in multimodel analysis.” Water Resour. Res., 44(3), W03428.
Ye, M., Neuman, S. P., and Meyer, P. D. (2004). “Maximum likelihood Bayesian averaging of spatial variability models in unsaturated fractured tuff.” Water Resour. Res., 40(5), W05113.
Zahraeifard, V., Deng, Z.-Q., and Malone, R. (2014). “Modeling spatial variations in dissolved oxygen in fine-grained streams under uncertainty.” Hydrol. Process., 29(2), 213–224.
Information & Authors
Information
Published In
Journal of Hydrologic Engineering
Volume 20 • Issue 10 • October 2015
Copyright
© 2015 American Society of Civil Engineers.
History
Received: Sep 23, 2014
Accepted: Mar 19, 2015
Published online: Jul 15, 2015
Published in print: Oct 1, 2015
Discussion open until: Dec 15, 2015
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.