Abstract
Flood Insurance Rate Maps (FIRMs) managed by FEMA have been providing ongoing flood information to most communities in the United States over the past half-century. However, the uncertainty associated with the modeling of FIRMs, some of which are created by using a single Hydrologic Engineering Center River Analysis System (HEC-RAS) one-dimensional (1D) steady-flow model, may have adverse effects on the reliability of flood stage and inundation extent predictions. Therefore, a systematic understanding of the uncertainty in the modeling process of FIRMs is necessary. Bayesian model averaging (BMA), which is a statistical approach that can combine estimations from multiple models and produce reliable probabilistic predictions, was applied to evaluating the uncertainty associated with FIRMs. In this study, both the BMA and hierarchical BMA (HBMA) approaches were used to quantify the uncertainty within the detailed FEMA models of the Deep River and the Saint Marys River in the state of Indiana based on water stage predictions from 150 HEC-RAS 1D unsteady-flow model configurations that incorporate four uncertainty sources including bridges, channel roughness, floodplain roughness, and upstream flow input. Given the ensemble predictions and the observed water stage data in the training period, the BMA weight and the variance for each model member were obtained, and then the BMA prediction ability was validated for the observed data from the later period. The results indicate that the BMA prediction is more robust than both the original FEMA model and the ensemble mean. Furthermore, the HBMA framework explicitly shows the propagation of various uncertainty sources, and both the channel roughness and the upstream flow input have a larger impact on prediction variance than bridges. Hence, it provides insights for modelers into the relative impact of individual uncertainty sources in the flood modeling process. The results show that the probabilistic flood maps developed based on the BMA analysis could provide more reliable predictions than the deterministic FIRMs.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
All the data used in this study, including the gauge streamflow and water stage data, are publicly available from the USGS website. FEMA’s flood models used in this study are available from the Indiana Department of Natural Resources’ Hydrology and Hydraulics Model Library at https://dnrmaps.dnr.in.gov/appsphp/model/index.php.
References
Acharya, N., N. A. Shrivastava, B. Panigrahi, and U. Mohanty. 2014. “Development of an artificial neural network based multi-model ensemble to estimate the northeast monsoon rainfall over south peninsular India: An application of extreme learning machine.” Clim. Dyn. 43 (5–6): 1303–1310. https://doi.org/10.1007/s00382-013-1942-2.
Ajami, N. K., Q. Duan, X. Gao, and S. Sorooshian. 2006. “Multimodel combination techniques for analysis of hydrological simulations: Application to distributed model intercomparison project results.” J. Hydrometeorol. 7 (4): 755–768. https://doi.org/10.1175/JHM519.1.
Apel, H., G. Aronica, H. Kreibich, and A. Thieken. 2009. “Flood risk analyses—How detailed do we need to be?” Nat. Hazard. 49 (1): 79–98. https://doi.org/10.1007/s11069-008-9277-8.
Arcement, G. J., and V. R. Schneider. 1989. Guide for selecting Manning’s roughness coefficients for natural channels and flood plains. Washington, DC: US Government Printing Office.
Arvin, D. V., H. T. Nguyen, and L. M. Huff. 2003. “Flood of North-Central Indiana.” Accessed April 1, 2004. https://pubs.usgs.gov/fs/2003/fs-094-03/.
Bari, M. A., L. Alam, M. M. Alam, L. F. Rahman, and J. J. Pereira. 2021. “Estimation of losses and damages caused by flash floods in the commercial area of Kajang, Selangor, Malaysia.” Arabian J. Geosci. 14 (3): 1–9. https://doi.org/10.1007/s12517-021-06503-x.
Bates, J. M., and C. W. Granger. 1969. “The combination of forecasts.” J. Oper. Res. Soc. 20 (4): 451–468. https://doi.org/10.1057/jors.1969.103.
Bates, P. D., and A. De Roo. 2000. “A simple raster-based model for flood inundation simulation.” J. Hydrol. 236 (1–2): 54–77. https://doi.org/10.1016/S0022-1694(00)00278-X.
Beven, K., and A. Binley. 1992. “The future of distributed models: Model calibration and uncertainty prediction.” Hydrol. Processes 6 (3): 279–298. https://doi.org/10.1002/hyp.3360060305.
Beven, K. J., and J. Hall. 2014. Applied uncertainty analysis for flood risk management. Singapore: World Scientific.
Box, G. E., and D. R. Cox. 1964. “An analysis of transformations.” J. R. Stat. Soc. B 26 (2): 211–243. https://doi.org/10.1111/j.2517-6161.1964.tb00553.x.
Brunner, G. W. 2016a. HEC-RAS hydraulic reference manual. Davis, CA: Hydrologic Engineering Center.
Brunner, G. W. 2016b. HEC-RAS river analysis system. Davis, CA: Hydrologic Engineering Center.
Chattopadhyay, S., and G. Chattopadhyay. 2008. “Comparative study among different neural net learning algorithms applied to rainfall time series.” Meteorol. Appl. 15 (2): 273–280. https://doi.org/10.1002/met.71.
Chitsazan, N., and F. T. C. Tsai. 2015. “A hierarchical Bayesian model averaging framework for groundwater prediction under uncertainty.” Ground Water 53 (2): 305–316. https://doi.org/10.1111/gwat.12207.
Cook, A., and V. Merwade. 2009. “Effect of topographic data, geometric configuration and modeling approach on flood inundation mapping.” J. Hydrol. 377 (1–2): 131–142. https://doi.org/10.1016/j.jhydrol.2009.08.015.
Dar, R. A., S. A. Mir, and S. A. Romshoo. 2019. “Influence of geomorphic and anthropogenic activities on channel morphology of River Jhelum in Kashmir Valley, NW Himalayas.” Quat. Int. 507 (Sep): 333–341. https://doi.org/10.1016/j.quaint.2018.12.014.
Davenport, F. V., M. Burke, and N. S. Diffenbaugh. 2021. “Contribution of historical precipitation change to US flood damages.” Proc. Natl. Acad. Sci. U.S.A. 118 (4): e2017524118. https://doi.org/10.1073/pnas.2017524118.
Demeritt, D., H. Cloke, F. Pappenberger, J. Thielen, J. Bartholmes, and M.-H. Ramos. 2007. “Ensemble predictions and perceptions of risk, uncertainty, and error in flood forecasting.” Environ. Hazards 7 (2): 115–127. https://doi.org/10.1016/j.envhaz.2007.05.001.
Dickinson, J. 1973. “Some statistical results in the combination of forecasts.” J. Oper. Res. Soc. 24 (2): 253–260. https://doi.org/10.1057/jors.1973.42.
Duan, Q., N. K. Ajami, X. Gao, and S. Sorooshian. 2007. “Multi-model ensemble hydrologic prediction using Bayesian model averaging.” Adv. Water Resour. 30 (5): 1371–1386. https://doi.org/10.1016/j.advwatres.2006.11.014.
FEMA. 2001. “Modernizing FEMAs flood hazard mapping program: Recommendations for using future-conditions hydrology for the national flood insurance program.” Accessed November 27, 2001. https://www.fema.gov/sites/default/files/2020-03/frm_frpt.pdf.
FEMA. 2015 “FEMA’s National Flood Hazard Layer (NFHL) viewer.” Accessed January 30, 2015. https://msc.fema.gov/nfhl.
FEMA. 2018. “Guidance for flood risk analysis and mapping.” Accessed February 27, 2018. https://www.fema.gov/sites/default/files/2020-02/Base_Level_Engineering_Guidance_Feb_2018.pdf.
Fowler, K. K., M. H. Kim, C. D. Menke, and D. V. Arvin. 2010. “Flood of September 2008 in northwestern Indiana.” Accessed September 12, 2008. https://pubs.er.usgs.gov/publication/ofr20101098.
Gupta, H. V., H. Kling, K. K. Yilmaz, and G. F. Martinez. 2009. “Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling.” J. Hydrol. 377 (1–2): 80–91. https://doi.org/10.1016/j.jhydrol.2009.08.003.
Hall, J. W., S. Tarantola, P. D. Bates, and M. S. Horritt. 2005. “Distributed sensitivity analysis of flood inundation model calibration.” J. Hydraul. Eng. 131 (2): 117–126. https://doi.org/10.1061/(ASCE)0733-9429(2005)131:2(117).
Harmel, R., R. Cooper, R. Slade, R. Haney, and J. Arnold. 2006. “Cumulative uncertainty in measured streamflow and water quality data for small watersheds.” Trans. ASABE 49 (3): 689–701. https://doi.org/10.13031/2013.20488.
Horn, D. P., and J. T. Brown. 2017. Introduction to the national flood insurance program (NFIP). Washington, DC: Congressional Research Service.
Horritt, M. 2006. “A methodology for the validation of uncertain flood inundation models.” J. Hydrol. 326 (1–4): 153–165. https://doi.org/10.1016/j.jhydrol.2005.10.027.
INDNR (Indiana Dept. of Natural Resources). 2018. “Indiana hydrology and hydraulics model library.” Accessed August 3, 2022. https://dnrmaps.dnr.in.gov/appsphp/model/index.php.
Ionita, M., and V. Nagavciuc. 2021. “Extreme floods in the eastern part of Europe: Large-scale drivers and associated impacts.” Water 13 (8): 1122. https://doi.org/10.3390/w13081122.
Kass, R. E., and A. E. Raftery. 1995. “Bayes factors.” J. Am. Stat. Assoc. 90 (430): 773–795. https://doi.org/10.1080/01621459.1995.10476572.
Kimuli, J. B., B. Di, R. Zhang, S. Wu, J. Li, and W. Yin. 2021. “A multisource trend analysis of floods in Asia-Pacific 1990–2018: Implications for climate change in sustainable development goals.” Int. J. Disaster Risk Reduct. 2021 (4): 102237. https://doi.org/10.1016/j.ijdrr.2021.102237.
Kling, H., M. Fuchs, and M. Paulin. 2012. “Runoff conditions in the upper Danube basin under an ensemble of climate change scenarios.” J. Hydrol. 424 (3): 264–277. https://doi.org/10.1016/j.jhydrol.2012.01.011.
Krishnamurti, T., C. M. Kishtawal, T. E. LaRow, D. R. Bachiochi, Z. Zhang, C. E. Williford, S. Gadgil, and S. Surendran. 1999. “Improved weather and seasonal climate forecasts from multimodel superensemble.” Science 285 (5433): 1548–1550. https://doi.org/10.1126/science.285.5433.1548.
Leamer, E. E. 1978. Specification searches: Ad hoc inference with nonexperimental data. New York: Wiley.
Liu, Z., and V. Merwade. 2018. “Accounting for model structure, parameter and input forcing uncertainty in flood inundation modeling using Bayesian model averaging.” J. Hydrol. 565 (Aug): 138–149. https://doi.org/10.1016/j.jhydrol.2018.08.009.
Liu, Z., and V. Merwade. 2019. “Separation and prioritization of uncertainty sources in a raster based flood inundation model using hierarchical Bayesian model averaging.” J. Hydrol. 578 (5): 124100. https://doi.org/10.1016/j.jhydrol.2019.124100.
Liu, Z., V. Merwade, and K. Jafarzadegan. 2019. “Investigating the role of model structure and surface roughness in generating flood inundation extents using one-and two-dimensional hydraulic models.” J. Flood Risk Manage. 12 (1): e12347. https://doi.org/10.1111/jfr3.12347.
Madadgar, S., and H. Moradkhani. 2014. “Improved Bayesian multimodeling: Integration of copulas and Bayesian model averaging.” Water Resour. Res. 50 (12): 9586–9603. https://doi.org/10.1002/2014WR015965.
Makridakis, S., A. Andersen, R. Carbone, R. Fildes, M. Hibon, R. Lewandowski, J. Newton, E. Parzen, and R. Winkler. 1982. “The accuracy of extrapolation (time series) methods: Results of a forecasting competition.” J. Forecast. 1 (2): 111–153. https://doi.org/10.1002/for.3980010202.
Makridakis, S., and R. L. Winkler. 1983. “Averages of forecasts: Some empirical results.” Manage. Sci. 29 (9): 987–996. https://doi.org/10.1287/mnsc.29.9.987.
McLachlan, G. J., and T. Krishnan. 2007. The EM algorithm and extensions. New York: Wiley.
Merwade, V., F. Olivera, M. Arabi, and S. Edleman. 2008. “Uncertainty in flood inundation mapping: Current issues and future directions.” J. Hydrol. Eng. 13 (7): 608–620. https://doi.org/10.1061/(ASCE)1084-0699(2008)13:7(608).
Merz, B., and A. H. Thieken. 2005. “Separating natural and epistemic uncertainty in flood frequency analysis.” J. Hydrol. 309 (1–4): 114–132. https://doi.org/10.1016/j.jhydrol.2004.11.015.
Nash, J. E., and J. V. Sutcliffe. 1970. “River flow forecasting through conceptual models part I—A discussion of principles.” J. Hydrol. 10 (3): 282–290. https://doi.org/10.1016/0022-1694(70)90255-6.
Nassor, B. S., and M. O. Makame. 2021. “Assessing community adaptation strategies to floods in flood-prone areas of urban district, Zanzibar, Tanzania.” J. Sustainable Dev. 14 (3): 95. https://doi.org/10.5539/jsd.v14n3p95.
Neuman, S., P. J. Wierenga, and T. Nicholson. 2003. A comprehensive strategy of hydrogeologic modeling and uncertainty analysis for nuclear facilities and sites. North Bethesda, MD: US Nuclear Regulatory Commission.
Neuman, S. P. 2003. “Maximum likelihood Bayesian averaging of uncertain model predictions.” Stochastic Environ. Res. Risk Assess. 17 (5): 291–305. https://doi.org/10.1007/s00477-003-0151-7.
Newbold, P., and C. W. Granger. 1974. “Experience with forecasting univariate time series and the combination of forecasts.” J. R. Stat. Soc. A 137 (2): 131–146. https://doi.org/10.2307/2344546.
Nobre, A. D., L. A. Cuartas, M. Hodnett, C. D. Rennó, G. Rodrigues, A. Silveira, and S. Saleska. 2011. “Height above the nearest drainage—A hydrologically relevant new terrain model.” J. Hydrol. 404 (1–2): 13–29. https://doi.org/10.1016/j.jhydrol.2011.03.051.
Pappenberger, F., K. Beven, M. Horritt, and S. Blazkova. 2005. “Uncertainty in the calibration of effective roughness parameters in HEC-RAS using inundation and downstream level observations.” J. Hydrol. 302 (1–4): 46–69. https://doi.org/10.1016/j.jhydrol.2004.06.036.
Pappenberger, F., K. J. Beven, M. Ratto, and P. Matgen. 2008. “Multi-method global sensitivity analysis of flood inundation models.” Adv. Water Resour. 31 (1): 1–14. https://doi.org/10.1016/j.advwatres.2007.04.009.
Parrish, M. A., H. Moradkhani, and C. M. DeChant. 2012. “Toward reduction of model uncertainty: Integration of Bayesian model averaging and data assimilation.” Water Resour. Res. 48 (3): 1116. https://doi.org/10.1029/2011WR011116.
Raftery, A. E., T. Gneiting, F. Balabdaoui, and M. Polakowski. 2005. “Using Bayesian model averaging to calibrate forecast ensembles.” Mon. Weather Rev. 133 (5): 1155–1174. https://doi.org/10.1175/MWR2906.1.
Raftery, A. E., D. Madigan, and J. A. Hoeting. 1997. “Bayesian model averaging for linear regression models.” J. Am. Stat. Assoc. 92 (437): 179–191. https://doi.org/10.1080/01621459.1997.10473615.
Refsgaard, J. C., S. Christensen, T. O. Sonnenborg, D. Seifert, A. L. Højberg, and L. Troldborg. 2012. “Review of strategies for handling geological uncertainty in groundwater flow and transport modeling.” Adv. Water Resour. 36 (Apr): 36–50. https://doi.org/10.1016/j.advwatres.2011.04.006.
Rings, J., J. A. Vrugt, G. Schoups, J. A. Huisman, and H. Vereecken. 2012. “Bayesian model averaging using particle filtering and Gaussian mixture modeling: Theory, concepts, and simulation experiments.” Water Resour. Res. 48 (5): 11067. https://doi.org/10.1029/2011WR011607.
Sakia, R. M. 1992. “The Box-Cox transformation technique: A review.” J. R. Stat. Soc. D 41 (2): 169–178. https://doi.org/10.2307/2348250.
Saksena, S., V. Merwade, and P. J. Singhofen. 2019. “Flood inundation modeling and mapping by integrating surface and subsurface hydrology with river hydrodynamics.” J. Hydrol. 575 (14): 1155–1177. https://doi.org/10.1016/j.jhydrol.2019.06.024.
Sauer, V. B., and R. Meyer. 1992. Determination of error in individual discharge measurements. Reston, VA: USGS. https://doi.org/10.3133/ofr92144.
Shamseldin, A. Y., and K. M. O’Connor. 1999. “A real-time combination method for the outputs of different rainfall-runoff models.” Hydrol. Sci. J. 44 (6): 895–912. https://doi.org/10.1080/02626669909492288.
Shamseldin, A. Y., K. M. O’Connor, and G. Liang. 1997. “Methods for combining the outputs of different rainfall–runoff models.” J. Hydrol. 197 (1–4): 203–229. https://doi.org/10.1016/S0022-1694(96)03259-3.
Singh, A., S. Mishra, and G. Ruskauff. 2010. “Model averaging techniques for quantifying conceptual model uncertainty.” Ground Water 48 (5): 701–715. https://doi.org/10.1111/j.1745-6584.2009.00642.x.
Smemoe, C. M., E. J. Nelson, A. K. Zundel, and A. W. Miller. 2007. “Demonstrating floodplain uncertainty using flood probability maps.” J. Am. Water Resour. Assoc. 43 (2): 359–371. https://doi.org/10.1111/j.1752-1688.2007.00028.x.
Tebaldi, C., and R. Knutti. 2007. “The use of the multi-model ensemble in probabilistic climate projections.” Philos. Trans. R. Soc. London, Ser. A 365 (1857): 2053–2075. https://doi.org/10.1098/rsta.2007.2076.
Teng, J., A. J. Jakeman, J. Vaze, B. F. Croke, D. Dutta, and S. Kim. 2017. “Flood inundation modelling: A review of methods, recent advances and uncertainty analysis.” Environ. Modell. Software 90 (4): 201–216. https://doi.org/10.1016/j.envsoft.2017.01.006.
Tiwari, H., S. P. Rai, and K. Shivangi. 2016. “Bridging the gap or broadening the problem?” Nat. Hazard. 84 (1): 351–366. https://doi.org/10.1007/s11069-016-2422-x.
Tsai, F. T. C., and X. Li. 2008. “Inverse groundwater modeling for hydraulic conductivity estimation using Bayesian model averaging and variance window.” Water Resour. Res. 44 (9): 8. https://doi.org/10.1029/2007WR006576.
Tsai, F. T.-C. 2010. “Bayesian model averaging assessment on groundwater management under model structure uncertainty.” Stochastic Environ. Res. Risk Assess. 24 (6): 845–861. https://doi.org/10.1007/s00477-010-0382-3.
USGS. 2019 “EarthExplorer.” Accessed August 2, 2019. https://earthexplorer.usgs.gov/.
Van Asselt, M. B., and J. Rotmans. 2002. “Uncertainty in integrated assessment modelling.” Clim. Change 54 (1): 75–105. https://doi.org/10.1023/A:1015783803445.
Von Bertalanffy, L. 1972. “The history and status of general systems theory.” Acad. Manage. J. 15 (4): 407–426. https://doi.org/10.2307/255139.
Vrugt, J. A., C. G. Diks, and M. P. Clark. 2008. “Ensemble Bayesian model averaging using Markov chain Monte Carlo sampling.” Environ. Fluid Mech. 8 (5–6): 579–595. https://doi.org/10.1007/s10652-008-9106-3.
Wing, O. E., P. D. Bates, A. M. Smith, C. C. Sampson, K. A. Johnson, J. Fargione, and P. Morefield. 2018. “Estimates of present and future flood risk in the conterminous United States.” Environ. Res. Lett. 13 (3): 034023. https://doi.org/10.1088/1748-9326/aaac65.
Winkler, R. L. 1989. “Combining forecasts: A philosophical basis and some current issues.” Int. J. Forecast. 5 (4): 605–609. https://doi.org/10.1016/0169-2070(89)90018-6.
Zounemat-Kermani, M., O. Batelaan, M. Fadaee, and R. Hinkelmann. 2021. “Ensemble machine learning paradigms in hydrology: A review.” J. Hydrol. 598 (Apr): 126266. https://doi.org/10.1016/j.jhydrol.2021.126266.
Information & Authors
Information
Published In
Journal of Hydrologic Engineering
Volume 28 • Issue 2 • February 2023
Copyright
© 2022 American Society of Civil Engineers.
History
Received: Jun 9, 2022
Accepted: Sep 14, 2022
Published online: Nov 17, 2022
Published in print: Feb 1, 2023
Discussion open until: Apr 17, 2023
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.