Optimal Hydrological Model Calibration Strategy for Climate Change Impact Studies
Publication: Journal of Hydrologic Engineering
Volume 27, Issue 3
Abstract
To assess the impacts of climate change on water resources, hydrological models are the most commonly used to simulate future flows. Hydrological model calibration is typically based on historical hydrometeorological data, which may not be representative of the future climate. This paper evaluates various calibration strategies to minimize this issue. The impact of these calibration strategies is measured on 921 North American catchments using a lumped hydrological model. Five calibration strategies (warm, low rainfall, high rainfall, low-flow, and high-flow years) were investigated, each using a 5-year (noncontinuous) independent validation dataset maximizing all five studied climate anomalies. The remaining years were used as a pool of calibration years, using targeted subsets of years in multiples of five to assess the impact of the number of calibration years versus the climate anomaly of each calibration subset. Results showed large cross-catchment variability, indicating that no single calibration strategy and number of calibration years were optimal for all watersheds. However, the large number of catchments used in this study allows for some general conclusions to be drawn. For the warm-years calibration strategy, using a large number of years was the approach most likely to succeed, indicating that removing a small subset of cold years was preferable to keeping a small subset of warm years. For the other four calibration strategies, the approach most likely to succeed was the one in which about half of the years in the historical record were kept. For the warm year strategy, keeping a larger number of years for calibration ensures better model robustness to account for precipitation variability in the validation set. For the other four calibration strategies, which are mostly related to precipitation, a larger number of years had to be dropped to account for the much larger differences between wet and dry years.
Get full access to this article
View all available purchase options and get full access to this article.
References
Anderson, E. A. 2002. Calibration of conceptual hydrologic models for use in river forecasting. Silver Spring, MD: Office of Hydrologic Development, US National Weather Service.
Andréassian, V., C. Perrin, and C. Michel. 2004. “Impact of imperfect potential evapotranspiration knowledge on the efficiency and parameters of watershed models.” J. Hydrol. 286 (1–4): 19–35. https://doi.org/10.1016/j.jhydrol.2003.09.030.
Arsenault, R., F. Brissette, J. Chen, Q. Guo, and G. Dallaire. 2020a. “NAC2H: The North American climate change and hydroclimatology data set.” Water Resour. Res. 56 (8): e2020WR027097. https://doi.org/10.1029/2020WR027097.
Arsenault, R., F. Brissette, and J.-L. Martel. 2018. “The hazards of split-sample validation in hydrological model calibration.” J. Hydrol. 566 (Nov): 346–362. https://doi.org/10.1016/j.jhydrol.2018.09.027.
Arsenault, R., F. Brissette, J.-L. Martel, M. Troin, G. Lévesque, J. Davidson-Chaput, M. C. Gonzalez, A. Ameli, and A. Poulin. 2020b. “A comprehensive, multisource database for hydrometeorological modeling of 14,425 North American watersheds.” Sci. Data 7 (1): 1–12. https://doi.org/10.1038/s41597-020-00583-2.
Arsenault, R., A. Poulin, P. Côté, and F. Brissette. 2014. “Comparison of stochastic optimization algorithms in hydrological model calibration.” J. Hydrol. Eng. 19 (7): 1374–1384. https://doi.org/10.1061/(ASCE)HE.1943-5584.0000938.
Beven, K., and J. Freer. 2001. “Equifinality, data assimilation, and uncertainty estimation in mechanistic modelling of complex environmental systems using the GLUE methodology.” J. Hydrol. 249 (1–4): 11–29. https://doi.org/10.1016/S0022-1694(01)00421-8.
Brigode, P., L. Oudin, and C. Perrin. 2013. “Hydrological model parameter instability: A source of additional uncertainty in estimating the hydrological impacts of climate change?” J. Hydrol. 476 (Jan): 410–425. https://doi.org/10.1016/j.jhydrol.2012.11.012.
Conover, W. J., M. E. Johnson, and M. M. Johnson. 1981. “A comparative study of tests for homogeneity of variances, with applications to the outer continental shelf bidding data.” Technometrics 3 (4): 351–361.
Coron, L., V. Andreassian, C. Perrin, J. Lerat, J. Vaze, M. Bourqui, and F. Hendrickx. 2012. “Crash testing hydrological models in contrasted climate conditions: An experiment on 216 Australian catchments.” Water Resour. Res. 48 (5): 1–17. https://doi.org/10.1029/2011WR011721.
Coron, L., V. Andréassian, M. Bourqui, C. Perrin, and F. Hendrickx. 2011. “Pathologies of hydrological models used in changing climatic conditions: A review.” In Proc., Symp. J-H02 at IUGG 2011. Brussels, Belgium: International Union of Geodesy and Geophysics.
Coron, L., V. Andréassian, C. Perrin, M. Bourqui, and F. Hendrickx. 2014. “On the lack of robustness of hydrologic models regarding water balance simulation: A diagnostic approach applied to three models of increasing complexity on 20 mountainous catchments.” Hydrol. Earth Syst. Sci. 18 (2): 727–746. https://doi.org/10.5194/hess-18-727-2014.
Coron, L., G. Thirel, O. Delaigue, C. Perrin, and V. Andréassian. 2017. “The suite of lumped GR hydrological models in an R package.” Environ. Model. Software 94 (Aug): 166–171. https://doi.org/10.1016/j.envsoft.2017.05.002.
Dallaire, G., A. Poulin, R. Arsenault, and F. Brissette. 2021. “Uncertainty of potential evapotranspiration modelling in climate change impact studies on low flows in North America.” Hydrol. Sci. J. 66 (4): 689–702. https://doi.org/10.1080/02626667.2021.1888955.
Deser, C., R. Knutti, S. Solomon, and A. S. Phillips. 2012. “Communication of the role of natural variability in future North American climate.” Nat. Clim. Change 2 (11): 775–779. https://doi.org/10.1038/nclimate1562.
Duethmann, D., G. Blöschl, and J. Parajka. 2020. “Why does a conceptual hydrological model fail to correctly predict discharge changes in response to climate change?” Hydrol. Earth Syst. Sci. 24 (7): 3493–3511. https://doi.org/10.5194/hess-24-3493-2020.
Folland, C. K., T. R. Karl, and M. Jim Salinger. 2001. “Observed climate variability and change.” In Climate change 2001: The scientific basis, 99–181. Cambridge, UK: Cambridge University Press.
Gharari, S., M. Hrachowitz, F. Fenicia, and H. Savenije. 2013. “An approach to identify time consistent model parameters: Sub-period calibration.” Hydrol. Earth Syst. Sci. 17 (1): 149. https://doi.org/10.5194/hess-17-149-2013.
Giuntoli, I., G. Villarini, C. Prudhomme, and D. M. Hannah. 2018. “Uncertainties in projected runoff over the conterminous United States.” Clim. Change 150 (3–4): 149–162. https://doi.org/10.1007/s10584-018-2280-5.
Goosse, H., H. Renssen, A. Timmermann, and R. S. Bradley. 2005. “Internal and forced climate variability during the last millennium: A model-data comparison using ensemble simulations.” Quat. Sci. Rev. 24 (12–13): 1345–1360. https://doi.org/10.1016/j.quascirev.2004.12.009.
Gupta, H. V., H. Kling, K. K. Yilmaz, and G. F. Martinez. 2009. “Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modeling.” J. Hydrol. 377 (1–2): 80–91. https://doi.org/10.1016/j.jhydrol.2009.08.003.
Hansen, N., and A. Ostermeier. 1996. “Adapting arbitrary normal mutation distributions in evolution strategies: The covariance matrix adaptation.” In Proc., IEEE Int. Conf. on Evolutionary Computation, 312–317. New York: IEEE.
Hansen, N., and A. Ostermeier. 2001. “Completely derandomized self-adaptation in evolution strategies.” Evol. Comput. 9 (2): 159–195. https://doi.org/10.1162/106365601750190398.
Hawkins, E., and R. Sutton. 2012. “Time of emergence of climate signals.” Geophys. Res. Lett. 39 (1): 1–6. https://doi.org/10.1029/2011GL050087.
Her, Y., S.-H. Yoo, J. Cho, S. Hwang, J. Jeong, and C. Seong. 2019. “Uncertainty in hydrological analysis of climate change: Multi-parameter vs. multi-GCM ensemble predictions.” Sci. Rep. 9 (1): 1–22. https://doi.org/10.1038/s41598-019-41334-7.
Hollander, M., D. A. Wolfe, and E. Chicken. 2013. Vol. 751 of Nonparametric statistical methods. Hoboken, NJ: Wiley.
Immerzeel, W., and P. Droogers. 2008. “Calibration of a distributed hydrological model based on satellite evapotranspiration.” J. Hydrol. 349 (3–4): 411–424. https://doi.org/10.1016/j.jhydrol.2007.11.017.
IPCC (Intergovernmental Panel on Climate Change). 2013. “Climate change 2013: The physical science basis.” In Proc., Contribution of Working Group I to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change, edited by T. F. Stocker, D. Qin, G.-K. Plattner, M. Tignor, S. K. Allen, J. Boschung, A. Nauels, Y. Xia, V. Bex, and P. M. Midgley. Cambridge, UK: Cambridge University Press.
Jehanzaib, M., S. A. Shah, J. Yoo, and T.-W. Kim. 2020. “Investigating the impacts of climate change and human activities on hydrological drought using non-stationary approaches.” J. Hydrol. 588 (Sep): 125052. https://doi.org/10.1016/j.jhydrol.2020.125052.
Kay, A., H. Davies, V. Bell, and R. Jones. 2009. “Comparison of uncertainty sources for climate change impacts: Flood frequency in England.” Clim. Change 92 (1–2): 41–63. https://doi.org/10.1007/s10584-008-9471-4.
Kirchner, J. W. 2006. “Getting the right answers for the right reasons: Linking measurements, analyses, and models to advance the science of hydrology.” Water Resour. Res. 42 (3): 1–5. https://doi.org/10.1029/2005WR004362.
Klemeš, V. 1986. “Operational testing of hydrological simulation models.” Hydrol. Sci. J. 31 (1): 13–24. https://doi.org/10.1080/02626668609491024.
Krysanova, V., C. Donnelly, A. Gelfan, D. Gerten, B. Arheimer, F. Hattermann, and Z. W. Kundzewicz. 2018. “How the performance of hydrological models relates to credibility of projections under climate change.” Hydrol. Sci. J. 63 (5): 696–720. https://doi.org/10.1080/02626667.2018.1446214.
Lehner, F., C. Deser, and L. Terray. 2017. “Toward a new estimate of ‘time of emergence’ of anthropogenic warming: Insights from dynamical adjustment and a large initial-condition model ensemble.” J. Clim. 30 (19): 7739–7756. https://doi.org/10.1175/JCLI-D-16-0792.1.
Li, H., S. Beldring, and C.-Y. Xu. 2015. “Stability of model performance and parameter values on two catchments facing changes in climatic conditions.” Hydrol. Sci. J. 60 (7–8): 1317–1330. https://doi.org/10.1080/02626667.2014.978333.
Lorenz, E. N. 1995. The essence of chaos. Seattle: University of Washington Press.
Manfreda, S., L. Mita, S. F. Dal Sasso, C. Samela, and L. Mancusi. 2018. “Exploiting the use of physical information for the calibration of a lumped hydrological model.” Hydrol. Process. 32 (10): 1420–1433. https://doi.org/10.1002/hyp.11501.
Martel, J.-L., K. Demeester, F. Brissette, A. Poulin, and R. Arsenault. 2017. “HMETS-A simple and efficient hydrology model for teaching hydrological modelling, flow forecasting and climate change impacts.” Int. J. Eng. Educ. 33 (4): 1307–1316.
Martel, J.-L., A. Mailhot, and F. Brissette. 2020. “Global and regional projected changes in 100-yr subdaily, daily, and multiday precipitation extremes estimated from three large ensembles of climate simulations.” J. Clim. 33 (3): 1089–1103. https://doi.org/10.1175/JCLI-D-18-0764.1.
Martel, J.-L., A. Mailhot, F. Brissette, and D. Caya. 2018. “Role of natural climate variability in the detection of anthropogenic climate change signal for mean and extreme precipitation at local and regional scales.” J. Clim. 31 (11): 4241–4263. https://doi.org/10.1175/JCLI-D-17-0282.1.
Mayewski, P. A., et al. 2004. “Holocene climate variability.” Quat. Res. 62 (3): 243–255. https://doi.org/10.1016/j.yqres.2004.07.001.
Mendoza, P. A., M. P. Clark, N. Mizukami, A. J. Newman, M. Barlage, E. D. Gutmann, R. M. Rasmussen, B. Rajagopalan, and J. R. Arnold. 2015. “Effects of hydrologic model choice and calibration on the portrayal of climate change impacts.” J. Hydrometeorol. 16 (2): 762–780. https://doi.org/10.1175/JHM-D-14-0104.1.
Merz, R., J. Parajka, and G. Blöschl. 2011. “Time stability of catchment model parameters: Implications for climate impact analyses.” Water Resour. Res. 47 (2): 1–17. https://doi.org/10.1029/2010WR009505.
Motavita, D., R. Chow, A. Guthke, and W. Nowak. 2019. “The comprehensive differential split-sample test: A stress-test for hydrological model robustness under climate variability.” J. Hydrol. 573 (Jun): 501–515. https://doi.org/10.1016/j.jhydrol.2019.03.054.
Najafi, M., H. Moradkhani, and I. Jung. 2011. “Assessing the uncertainties of hydrologic model selection in climate change impact studies.” Hydrol. Process. 25 (18): 2814–2826. https://doi.org/10.1002/hyp.8043.
Oudin, L., V. Andréassian, C. Perrin, C. Michel, and N. Le Moine. 2008. “Spatial proximity, physical similarity, regression and ungaged catchments: A comparison of regionalization approaches based on 913 French catchments.” Water Resour. Res. 44 (3): 1–15. https://doi.org/10.1029/2007WR006240.
Oudin, L., F. Hervieu, C. Michel, C. Perrin, V. Andréassian, F. Anctil, and C. Loumagne. 2005. “Which potential evapotranspiration input for a lumped rainfall–runoff model? Part 2—Towards a simple and efficient potential evapotranspiration model for rainfall–runoff modelling.” J. Hydrol. 303 (1–4): 290–306. https://doi.org/10.1016/j.jhydrol.2004.08.026.
Pachauri, R. K., et al. 2014. Climate change 2014: Synthesis report. Contribution of working groups I, II and III to the fifth assessment report of the Intergovernmental Panel on Climate Change. Geneva: Intergovernmental Panel on Climate Change.
Pendergrass, A. G., R. Knutti, F. Lehner, C. Deser, and B. M. Sanderson. 2017. “Precipitation variability increases in a warmer climate.” Sci. Rep. 7 (1): 1–9. https://doi.org/10.1038/s41598-017-17966-y.
Perrin, C., C. Michel, and V. Andréassian. 2003. “Improvement of a parsimonious model for streamflow simulation.” J. Hydrol. 279 (1–4): 275–289. https://doi.org/10.1016/S0022-1694(03)00225-7.
Poulin, A., F. Brissette, R. Leconte, R. Arsenault, and J.-S. Malo. 2011. “Uncertainty of hydrological modelling in climate change impact studies in a Canadian, snow-dominated river basin.” J. Hydrol. 409 (3–4): 626–636. https://doi.org/10.1016/j.jhydrol.2011.08.057.
Prudhomme, C., and H. Davies. 2009. “Assessing uncertainties in climate change impact analyses on the river flow regimes in the UK. Part 1: Baseline climate.” Clim. Change 93 (1–2): 177–195. https://doi.org/10.1007/s10584-008-9464-3.
Razavi, S., and B. A. Tolson. 2013. “An efficient framework for hydrologic model calibration on long data periods.” Water Resour. Res. 49 (12): 8418–8431. https://doi.org/10.1002/2012WR013442.
Ruiz-Pérez, G., M. González-Sanchis, A. D. Del Campo, and F. Francés. 2016. “Can a parsimonious model implemented with satellite data be used for modelling the vegetation dynamics and water cycle in water-controlled environments?” Ecol. Modell. 324 (Mar): 45–53. https://doi.org/10.1016/j.ecolmodel.2016.01.002.
Ruiz-Pérez, G., J. Koch, S. Manfreda, K. Caylor, and F. Francés. 2017. “Calibration of a parsimonious distributed ecohydrological daily model in a data-scarce basin by exclusively using the spatio-temporal variation of NDVI.” Hydrol. Earth Syst. Sci. 21 (12): 6235–6251. https://doi.org/10.5194/hess-21-6235-2017.
Seiller, G., I. Hajji, and F. Anctil. 2015. “Improving the temporal transposability of lumped hydrological models on twenty diversified US watersheds.” J. Hydrol.: Reg. Stud. 3 (Mar): 379–399.
Tarek, M., F. P. Brissette, and R. Arsenault. 2020. “Evaluation of the ERA5 reanalysis as a potential reference dataset for hydrological modeling over North-America.” Hydrol. Earth Syst. Sci. 24 (5): 2527–2544. https://doi.org/10.5194/hess-24-2527-2020.
Thirel, G., V. Andréassian, and C. Perrin. 2015. On the need to test hydrological models under changing conditions. London: Taylor & Francis.
Valéry, A. 2010. “Modélisation précipitations débit sous influence nivale: Elaboration d’un module neige et évaluation sur 380 bassins versants.” [In French.] Doctorat Hydrobiologie, Institut des Sciences et Industries du Vivant et de l’Environnement AgroParisTech.
Valéry, A., V. Andréassian, and C. Perrin. 2014a. “‘As simple as possible but not simpler’: What is useful in a temperature-based snow-accounting routine? Part 1–Comparison of six snow accounting routines on 380 catchments.” J. Hydrol. 517 (Sep): 1166–1175. https://doi.org/10.1016/j.jhydrol.2014.04.059.
Valéry, A., V. Andréassian, and C. Perrin. 2014b. “‘As simple as possible but not simpler’: What is useful in a temperature-based snow-accounting routine? Part 2–Sensitivity analysis of the Cemaneige snow accounting routine on 380 catchments.” J. Hydrol. 517 (Sep): 1176–1187. https://doi.org/10.1016/j.jhydrol.2014.04.058.
Vansteenkiste, T., M. Tavakoli, V. Ntegeka, F. De Smedt, O. Batelaan, F. Pereira, and P. Willems. 2014. “Intercomparison of hydrological model structures and calibration approaches in climate scenario impact projections.” J. Hydrol. 519 (Part A): 743–755. https://doi.org/10.1016/j.jhydrol.2014.07.062.
Vaze, J., D. Post, F. Chiew, J.-M. Perraud, N. Viney, and J. Teng. 2010. “Climate non-stationarity–validity of calibrated rainfall–runoff models for use in climate change studies.” J. Hydrol. 394 (3–4): 447–457. https://doi.org/10.1016/j.jhydrol.2010.09.018.
Vogel, C., and K. O’Brien. 2017. Coping with climate variability. London: Routledge.
Wanders, N., M. F. Bierkens, S. M. de Jong, A. de Roo, and D. Karssenberg. 2014. “The benefits of using remotely sensed soil moisture in parameter identification of large-scale hydrological models.” Water Resour. Res. 50 (8): 6874–6891. https://doi.org/10.1002/2013WR014639.
Zhao, C., F. Brissette, J. Chen, and J.-L. Martel. 2020. “Frequency change of future extreme summer meteorological and hydrological droughts over North America.” J. Hydrol. 584 (May): 124316. https://doi.org/10.1016/j.jhydrol.2019.124316.
Information & Authors
Information
Published In
Journal of Hydrologic Engineering
Volume 27 • Issue 3 • March 2022
Copyright
© 2021 American Society of Civil Engineers.
History
Received: Mar 3, 2021
Accepted: Sep 7, 2021
Published online: Dec 28, 2021
Published in print: Mar 1, 2022
Discussion open until: May 28, 2022
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited by
- Gianmarco Di Giustino, Alberto Bonora, Katia Federico, Matelda Reho, Giulia Lucertini, Spatial Analysis of the Vulnerability to Flooding in the Rural Context: The Case of the Emilia Romagna Region, Atmosphere, 10.3390/atmos13081181, 13, 8, (1181), (2022).
- Hongren Shen, Bryan A. Tolson, Juliane Mai, Time to Update the Split‐Sample Approach in Hydrological Model Calibration, Water Resources Research, 10.1029/2021WR031523, 58, 3, (2022).