Using Functional Data Analysis to Calibrate and Evaluate Hydrological Model Performance
Publication: Journal of Hydrologic Engineering
Volume 23, Issue 7
Abstract
The performance of a hydrological model depends strongly on the calibration procedure, and in particular on the goodness-of-fit measure used. It is widely recognized that traditional goodness-of-fit measures such as the Nash-Sutcliffe efficiency (NSE) are biased toward securing a particular aspect of a hydrograph (high flows, in the case of the NSE). This paper proposes a new strategy for model calibration that evaluates the ability of the model to simulate the complete shape, timing, and variability of the observed hydrographs. The methodology is based on the comparison of the simulated and observed whole annual hydrograph as a single curve using the functional data analysis (FDA) framework. FDA is a recent statistical framework that considers observations as curves or functions. The hydrograph is a particular example of such functions. The proposed approach is applied to calibrate the CEQUEAU model on the Lac St-Jean drainage basin (Quebec, Canada) and is compared with a traditional approach using NSE. Both calibrations yield to similar results for high flows, with NSE of 0.89 during calibration and 0.94 during the validation period. The results show an improvement for winter low-flow bias by 10% over the traditional calibration using NSE. Moreover, the application of the functional Student’s test suggests that winter flows simulated by the model calibrated with NSE are significantly different, whereas flows simulated by the model calibrated with the proposed approach are accurate for almost all periods of the year.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
Funding from NSERC and Rio Tinto for this project is acknowledged. The authors are also thankful for the technical assistance provided by the hydrological forecast team at Rio Tinto.
References
Arsenault, R., M. Latraverse, and T. Duschesne. 2016. “An efficient method to correct under-dispersion in ensemble streamflow prediction for seasonal volumetric forecasting.” Water Resour. Manage. 30 (12): 4363–4380. https://doi.org/10.1007/s11269-016-1425-4.
Asadzadeh, M., B. Tolson, and D. H. Burn. 2014. “A new selection metric for multiobjective hydrologic model calibration.” Water Resour. Res. 50 (9): 7082–7099. https://doi.org/10.1002/2013WR014970.
Bardossy, A., and S. Singh. 2008. “Robust estimation of hydrological model parameters.” Hydro. Earth Syst. Sci. 12 (6): 1273–1283. https://doi.org/10.5194/hess-12-1273-2008.
Casper, M., G. Grigoryan, O. Gronz, G. Heinemann, R. Ley, and A. Rock. 2012. “Analysis of projected hydrological behavior of catchments based on signature indices.” Hydrol. Earth Syst. Sci. 16 (2): 409–421. https://doi.org/10.5194/hess-16-409-2012.
Charbonneau, R., J-P. Fortin, and G. Morin. 1977. “The CEQUAU model: Description and examples of its use in problems related to water resource management [Le modèle CEQUEAU: description et exemples d’utilisation dans le cadre de problèmes reliés à l’aménagement].” Hydrol. Sci. Bull. 22 (1): 193–202. https://doi.org/10.1080/02626667709491704.
Chebana, F., S. Dabo-Niang, and T. Ouarda. 2012. “Exploratory functional flood frequency analysis and outlier detection.” Water Resour. Res. 48 (4): W04514. https://doi.org/10.1029/2011WR011040.
Clausen, B., and B. Biggs. 2000. “Flow variables for ecological studies in temperate streams: Groupings based on covariance.” J. Hydrol. 237 (3–4): 184–197. https://doi.org/10.1016/S0022-1694(00)00306-1.
Euser, T., H. C. Winsemius, M. Hrachowitz, F. Fenicia, S. Uhlenbrook, and H. H. G. Savenije. 2013. “A framework to assess the realism of model structures using hydrological signatures.” Hydrol. Earth Syst. Sci. 17 (5): 1893–1912. https://doi.org/10.5194/hess-17-1893-2013.
Fenicia, F., H. H. G. Savenije, P. Matgen, and L. Pfister. 2007. “A comparison of alternative multiobjective calibration strategies for hydrological modelling.” Water Resour. Res. 43: W03434. https://doi.org/10.1029/2006WR005098.
Glover, F. 1990. “Tabu search: A tutorial.” Interfaces 20 (4): 74–94. https://doi.org/10.1287/inte.20.4.74.
Glover, F., and M. Laguna. 1997. Tabu search. Dordrecht, Netherlands: Kluwer Academic.
Gunkel, A., S. Shadeed, A. Hartmann, T. Wagener, and J. Lange. 2015. “Model signatures and aridity indices enhance the accuracy of water balance estimations in a data-scarce Eastern Mediterranean catchment.” J. Hydrol. 4: 487–501. https://doi.org/10.1016/j.ejrh.2015.08.002.
Gupta, H., H. Kling, K. Yilmaz, and G. F. Martinez. 2009. “Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling.” J. Hydrol. 377 (1–2), 80–91. https://doi.org/10.1016/j.jhydrol.2009.08.003.
Gupta, H., T. Wagener, and Y. Liu. 2008. “Reconciling theory with observations: Elements of a diagnostic approach to model evaluation.” Hydrol. Processes 22 (18): 3802–3813. https://doi.org/10.1002/hyp.6989.
Gupta, V. H., S. Sorooshian, and P. O. Yapo. 1998. “Toward improved calibration of hydrologic models: Multiple and noncommensurable measures of information.” Water Ressour. Res. 34 (4): 751–763. https://doi.org/10.1029/97WR03495.
Hartmann, A., T. Wagener, A. Rimmer, J. Lange, H. Brielmann, and M. Weiler. 2013. “Testing the realism of model structures to identify karst system processes using water quality and quantity signatures.” Water Resour. Res. 49 (6): 3345–3358. https://doi.org/10.1002/wrcr.20229.
Hingray, B., B. Schaefli, A. Mezghani, and Y. Hamdi. 2010. “Signature-based model calibration for hydrological prediction in mesoscale Alpine catchments.” Hydrol. Sci. J. 55 (6): 1002–1016. https://doi.org/10.1080/02626667.2010.505572.
Krause, P., D. Boyle, and F. Bäse. 2005. “Comparison of different efficiency criteria for hydrological assessment.” Adv. Geosci. 5: 89–97. https://doi.org/10.5194/adgeo-5-89-2005.
Levitin, D., R. Nuzzo, B. Vines, and J. Ramsay. 2007. “Introduction to functional data analysis.” Can. Psychol. 48 (3): 135–155. https://doi.org/10.1037/cp2007014.
Morin, G., and P. Paquet. 2007. Modèle hydrologique CEQUEAU., 458. Québec, Canada: INRS, Centre Eau Terre Environement.
Nash, J., and J. Sutcliffe. 1970. “River flow forecasting through conceptual models part I—A discussion of principles.” J. Hydrol. 10 (3): 282–290. https://doi.org/10.1016/0022-1694(70)90255-6.
Pechlivanidis, I. G., B. Jackson, H. McMillan, and H. Gupta. 2012. “Using an informational entropy-based metric as a diagnostic of flow duration to drive model parameter identification.” Global Nest J. 14 (3): 325–334.
Pechlivanidis, I. G., B. Jackson, H. McMillan, and H. Gupta. 2014. “Use of an entropy-based metric in multiobjetive calibration to improve model performance.” Water Resour. Res. 50 (10): 8066–8083. https://doi.org/10.1002/2013WR014537.
Pechlivanidis, I. G., B. M. Jackson, N. R. Mcintyre, and H. S. Wheater. 2011. “Catchment scale hydrological modelling: A review of model types, calibration approaches and uncertainty analysis methods in the context of recent developments in technology and applications.” Global Nest J. 13 (3): 193–214.
Ramsay, J., and J. Ramsey. 2002. “Functional data analysis of the dynamics of the monthly index of nondurable goods production.” J. Econometrics 107 (1–2): 327–344. https://doi.org/10.1016/S0304-4076(01)00127-0.
Ramsay, J. O., and B. W. Silverman. 2002. Applied functional data analysis: Methods and case studies. New York: Springer.
Ramsay, J. O., and B. W. Silverman. 2005. Applied functional data analysis: Methods and case studies. 2nd ed. New York: Springer.
Ramsay, J. O., and B. W. Silverman. 2006. Functional data analysis. 2nd ed. New York: Springer.
Sawicz, K., T. Wagener, M. Sivapalan, P. A. Troch, and G. Carillo. 2011. “Catchment classification: Empirical analysis of hydrologic similarity based on catchment function in the eastern USA.” Hydrol. Earth Syst. Sci. 15 (9): 2895–2911. https://doi.org/10.5194/hess-15-2895-2011.
Schaefli, B., and H. V. Gupta. 2007. “Do Nash values have value?” Hydrol. Processes 21 (15): 2075–2080. https://doi.org/10.1002/hyp.6825.
Schaefli, B., and E. Zehe. 2009. “Hydrological model performance and parameter estimation in the wavelet-domain.” Hydrol. Earth Syst. Sci. 13 (10): 1921–1936. https://doi.org/10.5194/hess-13-1921-2009.
Sguera, C., P. Galeano, and R. Lillo. 2016. “Functional outlier detection by a local depth with application to levels.” Stoch. Environ. Res. Risk. Assess. 30 (4): 1115–1130. https://doi.org/10.1007/s00477-015-1096-3.
Shafii, M., and B. Tolson. 2015. “Optimizing hydrological consistency by incorporating hydrological signatures into model calibration objectives.” Water Resour. Res. 51 (5): 3796–3814. https://doi.org/10.1002/2014WR016520.
St-Hilaire, A., M-A. Boucher, F. Chebana, S. Ouellet-Proulx, Q-X. Zhou, S. Larabi, and S. Dugdale. 2015. “Breathing a new life to an older model: The CEQUEAU tool for flow and water temperature simulations and forecasting.” In Proc., 22nd Canadian Hydrotechnical Conf., Montreal, QC, Canada.
St-Hilaire, A., G. Morin, N. El-Jabi, and D. Caissie. 2000. “Water temperature modelling in a small forested stream: Implication of forest canopy and soil temperature.” Can. J. Civ. Eng. 27 (6): 1095–1108. https://doi.org/10.1139/l00-021.
Ternynck, C., M. L. Ben Alaya, F. Chebana, S. Dabo-Niang, and T. B. M. J. Ouarda. 2016. “Streamflow hydrograph classification using functional data analysis.” J. Hydrometeorol. 17 (1): 327–344. https://doi.org/10.1175/JHM-D-14-0200.1.
Tukey, J. W. 1975. “Mathematics and picturing data.” In Vol. 2 of Proc., Int. Congress of Mathematics, edited by James, R. D. Vancouver, BC, Canada: Canadian Mathematical Congress.
Vrugt, J. A., H. V. Gupta, L. A. Bastidas, W. Bouten, and S. Sorooshian. 2003. “Effective and efficient algorithm for multiobjective optimization of hydrologic models.” Water Resour. Res. 39 (8): 1214. https://doi.org/10.1029/2002WR001746.
Vrugt, J. A., and B. A. Robinson. 2007. “Improved evolutionary optimization from genetically adaptive multimethod search.” Proc. Natl. Acad. Sci. USA, 3 (104), 708–711.
Wagner, T., H. Wheater, and H. Gupta. 2004. Rainfall-runoff modelling in gauged and ungauged catchements. London: Imperial College Press.
Westerberg, I., and H. McMillan. 2015. “Uncertainty in hydrological signatures.” Hydol. Earth Syst. Sci. 19 (9): 3951–3968. https://doi.org/10.5194/hess-19-3951-2015.
Yapo, P. O., H. V. Gupta, and S. Sorooshian. 1998. “Multi-objective global optimization for hydrologic models.” J. Hydrol. 204 (1–4): 83–97. https://doi.org/10.1016/S0022-1694(97)00107-8.
Yilmaz, K., H. V. Gupta, and T. Wagener. 2008. “A process-based diagnostic approach to model evaluation: Application to the NWS distributed hydrologic model.” Water Resour. Res. 44 (9): W09417. https://doi.org/10.1029/2007WR006716.
Information & Authors
Information
Published In
Copyright
©2018 American Society of Civil Engineers.
History
Received: Apr 4, 2017
Accepted: Dec 29, 2017
Published online: Apr 28, 2018
Published in print: Jul 1, 2018
Discussion open until: Sep 28, 2018
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.