Technical Papers
Apr 28, 2018

Using Functional Data Analysis to Calibrate and Evaluate Hydrological Model Performance

Publication: Journal of Hydrologic Engineering
Volume 23, Issue 7

Abstract

The performance of a hydrological model depends strongly on the calibration procedure, and in particular on the goodness-of-fit measure used. It is widely recognized that traditional goodness-of-fit measures such as the Nash-Sutcliffe efficiency (NSE) are biased toward securing a particular aspect of a hydrograph (high flows, in the case of the NSE). This paper proposes a new strategy for model calibration that evaluates the ability of the model to simulate the complete shape, timing, and variability of the observed hydrographs. The methodology is based on the comparison of the simulated and observed whole annual hydrograph as a single curve using the functional data analysis (FDA) framework. FDA is a recent statistical framework that considers observations as curves or functions. The hydrograph is a particular example of such functions. The proposed approach is applied to calibrate the CEQUEAU model on the Lac St-Jean drainage basin (Quebec, Canada) and is compared with a traditional approach using NSE. Both calibrations yield to similar results for high flows, with NSE of 0.89 during calibration and 0.94 during the validation period. The results show an improvement for winter low-flow bias by 10% over the traditional calibration using NSE. Moreover, the application of the functional Student’s test suggests that winter flows simulated by the model calibrated with NSE are significantly different, whereas flows simulated by the model calibrated with the proposed approach are accurate for almost all periods of the year.

Get full access to this article

View all available purchase options and get full access to this article.

Acknowledgments

Funding from NSERC and Rio Tinto for this project is acknowledged. The authors are also thankful for the technical assistance provided by the hydrological forecast team at Rio Tinto.

References

Arsenault, R., M. Latraverse, and T. Duschesne. 2016. “An efficient method to correct under-dispersion in ensemble streamflow prediction for seasonal volumetric forecasting.” Water Resour. Manage. 30 (12): 4363–4380. https://doi.org/10.1007/s11269-016-1425-4.
Asadzadeh, M., B. Tolson, and D. H. Burn. 2014. “A new selection metric for multiobjective hydrologic model calibration.” Water Resour. Res. 50 (9): 7082–7099. https://doi.org/10.1002/2013WR014970.
Bardossy, A., and S. Singh. 2008. “Robust estimation of hydrological model parameters.” Hydro. Earth Syst. Sci. 12 (6): 1273–1283. https://doi.org/10.5194/hess-12-1273-2008.
Casper, M., G. Grigoryan, O. Gronz, G. Heinemann, R. Ley, and A. Rock. 2012. “Analysis of projected hydrological behavior of catchments based on signature indices.” Hydrol. Earth Syst. Sci. 16 (2): 409–421. https://doi.org/10.5194/hess-16-409-2012.
Charbonneau, R., J-P. Fortin, and G. Morin. 1977. “The CEQUAU model: Description and examples of its use in problems related to water resource management [Le modèle CEQUEAU: description et exemples d’utilisation dans le cadre de problèmes reliés à l’aménagement].” Hydrol. Sci. Bull. 22 (1): 193–202. https://doi.org/10.1080/02626667709491704.
Chebana, F., S. Dabo-Niang, and T. Ouarda. 2012. “Exploratory functional flood frequency analysis and outlier detection.” Water Resour. Res. 48 (4): W04514. https://doi.org/10.1029/2011WR011040.
Clausen, B., and B. Biggs. 2000. “Flow variables for ecological studies in temperate streams: Groupings based on covariance.” J. Hydrol. 237 (3–4): 184–197. https://doi.org/10.1016/S0022-1694(00)00306-1.
Euser, T., H. C. Winsemius, M. Hrachowitz, F. Fenicia, S. Uhlenbrook, and H. H. G. Savenije. 2013. “A framework to assess the realism of model structures using hydrological signatures.” Hydrol. Earth Syst. Sci. 17 (5): 1893–1912. https://doi.org/10.5194/hess-17-1893-2013.
Fenicia, F., H. H. G. Savenije, P. Matgen, and L. Pfister. 2007. “A comparison of alternative multiobjective calibration strategies for hydrological modelling.” Water Resour. Res. 43: W03434. https://doi.org/10.1029/2006WR005098.
Glover, F. 1990. “Tabu search: A tutorial.” Interfaces 20 (4): 74–94. https://doi.org/10.1287/inte.20.4.74.
Glover, F., and M. Laguna. 1997. Tabu search. Dordrecht, Netherlands: Kluwer Academic.
Gunkel, A., S. Shadeed, A. Hartmann, T. Wagener, and J. Lange. 2015. “Model signatures and aridity indices enhance the accuracy of water balance estimations in a data-scarce Eastern Mediterranean catchment.” J. Hydrol. 4: 487–501. https://doi.org/10.1016/j.ejrh.2015.08.002.
Gupta, H., H. Kling, K. Yilmaz, and G. F. Martinez. 2009. “Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling.” J. Hydrol. 377 (1–2), 80–91. https://doi.org/10.1016/j.jhydrol.2009.08.003.
Gupta, H., T. Wagener, and Y. Liu. 2008. “Reconciling theory with observations: Elements of a diagnostic approach to model evaluation.” Hydrol. Processes 22 (18): 3802–3813. https://doi.org/10.1002/hyp.6989.
Gupta, V. H., S. Sorooshian, and P. O. Yapo. 1998. “Toward improved calibration of hydrologic models: Multiple and noncommensurable measures of information.” Water Ressour. Res. 34 (4): 751–763. https://doi.org/10.1029/97WR03495.
Hartmann, A., T. Wagener, A. Rimmer, J. Lange, H. Brielmann, and M. Weiler. 2013. “Testing the realism of model structures to identify karst system processes using water quality and quantity signatures.” Water Resour. Res. 49 (6): 3345–3358. https://doi.org/10.1002/wrcr.20229.
Hingray, B., B. Schaefli, A. Mezghani, and Y. Hamdi. 2010. “Signature-based model calibration for hydrological prediction in mesoscale Alpine catchments.” Hydrol. Sci. J. 55 (6): 1002–1016. https://doi.org/10.1080/02626667.2010.505572.
Krause, P., D. Boyle, and F. Bäse. 2005. “Comparison of different efficiency criteria for hydrological assessment.” Adv. Geosci. 5: 89–97. https://doi.org/10.5194/adgeo-5-89-2005.
Levitin, D., R. Nuzzo, B. Vines, and J. Ramsay. 2007. “Introduction to functional data analysis.” Can. Psychol. 48 (3): 135–155. https://doi.org/10.1037/cp2007014.
Morin, G., and P. Paquet. 2007. Modèle hydrologique CEQUEAU., 458. Québec, Canada: INRS, Centre Eau Terre Environement.
Nash, J., and J. Sutcliffe. 1970. “River flow forecasting through conceptual models part I—A discussion of principles.” J. Hydrol. 10 (3): 282–290. https://doi.org/10.1016/0022-1694(70)90255-6.
Pechlivanidis, I. G., B. Jackson, H. McMillan, and H. Gupta. 2012. “Using an informational entropy-based metric as a diagnostic of flow duration to drive model parameter identification.” Global Nest J. 14 (3): 325–334.
Pechlivanidis, I. G., B. Jackson, H. McMillan, and H. Gupta. 2014. “Use of an entropy-based metric in multiobjetive calibration to improve model performance.” Water Resour. Res. 50 (10): 8066–8083. https://doi.org/10.1002/2013WR014537.
Pechlivanidis, I. G., B. M. Jackson, N. R. Mcintyre, and H. S. Wheater. 2011. “Catchment scale hydrological modelling: A review of model types, calibration approaches and uncertainty analysis methods in the context of recent developments in technology and applications.” Global Nest J. 13 (3): 193–214.
Ramsay, J., and J. Ramsey. 2002. “Functional data analysis of the dynamics of the monthly index of nondurable goods production.” J. Econometrics 107 (1–2): 327–344. https://doi.org/10.1016/S0304-4076(01)00127-0.
Ramsay, J. O., and B. W. Silverman. 2002. Applied functional data analysis: Methods and case studies. New York: Springer.
Ramsay, J. O., and B. W. Silverman. 2005. Applied functional data analysis: Methods and case studies. 2nd ed. New York: Springer.
Ramsay, J. O., and B. W. Silverman. 2006. Functional data analysis. 2nd ed. New York: Springer.
Sawicz, K., T. Wagener, M. Sivapalan, P. A. Troch, and G. Carillo. 2011. “Catchment classification: Empirical analysis of hydrologic similarity based on catchment function in the eastern USA.” Hydrol. Earth Syst. Sci. 15 (9): 2895–2911. https://doi.org/10.5194/hess-15-2895-2011.
Schaefli, B., and H. V. Gupta. 2007. “Do Nash values have value?” Hydrol. Processes 21 (15): 2075–2080. https://doi.org/10.1002/hyp.6825.
Schaefli, B., and E. Zehe. 2009. “Hydrological model performance and parameter estimation in the wavelet-domain.” Hydrol. Earth Syst. Sci. 13 (10): 1921–1936. https://doi.org/10.5194/hess-13-1921-2009.
Sguera, C., P. Galeano, and R. Lillo. 2016. “Functional outlier detection by a local depth with application to NOx levels.” Stoch. Environ. Res. Risk. Assess. 30 (4): 1115–1130. https://doi.org/10.1007/s00477-015-1096-3.
Shafii, M., and B. Tolson. 2015. “Optimizing hydrological consistency by incorporating hydrological signatures into model calibration objectives.” Water Resour. Res. 51 (5): 3796–3814. https://doi.org/10.1002/2014WR016520.
St-Hilaire, A., M-A. Boucher, F. Chebana, S. Ouellet-Proulx, Q-X. Zhou, S. Larabi, and S. Dugdale. 2015. “Breathing a new life to an older model: The CEQUEAU tool for flow and water temperature simulations and forecasting.” In Proc., 22nd Canadian Hydrotechnical Conf., Montreal, QC, Canada.
St-Hilaire, A., G. Morin, N. El-Jabi, and D. Caissie. 2000. “Water temperature modelling in a small forested stream: Implication of forest canopy and soil temperature.” Can. J. Civ. Eng. 27 (6): 1095–1108. https://doi.org/10.1139/l00-021.
Ternynck, C., M. L. Ben Alaya, F. Chebana, S. Dabo-Niang, and T. B. M. J. Ouarda. 2016. “Streamflow hydrograph classification using functional data analysis.” J. Hydrometeorol. 17 (1): 327–344. https://doi.org/10.1175/JHM-D-14-0200.1.
Tukey, J. W. 1975. “Mathematics and picturing data.” In Vol. 2 of Proc., Int. Congress of Mathematics, edited by James, R. D. Vancouver, BC, Canada: Canadian Mathematical Congress.
Vrugt, J. A., H. V. Gupta, L. A. Bastidas, W. Bouten, and S. Sorooshian. 2003. “Effective and efficient algorithm for multiobjective optimization of hydrologic models.” Water Resour. Res. 39 (8): 1214. https://doi.org/10.1029/2002WR001746.
Vrugt, J. A., and B. A. Robinson. 2007. “Improved evolutionary optimization from genetically adaptive multimethod search.” Proc. Natl. Acad. Sci. USA, 3 (104), 708–711.
Wagner, T., H. Wheater, and H. Gupta. 2004. Rainfall-runoff modelling in gauged and ungauged catchements. London: Imperial College Press.
Westerberg, I., and H. McMillan. 2015. “Uncertainty in hydrological signatures.” Hydol. Earth Syst. Sci. 19 (9): 3951–3968. https://doi.org/10.5194/hess-19-3951-2015.
Yapo, P. O., H. V. Gupta, and S. Sorooshian. 1998. “Multi-objective global optimization for hydrologic models.” J. Hydrol. 204 (1–4): 83–97. https://doi.org/10.1016/S0022-1694(97)00107-8.
Yilmaz, K., H. V. Gupta, and T. Wagener. 2008. “A process-based diagnostic approach to model evaluation: Application to the NWS distributed hydrologic model.” Water Resour. Res. 44 (9): W09417. https://doi.org/10.1029/2007WR006716.

Information & Authors

Information

Published In

Go to Journal of Hydrologic Engineering
Journal of Hydrologic Engineering
Volume 23Issue 7July 2018

History

Received: Apr 4, 2017
Accepted: Dec 29, 2017
Published online: Apr 28, 2018
Published in print: Jul 1, 2018
Discussion open until: Sep 28, 2018

Permissions

Request permissions for this article.

Authors

Affiliations

Samah Larabi [email protected]
Ph.D. Student, Institut National de la recherche scientifique, Centre Eau-Terre-Environnement, 490 rue de la couronne, Québec, QC, Canada G1K 1A9 (corresponding author). Email: [email protected]; [email protected]
André St-Hilaire [email protected]
Professor, Institut National de la recherche scientifique Centre Eau-Terre-Environnement, 490 rue de la couronne, Québec, QC, Canada G1K 1A9. Email: [email protected]
Fateh Chebana [email protected]
Professor, Institut National de la recherche scientifique, Centre Eau-Terre-Environnement, 490 rue de la couronne, Québec, QC, Canada G1K 1A9. Email: [email protected]
Marco Latraverse [email protected]
Operations Research Analyst, Rio Tinto, 1954 rue Davis, Jonquière, Québec, QC, Canada G7S 4R5. Email: [email protected]

Metrics & Citations

Metrics

Citations

Download citation

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

Cited by

View Options

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share