Validation of an ANN Flow Prediction Model Using a Multistation Cluster Analysis
Publication: Journal of Hydrologic Engineering
Volume 17, Issue 2
Abstract
The objective of this study is to validate a flow prediction model for a hydrometric station using a multistation criterion in addition to standard single-station performance criteria. In this contribution we used cluster analysis to identify the regional flow height, i.e., water-level patterns and validate the output of an artificial neural network (ANN) model of the Alportel River in Portugal. Measurements of precipitation, temperature, and flow height were used as input variables to the ANN model with a lead time of 12 h. The lead time of 12 h is assumed to be appropriate for a short-term hydrological prediction since it is meaningful for physical processes. The ANN model with three inputs, four hidden neurons, and ten epochs was tested using the new model-validation criterion. The high performance of the model (i.e., Nash-Sutcliffe coefficient is equal to 0.922) was confirmed by the cluster-analysis criterion. It can be concluded that a multistation-based approach can be used as an additional validation criterion and might result in a rejection of a model which initially passed a single-station validation criterion.
Get full access to this article
View all available purchase options and get full access to this article.
References
Anctil, F., and Lauzon, N. (2004). “Generalisation for neural networks through data sampling and training procedures, with applications to streamflow predictions.” Hydrol. Earth Syst. Sci., 8(5), 940–958.
Anctil, F., Perrin, C., and Andréassian, V. (2004). “Impact of the length of observed records on the performance of ANN and of conceptual parsimonious rainfall-runoff forecasting models.” Environ. Modell. Software, 19(4), 357–368.
Anctil, F., and Rat, A. (2005). “Evaluation of neural network streamflow forecasting on 47 watersheds.” J. Hydrol. Eng., 10(1), 85–88.
ASCE. (1993). “Criteria for evaluation of watershed models.” J. Irrig. Drain. Eng., 119(3), 429–442.
Bartlett, M. S. (1946). “On the theoretical specification and sampling properties of autocorrelated time-series.” Suppl. J. Roy. Statist. Soc., 8(1), 27–41.
Bathurst, J. C., Ewen, J., Parkin, G., O’Connell, P. E., and Cooper, J. D. (2004). “Validation of catchment models for predicting land-use and climate change impacts. 3. Blind validation for internal and outlet responses.” J. Hydrol., 287(1–4), 74–94.
Beven, K. J. (2004). Rainfall-runoff modelling: The primer, Wiley, New York.
Booij, M. J. (2005). “Impact of climate change on river flooding assessed with different spatial model resolutions.” J. Hydrol., 303(1–4), 176–198.
Calvoa, I. P., and Portelab, M. M. (2007). “Application of neural approaches to one-step daily flow forecasting in Portuguese watersheds.” J. Hydrol., 332(1–2), 1–15.
Campolo, M., Andreussi, P., and Soldati, A. (1999). “River flood forecasting with a neural network model.” Water Resour. Res., 35(4), 1191–1197.
Campolo, M., Soldati, A., and Andreussi, P. (2003). “Artificial neural network approach to flood forecasting in the River Arno/Une approche à base de réseau de neurones artificiels pour la prévision des crues du fleuve Arno.” Hydrol. Sci. J., 48(3), 381–398.
Chang, F. J., Chiang, Y. M., and Chang, L. C. (2007). “Multi-step-ahead neural networks for flood forecasting/Réseaux de neurones à échéances multiples pour la prévision de crue.” Hydrol. Sci. J., 52(1), 114–130.
Cloke, H. L., and Pappenberger, F. (2009). “Ensemble flood forecasting: A review.” J. Hydrol., 375(3–4), 613–626.
Coffey, M. E., Workman, S. R., Taraba, J. L., and Fogle, A. W. (2004). “Statistical procedures for evaluating daily and monthly hydrologic model predictions.” Trans. ASAE, 47(1), 59–68.
Costa, A. C., Durão, R., Pereira, M. J., and Soares, A. (2008). “Using stochastic space-time models to map extreme precipitation in southern Portugal.” Nat. Hazards Earth Syst. Sci., 8(4), 763–773.
Dawson, C. W., Abrahart, R. J., and See, L. M. (2005). “HydroTest: A web-based toolbox of statistical measures for the standardized assessment of hydrological forecasts.” Environ. Modell. Software., 27(7), 1034–1052.
Demirel, M. C., Kahya, E., and Rivera, D. (2009a). “Discussion of ‘Hydrologic regionalization of watersheds in Turkey’ by Sabahattin Isik and Vijay P. Singh.” J. Hydrol. Eng., 14(7), 767–768.
Demirel, M. C., Venancio, A., and Kahya, E. (2009b). “Flow forecast by SWAT model and ANN in Pracana Basin, Portugal.” Adv. Eng. Software., 40(7), 467–473.
Demuth, H., Beale, M., and Hagan, M. (1992). Neural network toolbox 6” user’s guide, MathWorks, Natick, MA.
Dong, X. (2005). “Appropriate flow forecasting for reservoir operation.” Ph.D. thesis, Univ. of Twente, Enschede, The Netherlands.
Everitt, B. (1993). Cluster analysis, 3rd Ed., Halsted Press, Wiley, New York.
Ewen, J., and Parkin, G. (1996). “Validation of catchment models for predicting land-use and climate change impacts. 1. Method.” J. Hydrol., 175(1–4), 583–594.
Eylon, S., Theresa, M. C., Peter, F., and Konstantine, P. G. (2006). “Evaluation of the National Weather Service operational hydrologic model and forecasts for the American River Basin.” J. Hydrol. Eng., 11(5), 392–407.
Gong, X., and Richman, M. B. (1995). “On the application of cluster analysis to growing season precipitation data in North America east of the Rockies.” J. Clim., 8(4), 897–931.
Güntner, A., Uhlenbrook, S., Seibert, J., and Ch, L. (1999). “Multi-criterial validation of TOPMODEL in a mountainous catchment.” Hydrol. Process., 13(11), 1603–1620.
Haan, C. T., Allred, B., Storm, D. E., Sabbagh, G. J., and Prabhu, S. (1995). “Statistical procedure for evaluating hydrologic/water quality models.” Trans. ASAE, 38(3), 725–733.
Herbst, M., and Casper, M. C. (2008). “Towards model evaluation and identification using self-organizing maps.” Hydrol. Earth Syst. Sci., 12(2), 657–667.
Hsu, K., Gupta, H. V., and Sorooshian, S. (1995). “Artificial neural network modeling of the rainfall-runoff process.” Water Resour. Res., 31(10), 2517–2530.
Kahya, E., Kalayci, S., and Piechota, T. C. (2008). “Streamflow regionalization: Case study of Turkey.” J. Hydrol. Eng., 13(4), 205–214.
Kamp, R. G., and Savenije, H. H. G. (2007). “Hydrological model coupling with ANNs.” Hydrol. Earth Syst. Sci., 11(6), 1869–1881.
Laaha, G., and Blöschl, G. (2006). “A comparison of low flow regionalization methods—catchment grouping.” J. Hydrol., 323(1–4), 193–214.
Legates, D. R., and McCabe, G. J., Jr. (1999). “Evaluating the use of ‘goodness-of-fit’ measures in hydrologic and hydroclimatic model validation.” Water Resour. Res., 35(1), 233–241.
Martinec, J., and Rango, A. (1989). “Merits of statistical criteria for the performance of hydrological models.” Water Resour. Bull., 25(2), 421–432.
McLeod, A. I. (1993). “Parsimony, model adequacy and periodic correlation in time series forecasting.” Int. Statist. Rev./Rev. Int. Statist., 61(3), 387–393.
Modarres, R. (2009). “Multi-criteria validation of artificial neural network rainfall-runoff modeling.” Hydrol. Earth Syst. Sci., 13(3), 411–421.
Moriasi, D. N., Arnold, J. G., Van Liew, M. W., Bingner, R. L., Harmel, R. D., and Veith, T. L. (2007). “Model evaluation guidelines for systematic quantification of accuracy in watershed simulations.” Trans. ASAE, 50(3), 885–900.
Nash, J. E., and Sutcliffe, J. V. (1970). “River flow forecasting through conceptual models part I—A discussion of principles.” J. Hydrol., 10(3), 282–290.
Parkin, G., O’Donnell, G., Ewen, J., Bathurst, J. C., O’Connell, P. E., and Lavabre, J. (1996). “Validation of catchment models for predicting land-use and climate change impacts. 2. Case study for a Mediterranean catchment.” J. Hydrol., 175(1–4), 595–613.
Perrin, C., Michel, C., and Andréassian, V. (2003). “Improvement of a parsimonious model for streamflow simulation.” J. Hydrol., 279(1–4), 275–289.
Refsgaard, J. C. (1997). “Parameterization, calibration and validation of distributed hydrological models.” J. Hydrol., 198(1–4), 69–97.
Rutten, M., van de Giesen, N., Baptist, M., Icke, J., and Uijttewaal, W. (2008). “Seasonal forecast of cooling water problems in the River Rhine.” Hydrol. Processes, 22(7), 1037–1045.
Schaefli, B., and Gupta, H. V. (2007). “Do Nash values have value?” Hydrol. Process., 21(15), 2075–2080.
Schaefli, B., Hingray, B., Niggli, M., and Musy, A. (2005). “A conceptual glacio-hydrological model for high mountainous catchments.” Hydrol. Earth Syst. Sci., 9(1/2), 95–109.
Schaefli, B., and Zehe, E. (2009). “Hydrological model performance and parameter estimation in the wavelet-domain.” Hydrol. Earth Syst. Sci., 13(10), 1921–1936.
Shih-Min, C., Ting-Kuei, T., and Stephan, J. N. (2002). “Hydrologic regionalization of watersheds. II: Applications.” J. Water Resour. Plan. Manage., 128(1), 12–20.
Silverman, D., and Dracup, J. A. (2000). “Artificial neural networks and long-lead precipitation prediction in California.” J. Appl. Meteorol., 39(1), 57–66.
Sistema Nacional de Informação de Recursos Hídricos (SNIRH). (2009). 〈http://www.snirh.pt/〉.
Sivakumar, B., Jayawardena, A. W., and Fernando, T. (2002). “River flow forecasting: Use of phase-space reconstruction and artificial neural networks approaches.” J. Hydrol., 265(1–4), 225–245.
Solomatine, D. P., Maskey, M., and Shrestha, D. L. (2007). “Instance-based learning compared to other data-driven methods in hydrological forecasting.” Hydrol. Processes, 22(2), 275–287.
Srivastava, P., McNair, J. N., and Johnson, T. E. (2006). “Comparison of process-based and artificial neural network approaches for streamflow modelling in an agricultural watershed.” J. Am. Water Resour. Assoc., 42(3), 545–563.
Sudheer, K. P., Gosain, A. K., and Ramasastri, K. S. (2002). “A data driven algorithm for constructing artificial neural network rainfall runoff models.” Hydrol. Process., 16(6), 1325–1330.
Tiwari, M. K., and Chatterjee, C. (2010). “Uncertainty assessment and ensemble flood forecasting using bootstrap based artificial neural networks (BANNs).” J. Hydrol., 382(1–4), 20–33.
Tokar, A. S., and Markus, M. (2000). “Precipitation-runoff modeling using artificial neural networks and conceptual models.” J. Hydrol. Eng., 5(2), 156–161.
Ünal, Y., Kindap, T., and Karaca, M. (2003). “Redefining the climate zones of Turkey using cluster analysis.” Int. J. Climatol., 23(9), 1045–1055.
Van Liew, M. W., Veith, T. L., Bosch, D. D., and Arnold, J. G. (2007). “Suitability of SWAT for the conservation effects assessment project: Comparison on USDA agricultural research service watersheds.” J. Hydrol. Eng., 12(2), 173–189.
Ward, J. H., Jr. (1963). “Hierarchical grouping to optimize an objective function.” J. Am. Stat. Assoc., 58(301), 236–244.
Willmott, C. J. (1981). “On the validation of models.” Phys. Geogr., 2(2), 184–194.
Willmott, C. J. (1982). “Some comments on the evaluation of model performance.” Bull. Am. Meteorol. Soc., 63(11), 1309–1313.
Wu, J. S., Han, J., Annambhotla, S., and Bryant, S. (2005). “Artificial neural networks for forecasting watershed runoff and stream flows.” J. Hydrol. Eng., 10(3), 216–222.
Zealand, C. M., Burn, D. H., and Simonovic, S. P. (1999). “Short term streamflow forecasting using artificial neural networks.” J. Hydrol., 214(1–4), 32–48.
Information & Authors
Information
Published In
Journal of Hydrologic Engineering
Volume 17 • Issue 2 • February 2012
Pages: 262 - 271
Copyright
© 2012 American Society of Civil Engineers.
History
Received: Feb 7, 2010
Accepted: May 9, 2011
Published online: May 27, 2011
Published in print: Feb 1, 2012
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.