Knowledge Extraction from Artificial Neural Networks for Rainfall-Runoff Model Combination Systems
Publication: Journal of Hydrologic Engineering
Volume 19, Issue 7
Abstract
Artificial neural networks (ANNs) are generally regarded to behave as black-box systems. Recent research explores various methods that can provide an insight into the internal connections and relationships existing within the network. Various methodologies that understand the input variable contribution are analyzed in detail, and rule extraction approaches for a trained artificial neural network are addressed. To understand the contribution of input variables to rainfall-runoff model combination systems, this paper for the first time investigates knowledge extraction from artificial neural network, which is used to combine the results obtained from different competing rainfall-runoff models, using three different approaches: (1) Garson’s algorithm; (2) neural interpretation diagram (NID); and (3) sensitivity analysis (SA). For the purpose of investigating knowledge extraction techniques, the trained multilayer perceptron neural network to combine the results from four different rainfall-runoff models for the Brosna Catchment located in Ireland has been chosen. The results of the three approaches obtained in this study indicate that they can be used to reduce the complexity of rainfall-runoff model combination systems by eliminating the least significant contributing input variables. Based on these approaches, the paper helps to provide guidance in the optimal number of rainfall-runoff models that best perform in a combination system.
Get full access to this article
View all available purchase options and get full access to this article.
References
Anctil, F., Michel, C., Perrin, C., and Andréassian, V. (2004). “A soil moisture index as an auxiliary ANN input for stream flow forecasting.” J. Hydrol., 286(1–4), 155–167.
Andrews, R., Diederich, J., and Tickle, A. B. (1995). “Survey and critique of techniques for extracting rules from trained artificial neural networks.” Knowl. Based Syst., 8(6), 373–389.
Chapman, D. S., and Purse, B. V. (2011). “Community versus single-species distribution models for British plants.” J. Biogeogr., 38(8), 1524–1535.
Gallant, S. I. (1988). “Connectionist expert systems.” Commun. ACM, 31(2), 152–169.
Garson, G. D. (1991). “Interpreting neural-network connection weights.” AI Expert, 6(4), 46–51.
Gevrey, M., Dimopoulos, I., and Lek, S. (2003). “Review and comparison of methods to study the contribution of variables in artificial neural network models.” Ecol. Modell., 160(3), 249–264.
Izadifar, Z., and Elshorbagy, A. (2010). “Prediction of hourly actual evapotranspiration using neural networks, genetic programming, and statistical models.” Hydrol. Process., 24(23), 3413–3425.
Jain, A., and Kumar, S. (2009). “Dissection of trained neural network hydrologic models for knowledge extraction.” Water Resour. Res., 45(7), W07420.
Jeong, D. I., and Kim, Y. O. (2005). “Rainfall-runoff models using artificial neural networks for ensemble streamflow prediction.” Hydrol. Process., 19(19), 3819–3835.
Kahramanli, H., and Allahverdi, N. (2009). “Rule extraction from trained adaptive neural networks using artificial immune systems.” Expert Syst. Appl., 36(2, Part 1), 1513–1522.
Kalteh, A. M. (2008). “Rainfall-runoff modelling using artificial neural networks (ANNs): Modelling and understanding.” Caspian J. Env. Sci., 6(1), 53–58.
Kerem, C. H., and Kisi, Ö. (2006). “Methods to improve the neural network performance in suspended sediment estimation.” J. Hydrol., 317(3–4), 221–238.
Ki, O. (2007). “Streamflow forecasting using different artificial neural network algorithms.” J. Hydrol. Eng., 12(5), 532–539.
Kingston, G. B., Maier, H. R., and Lambert, M. F. (2005). “Calibration and validation of neural networks to ensure physically plausible hydrological modeling.” J. Hydrol., 314(2005), 158–176.
Lek, S., Delacoste, M., Baran, P., Dimonopoulos, I., Lauge, J., and Aulagnier, J. (1996). “Application of neural networks to modelling nonlinear relationships in ecology.” Ecol. Modell., 90(1), 39–52.
Olden, J. D., and Jackson, D. A. (2002). “Illuminating the “black box”: A randomization approach for understanding variable contributions in artificial neural networks.” Ecol. Modell., 154(1–2), 135–150.
Olden, J. D., Joy, M. K., and Death, R. G. (2004). “An accurate comparison of methods for quantifying variable importance in artificial neural networks using simulated data.” Ecol. Modell., 178(3–4), 389–397.
Özesmi, S. L., and Özesmi, U. (1999). “An artificial neural network approach to spatial habitat modelling with interspecific interaction.” Ecol. Modell., 116(1), 15–31.
Saltelli, A., Chan, K., and Scott, E. M. (2000). Sensitivity analysis, Wiley, New York.
Shamseldin, A. Y., Nasr, A. E., and O’Connor, K. M. (2002). “Comparsion of different forms of the multi-layer feed-forward neural network method used for river flow forecasting.” Hydrol. Earth Syst. Sci., 6(4), 671–684.
Shamseldin, A. Y., O’Connor, K. M., and Liang, G. C. (1997). “Methods for combining the outputs of different rainfall-runoff models.” J. Hydrol., 197(1–4), 203–229.
Shamseldin, A. Y., O’Connor, K. M., and Nasr, A. E. (2007). “A comparative study of three neural network forecast combination methods for simulated river flows of different rainfall-runoff models.” Hydrol. Sci. J., 52(5), 896–916.
Sudheer, K. P. (2005). “Knowledge extraction from trained neural network river flow models.” J. Hydrol. Eng., 264–269.
Tokar, A. S., and Markus, M. (2000). “Precipitation-runoff modeling using artificial neural networks and conceptual models.” J. Hydrol. Eng., 5(2), 156–161.
Wang, F., Zhou, B., Xu, J., Song, L., and Wang, X. (2009). “Application of neural network and MODIS 250 m imagery for estimating suspended sediments concentration in Hangzhou Bay, China.” Env. Geo., 56(6), 1093–1101.
Weckman, G. R., et al. (2009). “Knowledge extraction from the neural ‘black box’ in ecological monitoring.” J. Ind. Syst. Eng., 3(1), 38–55.
Wei, S., Song, J., and Khan, N. I. (2012). “Simulating and predicting river discharge time series using a wavelet-neural network hybrid modelling approach.” Hydrol. Process., 26(2), 281–296.
Wilby, R. L., Abrahart, R. J., and Dawson, C. W. (2003). “Detection of conceptual model rainfall-runoff processes inside an artificial neural network.” Hydrol. Sci. J., 48(2), 163–181.
World Meteorological Organization (WMO). (1992). “Simulated real-time intercomparison of hydrological models.” Oper. Hydrol. Rep. 38, WMO 779, Geneva.
Information & Authors
Information
Published In
Journal of Hydrologic Engineering
Volume 19 • Issue 7 • July 2014
Pages: 1422 - 1429
Copyright
© 2013 American Society of Civil Engineers.
History
Received: May 16, 2013
Accepted: Nov 12, 2013
Published online: Nov 14, 2013
Discussion open until: Apr 14, 2014
Published in print: Jul 1, 2014
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.