Multivariate Reservoir Inflow Forecasting Using Temporal Neural Networks
Publication: Journal of Hydrologic Engineering
Volume 6, Issue 5
Abstract
An experiment on predicting multivariate water resource time series, specifically the prediction of hydropower reservoir inflow using temporal neural networks, is presented. This paper focuses on dynamic neural networks to address the temporal relationships of the hydrological series. Three types of temporal neural network architectures with different inherent representations of temporal information are investigated. An input delayed neural network (IDNN) and a recurrent neural network (RNN) with and without input time delays are proposed for multivariate reservoir inflow forecasting. The forecast results indicate that, overall, the RNN obtained the best performance. The results also suggest that the use of input time delays significantly improves the conventional multilayer perceptron (MLP) network but does not provide any improvement in the RNN model. However, the RNN with input time delays remains slightly more effective for multivariate reservoir inflow prediction than the IDNN model. Moreover, it is found that the conventional MLP network widely used in hydrological applications is less effective at multivariate reservoir inflow forecasting than the proposed models. Furthermore, the experiment shows that employing only time-delayed recurrences can be the more effective and less costly method for multivariate water resources time series prediction.
Get full access to this article
View all available purchase options and get full access to this article.
References
1.
Anmala, J., Zhang, B., and Govindaraju, R. S. (2000). “Comparison of ANNs and empirical approaches for predicting watershed runoff.”J. Water Resour. Plng. and Mgmt., ASCE, 126(3), 156–166.
2.
ASCE Task Committee on Application of Artificial Neural Networks in Hydrology. ( 2000). “Artificial neural networks in hydrology. Parts I and II." J. Hydrologic Engrg., ASCE, 5(2), 115–137.
3.
Campolo, M., Andreussi, P., and Soldati, A. ( 1999). “River flood forecasting with neural network model.” Water Resour. Res., 35(4), 1191–1197.
4.
Chow, T. W. S., and Cho, S. Y. ( 1997). “Development of recurrent sigma-pi neural network rainfall forecasting system in Hong Kong.” Neural Computing and Applications, 5(2), 66–75.
5.
Clair, T. A., and Ehrman, J. M. ( 1998). “Using neural networks to assess the influence of changing seasonal climates in modifying discharge, dissolved organic carbon, and nitrogen export in eastern Canadian rivers.” Water Resour. Res., 34(3), 447–455.
6.
Clouse, D. S., Giles, C. L., Horne, B. G., and Cottrell, G. W. ( 1997). “Time-delay neural networks: Representation and induction of finite-state machines.” IEEE Trans. on Neural Networks, 8(5), 1065–1070.
7.
Coulibaly, P., Anctil, F., and Bobée, B. ( 1999). “Prévision hydrologique par réseaux de neurones artificiels: État de l'art.” Can. J. Civ. Engrg., 26(3), 293–304.
8.
Coulibaly, P., Anctil, F., and Bobée, B. ( 2000a). “Daily reservoir inflow forecasting using artificial neural networks with stopped training approach.” J. Hydro., 230, 244–257.
9.
Coulibaly, P., Anctil, F., and Bobée, B. ( 2000b). “Neural network-based long-term hydropower forecasting system.” Comp. Aided Civ. and Infrastruct. Engrg., 15(5), 355–364.
10.
Coulibaly, P., Anctil, F., Rasmussen, P., and Bobée, B. ( 2000c). “A recurent neural networks approach using indices of low-frequency climatic variability to forecast regional annual runoff.” Hydrological Processes, 14, 2755–2777.
11.
Dibike, Y. B., and Solomatine, D., and Abbott, M. B. (1999). “On encapsulation of numeric-hydraulic models in artificial neural networks.”J. Hydr. Res., 37(2), 147–161.
12.
Elman, J. L. ( 1990). “Finding structure in time.” Cognitive Sci., 14, 179–211.
13.
Feldkamp, L. A., and Puskorius, G. V. ( 1998). “Signal processing framework based on dynamic neural networks with application to problems in adaptation, filtering and classification.” Proc., IEEE, 86(11), 2259–2277.
14.
Frasconi, P., Gori, M., and Soda, G. ( 1992). “Local feedback multilayered networks.” Neural Computation, 4, 120–130.
15.
Giles, C. L., Lawrence, S., and Tsoi, A. C. ( 1997). “Rule inference for financial prediction using recurrent neural networks.” Proc., IEEE/IAFE Conf. on Computational Intelligence for Financial Engrg., IEEE Press, Piscataway, N.J., 253–259.
16.
Hagan, M. T., and Menhaj, M. B. ( 1994). “Training feedforward networks with Marquardt algorithm.” IEEE Trans. on Neural Networks, 5(6), 989–993.
17.
Haykin, S. ( 1999). Neural networks: Comprehensive foundation, Prentice-Hall, Upper Saddle River, N.J.
18.
Hsu, K. L., Gupta, H. V., and Sorooshian, S. ( 1995). “Artificial neural network modeling of rainfall-rainoff process.” Water Resour. Res., 31(10), 2517–2530.
19.
Jain, S. K., Das, D., and Srivastava, D.K. (1999). “Application of ANN for reservoir inflow prediction and operation.”J. Water Resour. Plng. and Mgmt., ASCE, 125(5), 263–271.
20.
Jordan, M. I. ( 1986). “Attractor dynamics and parallelism in a connectionist sequential machine.” 8th Annu. Conf., Cognitive Sci. Soc., MIT Press, Amherst, Mass., 531–546.
21.
Karunanithi, N., Grenney, W. J., Whitley, D., and Bovee, K. (1994). “Neural networks for river flow prediction.”J. Comp. Civ. Engrg., ASCE, 8(2), 201–220.
22.
Maier, H. R., and Dandy, G. C. ( 1996). “Use of artificial neural networks for prediction of water quality parameters.” Water Resour. Res., 32(4), 1013–1022.
23.
Maier, H. R., and Dandy, G. C. ( 2000). “Neural networks for prediction and forecasting of water resources variables: Review of modelling issues and applications.” Envir. Modelling and Software, 15, 101–124.
24.
Masters, T. ( 1995). Advanced algorithms for neural networks: C++ sourcebook, Wiley, New York.
25.
Mozer, M. C. ( 1993). “Neural network architectures for temporal sequence processing.” Time series prediction: Forecasting the future and understanding the past, A. S. Weigend and N. A. Gershenfeld, eds., Addison-Wesley, Reading, Mass., 243–264.
26.
Nash, J. E., and Sutcliffe, J. V. ( 1970). “River flow forecasting through conceptual models. Part I: Discussion of principles.” J. Hydro., 10, 282–290.
27.
Pearlmutter, B. A. ( 1995). “Gradient calculations for dynamic recurrent neural networks: Survey.” IEEE Trans. on Neural Networks, 6(5), 1212–1228.
28.
Perchelt, L. ( 1998). “Automatic early stopping using cross validation: Quantifying criteria.” Neural Networks, 11, 761–767.
29.
Puskorius, G. V., Feldkamp, L. A., and Davis, L. I. ( 1996). “Dynamic neural network methods applied to on-line vehicle idle speed control.” Proc., IEEE, 34, 1407–1420.
30.
Ribeiro, J., Lauzon, N., Rousselle, J., Trung, H. T., and Salas, J. D. ( 1998). “Comparaison de deux modèles pour la prévision journalière en temps réel des apports naturels.” Can. J. Civ. Engrg., 25, 291–304 (in French).
31.
Saad, M., Bigras, P., Turgeon, A., and Duquette, R. ( 1996). “Fuzzy learning decomposition for scheduling of hydroelectric power systems.” Water Resour. Res., 32(1), 179–186.
32.
Sajikumar, N., and Thandaveswara, B. S. ( 1999). “Non-linear rainfall-runoff model using artificial neural network.” J. Hydro., 216, 32–35.
33.
Shamseldin, A. Y. ( 1997). “Application of neural network technique to rainfall-runoff modelling.” J. Hydro., 199, 272–294.
34.
Smith, J., and Eli, R. N. (1995). “Neural-network models of rainfall-runoff process.”J. Water Resour. Plng. and Mgmt., ASCE, 121(6), 499–508.
35.
Thirumalaiah, K., and Deo, M. C. (1998). “River stage forecasting using artificial neural networks.”J. Hydrologic Engrg., ASCE, 3(1), 26–32.
36.
Thirumalaiah, K., and Deo, M. C. (2000). “Hydrological forecasting using neural networks.”J. Hydrologic Engrg., ASCE, 5(2), 180–189.
37.
Tokar, A. S., and Johnson, P. A. (1999). “Rainfall-runoff modeling using artificial neural networks.”J. Hydrologic Engrg., ASCE, 4(3), 232–239.
38.
Waibel, A., Hanazawa, T., Hintin, G., Shikano, K., and Lang, K. J. ( 1989). “Phoneme recognition using time delay neural networks.” IEEE Trans. on ASSP, 37(3), 328–339.
39.
Wan, E. ( 1993). “Time series prediction using connectionist network with internal delay lines.” Time series prediction: Forecasting the future and understanding the past, A. S. Weigend and N. A. Gershenfeld, eds., Addison-Wesley, Reading, Mass., 195–217.
40.
Williams, R. J., and Peng, J. ( 1990). “An efficient gradient-based algorithm for on-line training of recurrent network trajectories.” Neural Computation, 2, 490–501.
41.
Williams, R. J., and Zipser, D. ( 1994). “Gradient-based learning algorithms for recurrent neural networks and their computational complexity.” Backpropagation: Theory, architectures, and applications, Y. Chauvin and D. E. Rumelhart, eds., Lawrence Erlbaum Associates, Hillsdale, N.J., 433–486.
42.
Zealand, C. M., Burn, D. H., and Simonovic, S. P. ( 1999). “Short term streamflow forecasting using artificial neural networks.” J. Hydro., 214, 32–48.
Information & Authors
Information
Published In
Journal of Hydrologic Engineering
Volume 6 • Issue 5 • October 2001
Pages: 367 - 376
History
Published online: Oct 1, 2001
Published in print: Oct 2001
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.