Forecasting Daily Runoff by Extreme Learning Machine Based on Quantum-Behaved Particle Swarm Optimization
Publication: Journal of Hydrologic Engineering
Volume 23, Issue 3
Abstract
Accurate hydrologic time-series prediction plays an important role in modern water resource planning, water supply management, environmental protection, and power system operation. In general, single-layer feedforward networks (SLFNs) can provide satisfactory forecasting results, but classical gradient-based learning algorithms are time consuming and easily trapped into local optimums. As a new training method for SLFNs, extreme learning machine (ELM) has faster training speed and stronger nonlinear mapping than gradient-based algorithms, and provides an effective technique for hydrologic time-series prediction. However, ELM may converge to local minimums in some cases due to the random determination of input weights and hidden biases. Thus, in order to overcome the shortcomings of ELM, this paper introduces a novel ELM–quantum-behaved particle swarm optimization (QPSO) model (ELM-QPSO) combining the advantages of ELM and QPSO. The proposed model adopts the QPSO algorithm to select the optimal input-hidden weights and hidden biases of ELM, and uses the Moore–Penrose generalized inverse to analytically determine the output weights. The proposed approach is assessed with daily runoff data of Xinfengjiang reservoir in China from January 1, 2000 to December 31, 2014. The results indicate that the ELM-QPSO can significantly improve the generalization performance of ELM for hydrologic time-series prediction, and that QPSO is an alternative training algorithm for ELM parameters selection.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
This research is supported by the National Key R&D Program of China (2017YFC0405900), National Natural Science Foundation of China (51709119, 91547201, and 91547208) and the Fundamental Research Funds for the Central Universities (HUST: 2017KFYXJJ193). The authors thank the editors and reviewers for their valuable comments and suggestions.
References
Babovic, V., and Keijzer, M. (2000). Forecasting of river discharges in the presence of chaos and noise, Springer, Dordrecht, Netherlands.
Bai, Y., Wang, P., Xie, J., Li, J., and Li, C. (2015). “Additive model for monthly reservoir inflow forecast.” J. Hydrol. Eng., 04014079.
Caldwell, J., Rajagopalan, B., and Danner, E. (2015). “Statistical modeling of daily water temperature attributes on the Sacramento River.” J. Hydrol. Eng., 04014065.
Cao, J., Lin, Z., and Huang, G. B. (2012). “Self-adaptive evolutionary extreme learning machine.” Neural Process Lett., 36(3), 285–305.
Chau, K. W. (2006). “Particle swarm optimization training algorithm for ANNs in stage prediction of Shing Mun River.” J. Hydrol., 329(3–4), 363–367.
Chau, K. W., and Wu, C. L. (2010). “A hybrid model coupled with singular spectrum analysis for daily rainfall prediction.” J. Hydroinf., 12(4), 458–473.
Chau, K. W., Wu, C. L., and Li, Y. S. (2005). “Comparison of several flood forecasting models in Yangtze River.” J. Hydrol. Eng., 485–491.
Chen, L., Singh, V. P., and Guo, S. (2013). “Measure of correlation between river flows using the copula-entropy method.” J. Hydrol. Eng., 1591–1606.
Chen, L., Ye, L., Singh, V., Zhou, J., and Guo, S. (2014). “Determination of input for artificial neural networks for flood forecasting using the copula entropy method.” J. Hydrol. Eng., 04014021.
Chen, X. Y., and Chau, K. W. (2016). “A hybrid double feedforward neural network for suspended sediment load estimation.” Water Resour. Manage., 30(7), 2179–2194.
Chen, X. Y., Chau, K. W., and Busari, A. O. (2015). “A comparative study of population-based optimization algorithms for downstream river flow forecasting by a hybrid neural network model.” Eng. Appl. Artif. Intell., 46, 258–268.
Choudhury, P., and Roy, P. (2015). “Forecasting concurrent flows in a river system using ANNs.” J. Hydrol. Eng., 06014012.
Fang, W., Sun, J., Ding, Y., Wu, X., and Xu, W. (2010). “A review of quantum-behaved particle swarm optimization.” IETE Tech. Rev., 27(4), 336–348.
Feng, Z. K., Niu, W. J., and Cheng, C. T. (2017a). “Multi-objective quantum-behaved particle swarm optimization for economic environmental hydrothermal energy system scheduling.” Energy, 131, 165–178.
Feng, Z. K., Niu, W. J., Cheng, C. T., and Liao, S. L. (2017b). “Hydropower system operation optimization by discrete differential dynamic programming based on orthogonal experiment design.” Energy, 126, 720–732.
Feng, Z. K., Niu, W. J., Zhou, J., Cheng, C., Qin, H., and Jiang, Z. (2017c). “Parallel multi-objective genetic algorithm for short-term economic environmental hydrothermal scheduling.” Energies, 10(2), 163.
Feng, Z. K., Niu, W. J., Zhou, J. Z., and Cheng, C. T. (2017d). “Multiobjective operation optimization of a cascaded hydropower system.” J. Water Resour. Plann. Manage., 05017010.
Gholami, V., Chau, K. W., Fadaee, F., Torkaman, J., and Ghaffari, A. (2015). “Modeling of groundwater level fluctuations using dendrochronology in alluvial aquifers.” J. Hydrol., 529, 1060–1069.
Huang, G., Huang, G. B., Song, S., and You, K. (2015). “Trends in extreme learning machines: A review.” Neural Networks, 61, 32–48.
Huang, G. B., Chen, L., and Siew, C. K. (2006a). “Universal approximation using incremental constructive feedforward networks with random hidden nodes.” IEEE Trans. Neural Networks, 17(4), 879–892.
Huang, G. B., Zhou, H., Ding, X., and Zhang, R. (2012). “Extreme learning machine for regression and multiclass classification.” IEEE Trans. Syst. Man Cybern. Part B (Cybernetics), 42(2), 513–529.
Huang, G. B., Zhu, Q. Y., and Siew, C. K. (2006b). “Extreme learning machine: Theory and applications.” Neurocomputing, 70(1–3), 489–501.
Huang, S., Chang, J., Huang, Q., and Chen, Y. (2014). “Monthly streamflow prediction using modified EMD-based support vector machine.” J. Hydrol., 511, 764–775.
JAVA version 1.6 [Computer software]. Oracle Corporation, Redwood Shores, CA.
Khan, U. T., and Valeo, C. (2016). “Short-term peak flow rate prediction and flood risk assessment using fuzzy linear regression.” J. Environ. Inf., 28(2), 71–89.
Li, P., Chen, B., Li, Z. L., and Jing, L. (2016). “ASOC: A novel agent-based simulation-optimization coupling approach-algorithm and application in offshore oil spill responses.” J. Environ. Inf., 28(2), 90–100.
Linares-Rodriguez, A., Lara-Fanego, V., Pozo-Vazquez, D., and Tovar-Pescador, J. (2015). “One-day-ahead streamflow forecasting using artificial neural networks and a meteorological mesoscale model.” J. Hydrol. Eng., 05015001.
Nahvi, B., Habibi, J., Mohammadi, K., Shamshirband, S., and Razgan, O. S. A. (2016). “Using self-adaptive evolutionary algorithm to improve the performance of an extreme learning machine for estimating soil temperature.” Comput. Electron. Agric., 124, 150–160.
Prada-Sarmiento, F., and Obregón-Neira, N. (2009). “Forecasting of monthly streamflows based on artificial neural networks.” J. Hydrol. Eng., 1390–1395.
Song, X. M., Kong, F. Z., Zhan, C. S., and Han, J. W. (2012). “Hybrid optimization rainfall-runoff simulation based on Xinanjiang model and artificial neural network.” J. Hydrol. Eng., 1033–1041.
Stagge, J. H., and Moglen, G. E. (2014). “Evolutionary algorithm optimization of a multireservoir system with long lag times.” J. Hydrol. Eng., 05014011.
Sun, J., Fang, W., Wu, X., Palade, V., and Xu, W. (2012a). “Quantum-behaved particle swarm optimization: Analysis of individual particle behavior and parameter selection.” Evol. Comput., 20(3), 349–393.
Sun, J., Fang, W., Wu, X., Xie, Z., and Xu, W. (2011). “QoS multicast routing using a quantum-behaved particle swarm optimization algorithm.” Eng. Appl. Artif. Intell., 24(1), 123–131.
Sun, J., Wu, X., Palade, V., Fang, W., Lai, C. H., and Xu, W. (2012b). “Convergence analysis and improvements of quantum-behaved particle swarm optimization.” Inf. Sci., 193(11), 81–103.
Sun, Y., Babovic, V., and Chan, E. S. (2010). “Multi-step-ahead model error prediction using time-delay neural networks combined with chaos theory.” J. Hydrol., 395(1–2), 109–116.
Tao, Y., et al. (2014). “An evaluation of post-processed TIGGE multimodel ensemble precipitation forecast in the Huai River basin.” J. Hydrol., 519(PD), 2890–2905.
Taormina, R., and Chau, K. W. (2015). “Data-driven input variable selection for rainfall-runoff modeling using binary-coded particle swarm optimization and extreme learning machines.” J. Hydrol., 529, 1617–1632.
Valipour, M., Banihabib, M. E., and Behbahani, S. M. R. (2013). “Comparison of the ARMA, ARIMA, and the autoregressive artificial neural network models in forecasting the monthly inflow of Dez dam reservoir.” J. Hydrol., 476(2), 433–441.
Vojinovic, Z., Kecman, V., and Babovic, V. (2003). “Hybrid approach for modeling wet weather response in wastewater systems.” J. Water Resour. Plann. Manage., 511–521.
Wang, W. C., Chau, K. W., Cheng, C. T., and Qiu, L. (2009). “A comparison of performance of several artificial intelligence methods for forecasting monthly discharge time series.” J. Hydrol., 374(3–4), 294–306.
Wang, W. C., Chau, K. W., Qiu, L., and Chen, Y. B. (2015a). “Improving forecasting accuracy of medium and long-term runoff using artificial neural network based on EEMD decomposition.” Environ. Res., 139, 46–54.
Wang, W. C., Chau, K. W., Xu, D. M., and Chen, X. Y. (2015b). “Improving forecasting accuracy of annual runoff time series using ARIMA based on EEMD decomposition.” Water Resour. Manage., 29(8), 2655–2675.
Wang, W. C., Xu, D. M., Cheng, C. T., and Chau, K. W. (2012). “Calibration of Xinanjiang model parameters using hybrid genetic algorithm based fuzzy optimal model.” J. Hydroinf., 14(3), 784–799.
Wu, C. L., Chau, K. W., and Fan, C. (2010). “Prediction of rainfall time series using modular artificial neural networks coupled with data-preprocessing techniques.” J. Hydrol., 389(1–2), 146–167.
Wu, C. L., Chau, K. W., and Li, Y. S. (2009a). “Methods to improve neural network performance in daily flows prediction.” J. Hydrol., 372(1–4), 80–93.
Wu, C. L., Chau, K. W., and Li, Y. S. (2009b). “Predicting monthly streamflow using data-driven models coupled with data-preprocessing techniques.” Water Resour. Res., 45(8), 2263–2289.
Xu, D. M., Wang, W. C., Chau, K. W., Cheng, C. T., and Chen, S. Y. (2013). “Comparison of three global optimization algorithms for calibration of the Xinanjiang model parameters.” J. Hydroinf., 15(1), 174–193.
Yu, X., Liong, S. Y., and Babovic, V. (2004). “EC-SVM approach for real-time hydrologic forecasting.” J. Hydroinf., 6(3), 209–223.
Zhao, T., Zhao, J. S., Lund, J. R., and Yang, D. W. (2014). “Optimal hedging rules for reservoir flood operation from forecast uncertainties.” J. Water Resour. Plann. Manage., 04014041.
Zhu, Q. Y., Qin, A. K., Suganthan, P. N., and Huang, G. B. (2005). “Evolutionary extreme learning machine.” Pattern Recognit., 38(10), 1759–1763.
Information & Authors
Information
Published In
Journal of Hydrologic Engineering
Volume 23 • Issue 3 • March 2018
Copyright
©2018 American Society of Civil Engineers.
History
Received: Feb 22, 2017
Accepted: Sep 12, 2017
Published online: Jan 5, 2018
Published in print: Mar 1, 2018
Discussion open until: Jun 5, 2018
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.