A Probabilistic Runoff Prediction Model Based on Improved Long Short-Term Memory and Interval Correction
Publication: Journal of Hydrologic Engineering
Volume 29, Issue 4
Abstract
Accurate and reliable runoff prediction is essential for the efficient operation of hydropower systems. This paper presented a runoff probability prediction model that utilizes an enhanced long short-term memory (LSTM) network. The model incorporates a combination of a long and short-term memory network, a quantile regression module and an interval correction module. The proposed model utilizes the LSTM network to effectively capture the time-series characteristics of the runoff data. By incorporating the quantile regression module, the model allows for probability predictions without the need for prior assumptions. Furthermore, the inclusion of an interval correction module helps refine the prediction results, leading to improved accuracy and a narrower prediction interval. The integration of these three modules greatly enhances the precision of the predictions and brings the probability estimates closer to the true distribution. By incorporating the quantile regression module, the model allows for probability predictions without the need for prior assumptions. Jinsha River and Lancang River were selected to evaluate the performance of the model because of the availability of long-term reliable data, geographical representation, and socioeconomic importance. The prediction results demonstrate superior performance compared with other existing models. Moreover, the model enables obtaining probabilistic predictions with appropriate prediction intervals and high reliability.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or code that support the findings of this study are available from the corresponding author upon reasonable request.
Acknowledgments
This work was supported by the Open Research Fund of State Key Laboratory of Simulation and Regulation of Water Cycle in River Basin (China Institute of Water Resources and Hydropower Research), Grant No: IWHR-SKL-KF202114.
References
Abbasi, M., H. Dehban, A. Farokhnia, R. Roozbahani, and M. Bahreinimotlagh. 2022. “Long-term streamflow prediction using hybrid SVR-ANN based on Bayesian model averaging.” J. Hydrol. Eng. 27 (11): 05022018. https://doi.org/10.1061/(ASCE)HE.1943-5584.0002218.
Abdulraheem, A., R. Abdullah Arshah, and H. Qin. 2015. “Evaluating the effect of dataset size on predictive model using supervised learning technique.” Int. J. Software Eng. Comput. Sci. (IJSECS) 1 (Feb): 75–84. https://doi.org/10.15282/ijsecs.1.2015.6.0006.
Achite, M., S. Farzin, N. Elshaboury, M. Valikhan Anaraki, M. Amamra, and A. K. Toubal. 2022. “Modeling the optimal dosage of coagulants in water treatment plants using various machine learning models.” Environ. Dev. Sustainability 26 (2): 3395–3421. https://doi.org/10.1007/s10668-022-02835-0.
Adnan, R. M., Z. Liang, S. Heddam, M. Zounemat-Kermani, O. Kisi, and B. Li. 2020. “Least square support vector machine and multivariate adaptive regression splines for streamflow prediction in mountainous basin using hydro-meteorological data as inputs.” J. Hydrol. 586 (Jul): 124371. https://doi.org/10.1016/j.jhydrol.2019.124371.
Alessandrini, S., L. Delle Monache, S. Sperati, and G. Cervone. 2015. “An analog ensemble for short-term probabilistic solar power forecast.” Appl. Energy 157 (Sep): 95–110. https://doi.org/10.1016/j.apenergy.2015.08.011.
Al-Musaylh, M. S., R. C. Deo, Y. Li, and J. F. Adamowski. 2018. “Two-phase particle swarm optimized-support vector regression hybrid model integrated with improved empirical mode decomposition with adaptive noise for multiple-horizon electricity demand forecasting.” Appl. Energy 217 (Feb): 422–439. https://doi.org/10.1016/j.apenergy.2018.02.140.
Bauer, M., M. van der Wilk, and C. E. Rasmussen. 2016. “Understanding probabilistic sparse gaussian process approximations.” In Vol. 29 of Proc., 30th Conf. on Neural Information Processing Systems (NIPS). Red Hook, NY: Curran Associates.
Bui, T. D., J. Yan, and R. E. Turner. 2017. “A unifying framework for Gaussian process pseudo-point approximations using power expectation propagation.” J. Mach. Learn. Res. 18 (104): 1–72. https://doi.org/10.17863/CAM.20846.
Cannon, A. 2011. “Quantile regression neural networks: Implementation in R and application to precipitation downscaling.” Comput. Geosci. 37 (9): 1277–1284. https://doi.org/10.1016/j.cageo.2010.07.005.
Carlson, R. F., A. J. A. Maccormick, and D. G. Watts. 1970. “Application of linear random models to four annual streamflow series.” Water Resour. Res. 6 (4): 1070–1078. https://doi.org/10.1029/WR006i004p01070.
Chang, F.-J., and M.-J. Tsai. 2016. “A nonlinear spatio-temporal lumping of radar rainfall for modeling multi-step-ahead inflow forecasts by data-driven techniques.” J. Hydrol. 535 (Mar): 256–269. https://doi.org/10.1016/j.jhydrol.2016.01.056.
Chang, W., and X. Chen. 2018. “Monthly rainfall-runoff modeling at watershed scale: A comparative study of data-driven and theory-driven approaches.” Water 10 (9): 1116. https://doi.org/10.3390/w10091116.
Chen, J., F. Ding, Q. Zhu, and Y. Liu. 2020. “Interval error correction auxiliary model based gradient iterative algorithms for multirate ARX models.” IEEE Trans. Autom. Control 65 (10): 4385–4392. https://doi.org/10.1109/TAC.2019.2955030.
Chu, H., J. Wei, and W. Wu. 2020. “Streamflow prediction using LASSO-FCM-DBN approach based on hydro-meteorological condition classification.” J. Hydrol. 580 (Jan): 124253. https://doi.org/10.1016/j.jhydrol.2019.124253.
Duan, J., H. Zuo, Y. Bai, J. Duan, M. Chang, and B. Chen. 2021. “Short-term wind speed forecasting using recurrent neural networks with error correction.” Energy 217 (Feb): 119397. https://doi.org/10.1016/j.energy.2020.119397.
Duan, Q., S. Sorooshian, and V. K. Gupta. 1992. “Effective and efficient global optimization for conceptual rainfall-runoff models.” Water Resour. Res. 28 (4): 1015–1031. https://doi.org/10.1029/91WR02985.
Duong, T., and M. L. Hazelton. 2005. “Cross-validation bandwidth matrices for multivariate kernel density estimation.” Scand. J. Stat. 32 (3): 485–506. https://doi.org/10.1111/j.1467-9469.2005.00445.x.
Ehsan, A., A. Ehsan, and Q. Yang. 2019. “State-of-the-art techniques for modelling of uncertainties in active distribution network planning: A review.” Appl. Energy 239 (Apr): 1509–1523. https://doi.org/10.1016/j.apenergy.2019.01.211.
Elshorbagy, A., G. Corzo, S. Srinivasulu, and D. P. Solomatine. 2009. “Experimental investigation of the predictive capabilities of data driven modeling techniques in hydrology—Part 2: Application.” Hydrol. Earth Syst. Sci. 14 (Jun): 1943–1961. https://doi.org/10.5194/hess-14-1943-2010.
Epanechnikov, V. A. 1969. “Non-parametric estimation of a multivariate probability density.” Theory Probab. Appl. 14 (1): 153–158. https://doi.org/10.1137/1114019.
Fernández, C., J. A. Vega, T. Fontúrbel, and E. Jiménez. 2008. “Streamflow drought time series forecasting: A case study in a small watershed in North West Spain.” Stochastic Environ. Res. Risk Assess. 23 (Mar): 1063–1070. https://doi.org/10.1007/s00477-008-0277-8.
Flunkert, V., D. Salinas, and J. Gasthaus. 2020. “DeepAR: Probabilistic forecasting with autoregressive recurrent networks.” Preprint, submitted April 13, 2017. http://arxiv.org/abs/1704.04110.
Gao, S., Y. Huang, S. Zhang, J. Han, G. Wang, M. Zhang, and Q. Lin. 2020. “Short-term runoff prediction with GRU and LSTM networks without requiring time step optimization during sample generation.” J. Hydrol. 589 (Oct): 125188. https://doi.org/10.1016/j.jhydrol.2020.125188.
Gao, S., S. Zhang, Y. Huang, J. Han, H. Luo, Y. Zhang, and G. Wang. 2022. “A new seq2seq architecture for hourly runoff prediction using historical rainfall and runoff as input.” J. Hydrol. 612 (Sep): 128099. https://doi.org/10.1016/j.jhydrol.2022.128099.
Gonzalez, M. O., P. Preetha, M. Kumar, and T. P. Clement. 2023. “Comparison of data-driven groundwater recharge estimates with a process-based model for a river basin in the southeastern USA.” J. Hydrol. Eng. 28 (7): 04023019. https://doi.org/10.1061/JHYEFF.HEENG-5882.
Guo, J., Y. Liu, Q. Zou, L. Ye, S. Zhu, and H. Zhang. 2023. “Study on optimization and combination strategy of multiple daily runoff prediction models coupled with physical mechanism and LSTM.” J. Hydrol. 624 (Jun): 129969. https://doi.org/10.1016/j.jhydrol.2023.129969.
Guo, S. W., and D. Y. Lin. 1994. “Regression analysis of multivariate grouped survival data.” Biometrics 50 (3): 632–639. https://doi.org/10.2307/2532778.
He, X. X., J. G. Luo, G. G. Zuo, and J. C. Xie. 2019. “Daily runoff forecasting using a hybrid model based on variational mode decomposition and deep neural networks.” Water Resour. Manage. 33 (4): 1571–1590. https://doi.org/10.1007/s11269-019-2183-x.
He, Y., and H. Li. 2018. “Probability density forecasting of wind power using quantile regression neural network and kernel density estimation.” Energy Convers. Manage. 164 (Jan): 374–384. https://doi.org/10.1016/j.enconman.2018.03.010.
He, Z., X. Wen, H. Liu, and J. Du. 2014. “A comparative study of artificial neural network, adaptive neuro fuzzy inference system and support vector machine for forecasting river flow in the semiarid mountain region.” J. Hydrol. 509 (Mar): 379–386. https://doi.org/10.1016/j.jhydrol.2013.11.054.
Hochreiter, S., and J. Schmidhuber. 1997. “Long short-term memory.” Neural Comput. 9 (8): 1735–1780. https://doi.org/10.1162/neco.1997.9.8.1735.
Hu, J., J. Tang, and Y. Lin. 2020. “A novel wind power probabilistic forecasting approach based on joint quantile regression and multi-objective optimization.” Renewable Energy 149 (Jan): 141–164. https://doi.org/10.1016/j.renene.2019.11.143.
Krzysztofowicz, R. 1999. “Bayesian theory of probabilistic forecasting via deterministic hydrologic model.” Water Resour. Res. 35 (9): 2739–2750. https://doi.org/10.1029/1999WR900099.
LeCun, Y., Y. Bengio, and G. Hinton. 2015. “Deep learning.” Nature 521 (Feb): 436–444. https://doi.org/10.1038/nature14539.
Liu, Y., G. Hou, F. Huang, H. Qin, B. Wang, and L. Yi. 2022. “Directed graph deep neural network for multi-step daily streamflow forecasting.” J. Hydrol. 607 (Apr): 127515. https://doi.org/10.1016/j.jhydrol.2022.127515.
Liu, Y., Y. Liu, L. Ye, H. Qin, S. Ouyang, Z. Zhang, and J. Zhou. 2019. “Middle and long-term runoff probabilistic forecasting based on gaussian mixture regression.” Water Resour. Manage. 33 (5): 1785–1799. https://doi.org/10.1007/s11269-019-02221-y.
Lu, M. S., Q. Hou, S. Qin, L. Zhou, D. Hua, X. Wang, and L. Cheng. 2023. “A stacking ensemble model of various machine learning models for daily runoff forecasting.” Water 15 (7): 1265. https://doi.org/10.3390/w15071265.
Marilena, F., and V. Domenico. 2018. Quantile regression. Wiley series in probability and statistics. Hoboken, NJ: Wiley. https://doi.org/10.1002/9781118863718.
Morshed-Bozorgdel, A., M. Kadkhodazadeh, M. Valikhan Anaraki, and S. Farzin. 2022. “A Novel framework based on the stacking ensemble machine learning (SEML) method: Application in wind speed modeling.” Atmosphere 13 (5): 758. https://doi.org/10.3390/atmos13050758.
Ni, L., D. Wang, J. Wu, Y. Wang, Y. Tao, J. Zhang, and J. Liu. 2020. “Streamflow forecasting using extreme gradient boosting model coupled with Gaussian mixture model.” J. Hydrol. 586 (Jul): 124901. https://doi.org/10.1016/j.jhydrol.2020.124901.
Nowotarski, J., and R. Weron. 2018. “Recent advances in electricity price forecasting: A review of probabilistic forecasting.” Renewable Sustainable Energy Rev. 81 (Jan): 1548–1568. https://doi.org/10.1016/j.rser.2017.05.234.
Ran, X., C. Xu, L. Ma, and F. F. Xue. 2022. “Wind power interval prediction with adaptive rolling error correction based on PSR-BLS-QR.” Energies 15 (11): 4137. https://doi.org/10.3390/en15114137.
Reshef, D. N., Y. A. Reshef, M. Mitzenmacher, and P. C. Sabeti. 2013. “Equitability analysis of the maximal information coefficient, with comparisons.” Preprint, submitted January 29, 2013. http://arxiv.org/abs/1301.6314.
Ruder, S. 2017. “An overview of multi-task learning in deep neural networks.” Preprint, submitted May 29, 2017. http://arxiv.org/abs/1706.05098.
Szczepanek, R. 2022. “Daily streamflow forecasting in mountainous catchment using XGBoost, LightGBM and CatBoost.” Hydrology 9 (12): 226. https://doi.org/10.3390/hydrology9120226.
Thomas, H. 1962. “Mathematical synthesis of streamflow sequences for the analysis of river basin by simulation.” In Design of water resources-systems, 459–493. Cambridge, MA: Harvard University Press. https://doi.org/10.4159/harvard.9780674421042.c15.
Tiwari, A. D., P. Mukhopadhyay, and V. Mishra. 2022. “Influence of bias correction of meteorological and streamflow forecast on hydrological prediction in India.” J. Hydrometeorol. 23 (7): 1171–1192. https://doi.org/10.1175/JHM-D-20-0235.1.
Tyralis, H., and G. Papacharalampous. 2023. “Hydrological post-processing for predicting extreme quantiles.” J. Hydrol. 617 (Apr): 129082. https://doi.org/10.1016/j.jhydrol.2023.129082.
Wang, S. L., Z. Q. Jiang, and H. R. Zhang. 2022. “Correction of reservoir runoff forecast based on multi-scenario division and multi models.” Water Resour. Manage. 36 (13): 5277–5296. https://doi.org/10.1007/s11269-022-03305-y.
Weron, R. 2014. “Electricity price forecasting: A review of the state-of-the-art with a look into the future.” Int. J. Forecast. 30 (4): 1030–1081. https://doi.org/10.1016/j.ijforecast.2014.08.008.
Wu, J., J. Z. Zhou, L. Chen, and L. Ye. 2015. “Coupling forecast methods of multiple rainfall-runoff models for improving the precision of hydrological forecasting.” Water Resour. Manage. 29 (14): 5091–5108. https://doi.org/10.1007/s11269-015-1106-8.
Yaseen, Z. M., A. El-Shafie, O. Jaafar, H. A. Afan, and K. N. Sayl. 2015. “Artificial intelligence based models for stream-flow forecasting: 2000-2015.” J. Hydrol. 530 (Feb): 829–844. https://doi.org/10.1016/j.jhydrol.2015.10.038.
Ye, L., B. Dai, Z. Li, M. Pei, Y. Zhao, and P. Lu. 2022. “An ensemble method for short-term wind power prediction considering error correction strategy.” Appl. Energy 322 (Sep): 119475. https://doi.org/10.1016/j.apenergy.2022.119475.
Young, C.-C., and W. C. Liu. 2015. “Prediction and modelling of rainfall–runoff during typhoon events using a physically-based and artificial neural network hybrid model.” Hydrol. Sci. J. 60 (12): 2102–2116. https://doi.org/10.1080/02626667.2014.959446.
Yu, P.-S., S.-T. Chen, and I. F. Chang. 2006. “Support vector regression for real-time flood stage forecasting.” J. Hydrol. 328 (Apr): 704–716. https://doi.org/10.1016/j.jhydrol.2006.01.021.
Zhang, C., J.- Zhou, Z. C. Li, W. Fu, and T. Peng. 2017. “A compound structure of ELM based on feature selection and parameter optimization using hybrid backtracking search algorithm for wind speed forecasting.” Energy Convers. Manage. 143 (Jan): 360–376. https://doi.org/10.1016/j.enconman.2017.04.007.
Zhang, Z., L. Ye, H. Qin, Y. Liu, C. Wang, X. Yu, X. Yin, and J. Li. 2019. “Wind speed prediction method using shared weight long short-term memory network and Gaussian process regression.” Appl. Energy 247 (Jan): 270–284. https://doi.org/10.1016/j.apenergy.2019.04.047.
Zhu, S., X. Chen, X. Luo, K. Luo, J. Wei, J. Li, and Y. Xiong. 2022. “Enhanced probabilistic spatiotemporal wind speed forecasting based on deep learning, quantile regression, and error correction.” J. Energy Eng. 148 (2): 04022004. https://doi.org/10.1061/(ASCE)EY.1943-7897.0000823.
Information & Authors
Information
Published In
Journal of Hydrologic Engineering
Volume 29 • Issue 4 • August 2024
Copyright
© 2024 American Society of Civil Engineers.
History
Received: May 19, 2023
Accepted: Jan 26, 2024
Published online: Apr 30, 2024
Published in print: Aug 1, 2024
Discussion open until: Sep 30, 2024
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.