Rainfall Forecasting with Hybrid and Machine Learning Models Based on Hyperparameter Optimization
Publication: Journal of Hydrologic Engineering
Volume 28, Issue 11
Abstract
Time-series analysis in hydrology plays an important role in the efficient use of water resources, prediction of flood risks, and crop production. However, considering many parameters in the solution of hydrological problems complicates the time-series analysis. For this reason, the use of artificial intelligence methods in hydrology studies has become interesting. The support vector regression (SVR) model and random forest (RF) model are frequently used in hydrological time-series forecasting. The SVR model reduces the experimental measurement errors as well as giving the statistical properties of the data used. The RF model is often used in the solution of regression. However, in both models, realistic values can be reached with different parameters in predicting total monthly rainfall (TMR). The reason for this is that the parameters used in the SVR model and RF model in time-series analysis should be used in different values for each period. In this study, the SVR model is used to forecast monthly rainfall amounts. The artificial bee colony (ABC) algorithm is used to obtain optimum values of SVR model parameters. In the proposed approach, TMR values in the years between January 1938 and December 2016 of Elazig, Erzincan, Erzurum, and Van stations in the eastern part of Turkey are used. The performance of the proposed model is compared with search-based SVR and RF models and hybrid SVR-genetic algorithm and RF-genetic algorithm. For the four stations, the results showed that the hybrid model performed significantly better. The proposed SVR-ABC model provided more realistic values than the search-based SVR and RF models.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or codes that support the findings of this study are available from the corresponding author upon reasonable request, including total rainfall data of for Elazig, Erzincan, Erzurum, and Van for many years and the algorithm of the SVR-ABC model.
References
Abghari, H., H. Ahmadi, S. Besharat, and V. Rezaverdinejad. 2012. “Prediction of daily pan evaporation using wavelet neural networks.” Water Resour. Manage. 26 (12): 3639–3652. https://doi.org/10.1007/s11269-012-0096-z.
AFAD (Disaster and Emergency Management Presidency). 2020. “T.C. İçişleri Bakanlığı Afet ve Acil Durum Yönetimi Başkanlığı.” Accessed February 3, 2021. https://www.afad.gov.tr/kurumlar/afad.gov.tr/35429/xfiles/turkiye_de_afetler.pdf.
Bergstra, J., and Y. Bengio. 2012. “Random search for hyper-parameter optimization.” J. Mach. Learn. Res. 13 (10): 281–305.
Boser, B. E., T. B. Laboratories, I. M. Guyon, and V. N. Vapnik. 1992. “A training algorithm for optimal margin classifiers.” In Proc., 5th Annual Workshop on Computational Learning Theory, 144–152. New York: Association for Computing Machinery.
Breiman, L. 2001. “Random forests.” Mach. Learn. 45 (1): 5–32. https://doi.org/10.1023/A:1010933404324.
Danandeh, A., E. Kahya, and C. Yerdelen. 2014. “Computers & geosciences linear genetic programming application for successive-station monthly stream flow prediction.” Comput. Geosci. 70 (Sep): 63–72. https://doi.org/10.1016/j.cageo.2014.04.015.
Danandeh Mehr, A., V. Nourani, V. Karimi Khosrowshahi, and M. A. Ghorbani. 2019. “A hybrid support vector regression–firefly model for monthly rainfall forecasting.” Int. J. Environ. Sci. Technol. 16 (1): 335–346. https://doi.org/10.1007/s13762-018-1674-2.
Dance, S. L., et al. 2019. “Improvements in forecasting intense rainfall: Results from the FRANC (Forecasting Rainfall exploiting new data Assimilation techniques and Novel observations of Convection) project.” Atmosphere 10 (3): 125. https://doi.org/10.3390/atmos10030125.
Dao, T., C. De Sa, and C. Ré. 2017. “Gaussian quadrature for kernel features.” Adv. Neural Inf. Process. Syst. 176 (3): 139–148. https://doi.org/10.1016/j.physbeh.2017.03.040.
Delleur, J. W., and M. L. Kavvas. 1978. “Stochastic models for monthly rainfall forecasting and synthetic generation.” J. Appl. Meteorol. Climatol. 17 (10): 1528–1536. https://doi.org/10.1175/1520-0450(1978)017%3C1528:SMFMRF%3E2.0.CO;2.
Diez-Sierra, J., and M. del Jesus. 2020. “Long-term rainfall prediction using atmospheric synoptic patterns in semi-arid climates with statistical and machine learning methods.” J. Hydrol. 586 (Mar): 124789. https://doi.org/10.1016/j.jhydrol.2020.124789.
Elyan, E., and M. M. Gaber. 2017. “A genetic algorithm approach to optimising random forests applied to class engineered data.” Inf. Sci. 384 (Apr): 220–234. https://doi.org/10.1016/j.ins.2016.08.007.
Eswaran, C., and R. Logeswaran. 2012. “A dual hybrid forecasting model for support of decision making in healthcare management.” Adv. Eng. Software 53 (Nov): 23–32. https://doi.org/10.1016/j.advengsoft.2012.07.006.
Falkner, S., A. Klein, and F. Hutter. 2018. “BOHB: Robust and efficient hyperparameter optimization at scale.” In Proc., Int. Conf. on Machine Learning, 1437–1446. Cambridge, MA: Proceedings of Machine Learning Research.
Fan, F. M., W. Collischonn, K. J. Quiroz, M. V. Sorribas, D. C. Buarque, and V. A. Siqueira. 2016. “Flood forecasting on the Tocantins River using ensemble rainfall forecasts and real-time satellite rainfall estimates.” J. Flood Risk Manage. 9 (3): 278–288. https://doi.org/10.1111/jfr3.12177.
Feng, Q., X. Wen, and J. Li. 2014. “Wavelet analysis-support vector machine coupled models for monthly rainfall forecasting in arid regions.” Water Resour. Manage. 29 (4): 1049–1065. https://doi.org/10.1007/s11269-014-0860-3.
Feng, Z. K., and W. J. Niu. 2021. “Hybrid artificial neural network and cooperation search algorithm for nonlinear river flow time series forecasting in humid and semi-humid regions.” Knowledge-Based Syst. 211 (Jan): 106580. https://doi.org/10.1016/j.knosys.2020.106580.
Flake, G. 1999. “Support vector machines for regression problems with sequential minimal optimization.” In Proc., Conf. Neural Information Processing Systems, 435–441. Cambridge, MA: MIT Press.
Fu, X., and L. Wang. 2003. “Data dimensionality reduction with application to simplifying RBF network structure and improving classification performance.” IEEE Trans. Syst. Man Cybern. Part B Cybern. 33 (3): 399–409. https://doi.org/10.1109/TSMCB.2003.810911.
Gajera, V., R. Gupta, and P. K. Jana. 2017. “An effective multi-objective task scheduling algorithm using min-max normalization in cloud computing.” In Proc., 2016 2nd Int. Conf. on Applied and Theoretical Computing and Communication Technology (iCATccT), 812–816. New York: IEEE.
Ghorbani, M. A., R. C. Deo, Z. M. Yaseen, M. H. Kashani, and B. Mohammadi. 2018a. “Pan evaporation prediction using a hybrid multilayer perceptron-firefly algorithm (MLP-FFA) model: Case study in north Iran.” Theor. Appl. Climatol. 133 (3–4): 1119–1131. https://doi.org/10.1007/s00704-017-2244-0.
Ghorbani, M. A., R. Kazempour, K. W. Chau, S. Shamshirband, and P. T. Ghazvinei. 2018b. “Forecasting pan evaporation with an integrated artificial neural network quantum-behaved particle swarm optimization model: A case study in Talesh, northern Iran.” Eng. Appl. Comput. Fluid Mech. 12 (1): 724–737. https://doi.org/10.1080/19942060.2018.1517052.
Ghorbani, M. A., S. Shamshirband, D. Zare Haghi, A. Azani, H. Bonakdari, and I. Ebtehaj. 2017. “Application of firefly algorithm-based support vector machines for prediction of field capacity and permanent wilting point.” Soil Tillage Res. 172 (May): 32–38. https://doi.org/10.1016/j.still.2017.04.009.
Haidar, A., and B. Verma. 2018. “Monthly rainfall forecasting using one-dimensional deep convolutional neural network.” IEEE Access 6 (Nov): 69053–69063. https://doi.org/10.1109/ACCESS.2018.2880044.
Hong, W.-C. 2011. “Electric load forecasting by seasonal recurrent SVR (support vector regression) with chaotic artificial bee colony algorithm.” Energy 36 (9): 5568–5578. https://doi.org/10.1016/j.energy.2011.07.015.
Hutter, F., H. Hoos, and K. Leyton-Brown. 2011. “Bayesian optimization with censored response data.” In NIPS 2011 Work. Bayesian Optim. Seq. Exp. Des. Bandits, 1–5. Spain: Neural Information Processing Systems Foundation.
Hyndman, R. J., and G. Athanasopoulos. 2018. Forecasting: Principles & practice. 2nd ed. Melbourne, Australia: OTexts.
Javad, M., M. Reza, O. Kisi, and V. Nourani. 2017. “A new approach for simulating and forecasting the rainfall-runoff process within the next two months.” J. Hydrol. 548 (May): 588–597. https://doi.org/10.1016/j.jhydrol.2017.03.032.
Karaboga, D., and B. Akay. 2009. “A comparative study of artificial bee colony algorithm.” Appl. Math. Comput. 214 (1): 108–132. https://doi.org/10.1016/j.amc.2009.03.090.
Karaboga, D., and B. Basturk. 2007. “A powerful and efficient algorithm for numerical function optimization: Artificial bee colony (ABC) algorithm.” J. Global Optim. 39 (3): 459–471. https://doi.org/10.1007/s10898-007-9149-x.
Karaboğa, D. 2005. An idea based on honey bee swarm for numerical optimization. Tech. Rep. No. TR06. Talas, Türkiye: Erciyes Univ.
Karasuyama, M., and I. Takeuchi. 2010. “Nonlinear regularization path for the modified Huber loss support vector machines.” In Proc., 2010 Int. Joint Conf. on Neural Networks (IJCNN), 1–8. New York: IEEE. https://doi.org/10.1109/IJCNN.2010.5596869.
Kashiwao, T., K. Nakayama, S. Ando, K. Ikeda, M. Lee, and A. Bahadori. 2017. “A neural network-based local rainfall prediction system using meteorological data on the Internet: A case study using data from the Japan Meteorological Agency.” Appl. Soft Comput. J. 56 (Jul): 317–330. https://doi.org/10.1016/j.asoc.2017.03.015.
Kaushik, I., and S. Singh. 2008. “Seasonal ARIMA model for forecasting of monthly rainfall and temperature.” J. Environ. Res. Dev. 3 (2): 506–514.
Li, P.-C., F. Zhang, L. Gao, Y.-Q. Liu, and X.-Y. Ren. 2021. “A novel model for chaotic complex time series with large of data forecasting.” Knowledge-Based Syst. 222 (Jun): 107009. https://doi.org/10.1016/j.knosys.2021.107009.
Lin, G. F., Y. C. Chou, and M. C. Wu. 2013. “Typhoon flood forecasting using integrated two-stage support vector machine approach.” J. Hydrol. 486 (Apr): 334–342. https://doi.org/10.1016/j.jhydrol.2013.02.012.
Mehr, A. D., M. Jabarnejad, and V. Nourani. 2019. “Pareto-optimal MPSA-MGGP: A new gene-annealing model for monthly rainfall forecasting.” J. Hydrol. 571 (Feb): 406–415. https://doi.org/10.1016/j.jhydrol.2019.02.003.
Mekanik, F., M. A. Imteaz, S. Gato-Trinidad, and A. Elmahdi. 2013. “Multiple regression and artificial neural network for long-term rainfall forecasting using large scale climate modes.” J. Hydrol. 503 (Oct): 11–21. https://doi.org/10.1016/j.jhydrol.2013.08.035.
Mekanik, F., M. A. Imteaz, and A. Talei. 2016. “Seasonal rainfall forecasting by adaptive network-based fuzzy inference system (ANFIS) using large scale climate signals.” Clim. Dyn. 46 (9–10): 3097–3111. https://doi.org/10.1007/s00382-015-2755-2.
Moazenzadeh, R., B. Mohammadi, S. Shamshirband, and K. W. Chau. 2018. “Coupling a firefly algorithm with support vector regression to predict evaporation in northern Iran.” Eng. Appl. Comput. Fluid Mech. 12 (1): 584–597. https://doi.org/10.1080/19942060.2018.1482476.
Mortazavi, A. 2021. “Bayesian interactive search algorithm: A new probabilistic swarm intelligence tested on mathematical and structural optimization problems.” Adv. Eng. Software 155 (Mar): 102994. https://doi.org/10.1016/j.advengsoft.2021.102994.
Ouyang, Q., W. Lu, X. Xin, Y. Zhang, W. Cheng, and T. Yu. 2016. “Monthly rainfall forecasting using EEMD-SVR based on phase-space reconstruction.” Water Resour. Manage. 30 (7): 2311–2325. https://doi.org/10.1007/s11269-016-1288-8.
Qin, J. 2017. “Wind power forecasting model based on artificial bee colony algorithm and support vector machine under the influence of climate change.” Boletín Técnico. 55 (9): 693–700.
Rodriguez-Galiano, V., M. P. Mendes, M. J. Garcia-Soldado, M. Chica-Olmo, and L. Ribeiro. 2014. “Predictive modeling of groundwater nitrate pollution using random forest and multisource variables related to intrinsic and specific vulnerability: A case study in an agricultural setting (southern Spain).” Sci. Total Environ. 476 (Apr): 189–206. https://doi.org/10.1016/j.scitotenv.2014.01.001.
Roozbahani, R., B. Abbasi, S. Schreider, and Z. Hosseinifard. 2020. “A basin-wide approach for water allocation and dams location-allocation.” Ann. Oper. Res. 287 (1): 323–349. https://doi.org/10.1007/s10479-019-03345-5.
Samsudin, R., A. Shabri, and P. Saad. 2010. “A comparison of time series forecasting using support vector machine and artificial neural network model.” J. Appl. Sci. 10 (11): 950–958. https://doi.org/10.3923/jas.2010.950.958.
Santamaría-Bonfil, G., A. Reyes-Ballesteros, and C. Gershenson. 2016. “Wind speed forecasting for wind farms: A method based on support vector regression.” Renewable Energy 85 (Jan): 790–809. https://doi.org/10.1016/j.renene.2015.07.004.
Singh, P. 2018. “Indian summer monsoon rainfall (ISMR) forecasting using time series data: A fuzzy-entropy-neuro based expert system.” Geosci. Front. 9 (4): 1243–1257. https://doi.org/10.1016/j.gsf.2017.07.011.
Snoek, J., H. Larochelle, and R. P. Adams. 2012. “Practical Bayesian optimization of machine learning algorithms.” Adv. Neural Inf. Process. Syst. 4 (Apr): 2951–2959.
Subasi, O., S. Di, L. Bautista-Gomez, P. Balaprakash, O. Unsal, J. Labarta, A. Cristal, and F. Cappello. 2016. “Spatial support vector regression to detect silent errors in the exascale era.” In Proc., 2016 16th IEEE/ACM Int. Symp. on Cluster, Cloud and Grid Computing (CCGrid), 413–424. New York: IEEE. https://doi.org/10.1109/CCGrid.2016.33.
Tan, M., X. Song, X. Yang, and Q. Wu. 2015. “Support-vector-regression machine technology for total organic carbon content prediction from wireline logs in organic shale: A comparative study.” J. Nat. Gas Sci. Eng. 26 (Sep): 792–802. https://doi.org/10.1016/j.jngse.2015.07.008.
Taylor, K. E. 2001. “Summarizing multiple aspects of model performance in a single diagram.” J. Geophys. Res. 106 (D7): 7183–7192. https://doi.org/10.1029/2000JD900719.
Uzlu, E., A. Akpinar, H. T. Özturk, S. Nacar, and M. Kankal. 2014. “Estimates of hydroelectric generation using neural networks with the artificial bee colony algorithm for Turkey.” Energy 69 (May): 638–647. https://doi.org/10.1016/j.energy.2014.03.059.
Valipour, M. 2016. “How much meteorological information is necessary to achieve reliable accuracy for rainfall estimations?” Agriculture 6 (4): 53. https://doi.org/10.3390/agriculture6040053.
Vapnik, V. N. 1998. Statistical learning theory. New York: Wiley.
Weintraub, A. P., R. Epstein, G. Murphy, and B. Manley. 2000. “The impact of environmental constraints on short term harvesting: Use of planning tools and mathematical models.” Ann. Oper. Res. 95 (1–4): 41–66. https://doi.org/10.1023/A:1018966511108.
Wen, T., and A. Edelman. 2000. “Support vector machine Lagrange multipliers and simplex volume decompositions.” SIAM J. Matrix Anal. Appl. 21 (1): 1–32.
Willmott, C., and K. Matsuura. 2005. “Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance.” Clim. Res. 30 (1): 79. https://doi.org/10.3354/cr030079.
Wu, J., J. Long, and M. Liu. 2015. “Evolving RBF neural networks for rainfall prediction using hybrid particle swarm optimization and genetic algorithm.” Neurocomputing 148 (Jan): 136–142. https://doi.org/10.1016/j.neucom.2012.10.043.
Xue, Y., J. Jiang, B. Zhao, and T. Ma. 2018. “A self-adaptive artificial bee colony algorithm based on global best for global optimization.” Soft Comput. 22 (9): 2935–2952. https://doi.org/10.1007/s00500-017-2547-1.
Yang, Z., Y. Che, and K. W. E. Cheng. 2007. “Genetic algorithm-based RBF neural network load forecasting model.” In Proc., 2007 IEEE Power Engineering Society General Meeting, 1–6. New York: IEEE. https://doi.org/10.1109/PES.2007.385710.
Yaseen, Z. M., M. I. Ghareb, I. Ebtehaj, H. Bonakdari, R. Siddique, S. Heddam, A. A. Yusif, and R. Deo. 2018. “Rainfall pattern forecasting using novel hybrid intelligent model based ANFIS-FFA.” Water Resour. Manage. 32 (1): 105–122. https://doi.org/10.1007/s11269-017-1797-0.
Yu, H., and J. Yu. 2005. “A modified SMO algorithm for SVM regression and its application in quality prediction of HP-LDPE.” In Proc., Int. Conf. on Natural Computation, Berlin: Springer.
Zhang, P., Y. Jia, J. Gao, W. Song, and H. Leung. 2018. “Short-term rainfall forecasting using multi-layer perceptron.” IEEE Trans. Big Data 6 (1): 93–106. https://doi.org/10.1109/TBDATA.2018.2871151.
Information & Authors
Information
Published In
Journal of Hydrologic Engineering
Volume 28 • Issue 11 • November 2023
Copyright
© 2023 American Society of Civil Engineers.
History
Received: Nov 20, 2022
Accepted: Jun 28, 2023
Published online: Aug 23, 2023
Published in print: Nov 1, 2023
Discussion open until: Jan 23, 2024
ASCE Technical Topics:
- Algorithms
- Analysis (by type)
- Engineering fundamentals
- Forecasting
- Hybrid methods
- Hydrologic engineering
- Hydrologic models
- Hydrology
- Mathematics
- Methodology (by type)
- Models (by type)
- Parameters (statistics)
- Regression analysis
- Statistical analysis (by type)
- Statistics
- Time series analysis
- Water and water resources
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.