Development of Precipitation Forecast Model Based on Artificial Intelligence and Subseasonal Clustering
Publication: Journal of Hydrologic Engineering
Volume 24, Issue 12
Abstract
Forecasting precipitation remains challenging because of its large spatial and temporal variability, and the uncertainty in precipitation forecast leads to an important source of uncertainty in the prediction of other components of a hydrological system. In this study, in order to forecast subseasonal precipitation and better characterize the temporal variability of precipitation, a hybrid precipitation forecast model was developed based on (1) temporal clustering of subseasonal precipitation; and (2) coupling an improved seasonal autoregressive integrated moving average (ISARIMA) model to an artificial neural network (ANN) model to take the advantages of both models and capture precipitation persistence and statistics in each cluster. The performance of the proposed model was compared against different variations of conventional statistical models in the Rasht station with a humid climate and Gorgan station with a Mediterranean climate, both located south of the Caspian Sea in northern Iran. The model evaluation criteria indicated that the hybrid model can remarkably improve forecast accuracy. The root-mean square error score of the forecasted precipitation by the hybrid model against observations decreased 48% and 24% in the Rasht and Gorgan stations, respectively, when compared with the seasonal autoregressive integrated moving average (SARIMA) model and the index of agreement increased 32% and 17%, respectively, when compared with the ANN models. The proposed hybrid model can be a useful tool for forecasting subseasonal precipitation in humid and arid climates with persistent and nonpersistent precipitation patterns.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
The research was funded by Azarbaijan Shahid Madani University. Kabir Rasouli was supported by the Natural Sciences and Engineering Research Council, NSERC’s Postdoctoral fellowship. The manuscript benefitted from the comments and suggestions of the editor and the anonymous reviewers on a previous version.
References
Adamowski, J., and C. Karapataki. 2010. “Comparison of multivariate regression and artificial neural networks for peak urban water-demand forecasting: Evaluation of different ANN learning algorithms.” J. Hydrol. Eng. 15 (10): 729–743. https://doi.org/10.1061/(ASCE)HE.1943-5584.0000245.
Belgaman, H. A., K. Ichiyanagi, R. Suwarman, M. Edvin Aldrian, A. I. D. Utami, and D. A. Kusumaningtyas. 2017. “Characteristics of seasonal precipitation isotope variability in Indonesia.” Hydrol. Res. Lett. 11 (2): 92–98. https://doi.org/10.3178/hrl.11.92.
Bezdek, J. C. 1981. Pattern recognition with fuzzy objective function algorithms. New York: Plenum Press.
Blashfield, R. K. 1976. “Mixture model tests of cluster analysis: Accuracy of four agglomerative hierarchical methods.” Psychol. Bull. 83 (3): 377–388. https://doi.org/10.1037/0033-2909.83.3.377.
Box, G. E. P., and G. M. Jenkins. 1976. Times series analysis-forecasting and control. Englewood Cliffs, NJ: Prentice-Hall.
Caesar, L. K., O. M. Kvalheim, and N. B. Cech. 2018. “Hierarchical cluster analysis of technical replicates to identify interferents in untargeted mass spectrometry metabolomics.” Anal. Chim. Acta 1021 (Aug): 69–77. https://doi.org/10.1016/j.aca.2018.03.013.
Cannon, A. J., S. R. Sobie, and T. Q. Murdock. 2015. “Bias correction of GCM precipitation by quantile mapping: How well do methods preserve changes in quantiles and extremes?” J. Clim. 28 (17): 6938–6959. https://doi.org/10.1175/JCLI-D-14-00754.1.
Carter, G. M., J. P. Dallavalle, and H. R. Glahn. 1989. “Statistical forecasts based on the National Meteorological Center’s numerical weather prediction system.” Weather Forecasting 4 (3): 401–412. https://doi.org/10.1175/1520-0434(1989)004%3C0401:SFBOTN%3E2.0.CO;2.
Chang, X., M. Gao, Y. Wang, and X. Hou. 2012. “Seasonal autoregressive integrated moving average model for precipitation time series.” J. Math. Stat. 8 (4): 500–505. https://doi.org/10.3844/jmssp.2012.500.505.
Chen, K. Y., and C. H. Wang. 2007. “A hybrid SARIMA and support vector machines in forecasting the production values of the machinery industry in Taiwan.” Expert Syst. Appl. 32 (1): 254–264. https://doi.org/10.1016/j.eswa.2005.11.027.
Coles, A. E., B. G. McConkey, and J. J. McDonnell. 2017. “Climate change impacts on hillslope runoff on the northern Great Plains, 1962-2013.” J. Hydrol. 550 (Jul): 538–548. https://doi.org/10.1016/j.jhydrol.2017.05.023.
Dabral, P. P., and M. Z. Murry. 2017. “Modelling and forecasting of rainfall time series using SARIMA.” Environ. Processes 4 (2): 399–419. https://doi.org/10.1007/s40710-017-0226-y.
Eni, D., and F. J. Adeyeye. 2015. “Seasonal ARIMA modeling and forecasting of rainfall in Warri Town, Nigeria.” J. Geosci. Environ. Prot. 3 (6): 91–98. https://doi.org/10.4236/gep.2015.36015.
Eszergár-Kiss, D., and B. Caesar. 2017. “Definition of user groups applying Ward’s method.” Transp. Res. Procedia 22: 25–34. https://doi.org/10.1016/j.trpro.2017.03.004.
Farrelly, C. M., S. J. Schwartz, A. L. Amodeo, D. J. Feaster, D. L. Steinley, A. Meca, and S. Picariello. 2017. “The analysis of bridging constructs with hierarchical clustering methods: An application to identity.” J. Res. Personality 70 (Oct): 93–106. https://doi.org/10.1016/j.jrp.2017.06.005.
Fekete, B. M., C. J. Vörösmarty, J. O. Roads, and C. J. Willmott. 2004. “Uncertainties in precipitation and their impacts on runoff estimates.” J. Clim. 17 (2): 294–304. https://doi.org/10.1175/1520-0442(2004)017%3C0294:UIPATI%3E2.0.CO;2.
Glahn, H. R., and D. A. Lowry. 1972. “The use of model output statistics (MOS) in objective weather forecasting.” J. Appl. Meteorol. 11 (8): 1203–1211. https://doi.org/10.1175/1520-0450(1972)011%3C1203:TUOMOS%3E2.0.CO;2.
Hamidi, O., J. Poorolajal, M. Sadeghifar, H. Abbasi, Z. Maryanaji, H. R. Faridi, and L. Tapak. 2015. “A comparative study of support vector machines and artificial neural network for predicting precipitation in Iran.” Theor. Appl. Climatol. 119 (3–4): 723–731. https://doi.org/10.1007/s00704-014-1141-z.
Hamill, T. M., and J. S. Whitaker. 2006. “Probabilistic quantitative precipitation forecasts based on reforecast analogs: Theory and application.” Mon. Weather Rev. 134 (11): 3209–3229. https://doi.org/10.1175/MWR3237.1.
Hands, S., and B. Everitt. 1987. “A Monte Carlo study of the recovery of cluster structure in binary data by hierarchical clustering techniques.” Multivariate Behav. Res. 22 (2): 235–243. https://doi.org/10.1207/s15327906mbr2202_6.
Hirsch, R. M., and J. R. Slack. 1984. “A nonparametric trend test for seasonal data with serial dependence.” Water Resour. Res. 20 (6): 727–732. https://doi.org/10.1029/WR020i006p00727.
Huesca, M., J. Litago, S. Merino-de-Miguel, V. Cicuendez-López-Ocaña, and A. Palacios-Orueta. 2014. “Modeling and forecasting MODIS-based fire potential index on a pixel basis using time series models.” Int. J. Appl. Earth Obs. Geoinf. 26 (Feb): 363–376. https://doi.org/10.1016/j.jag.2013.09.003.
Hung, N. Q., M. S. Babel, S. Weesakul, and N. K. Tripathi. 2009. “An artificial neural network model for rainfall forecasting in Bangkok, Thailand.” Hydrol. Earth Syst. Sci. 13 (8): 1413–1425. https://doi.org/10.5194/hess-13-1413-2009.
Jain, A. K., and R. C. Dubes. 1998. Algorithms for clustering data. Upper Saddle River, NJ: Prentice-Hall.
Jiang, B., S. Liang, W. Jindi, and Z. Xiao. 2010. “Modeling MODIS LAI time series using three statistical methods.” Remote Sens. Environ. 114 (7): 1432–1444. https://doi.org/10.1016/j.rse.2010.01.026.
Karamouz, M., K. Rasouli, and S. Nazif. 2009. “Development of a hybrid index for drought prediction: Case study.” J. Hydrol. Eng. 14 (6): 617–627. https://doi.org/10.1061/(ASCE)HE.1943-5584.0000022.
Kendall, M. G. 1975. Rank correlation methods. London: Griffin.
Kohonene, T. 1989. Self-organization and associative memory. New York: Springer.
Koppen, W. 1936. Das geographische system der climate. Berlin: Gebrüder Borntraeger.
Kumar Nanda, S., D. P. Tripathy, S. Kumar Nayak, and S. Mohapatra. 2013. “Prediction of rainfall in India using artificial neural network (ANN) models.” Int. J. Intell. Syst. Appl. 5 (12): 1–22. https://doi.org/10.5815/ijisa.2013.12.01.
Lee, N. U., J. S. Shim, Y. W. Ju, and S. C. Park. 2018. “Design and implementation of the SARIMA-SVM time series analysis algorithm for the improvement of atmospheric environment forecast accuracy.” Soft Comput. 22 (13): 4275–4281. https://doi.org/10.1007/s00500-017-2825-y.
LIoyd, S. 1982. “Least squares quantization in PCM.” IEEE Trans. Inf. Theory 28 (2): 129–137. https://doi.org/10.1109/TIT.1982.1056489.
Mann, H. B. 1945. “Nonparametric tests against trend.” Econometrcia 13 (3): 245–259. https://doi.org/10.2307/1907187.
Marzano, F. S., E. Fionda, and P. Ciotti. 2006. “Neural-network approach to ground-based passive microwave estimation of precipitation intensity and extinction.” J. Hydrol. 328 (1–2): 121–131. https://doi.org/10.1016/j.jhydrol.2005.11.042.
McCulloch, W. S., and W. Pitts. 1943. “A logical calculus of the ideas immanent in nervous activity.” Bull. Math. Biophys. 5 (4): 115–133. https://doi.org/10.1007/BF02478259.
Michalakes, J. 1999. Design of a next-generation regional weather research and forecast model. Lemont, IL: Argonne National Laboratory.
Mislan, K., M. Haviluddin, S. Hardwinarto, M. Sumaryono, and M. Aipassa. 2015. “Rainfall monthly prediction based on artificial neural network: A case study in Tenggarong station, east Kalimantan–Indonesia.” Procedia Comput. Sci. 59: 142–151. https://doi.org/10.1016/j.procs.2015.07.528.
Moeeni, H., and H. Bonakdari. 2017. “Forecasting monthly inflow with extreme seasonal variation using the hybrid SARIMA-ANN model.” Stochastic Environ. Res. Risk Assess. 31 (8): 1997–2010. https://doi.org/10.1007/s00477-016-1273-z.
Moeeni, H., H. Bonakdari, and I. Ebtehaj. 2017. “Integrated SARIMA with neuro-fuzzy systems and neural networks for monthly inflow prediction.” Water Resour. Manage. 31 (7): 2141–2156. https://doi.org/10.1007/s11269-017-1632-7.
Moustris, K. P., I. K. Larissi, P. T. Nastos, and A. G. Paliatsos. 2011. “Precipitation forecast using artificial neural networks in specific regions of Greece.” Water Resour. Manage. 25 (8): 1979–1993. https://doi.org/10.1007/s11269-011-9790-5.
Narasimha Murthy, K. V., R. Saravana, and K. Vijaya Kumar. 2018. “Modeling and forecasting rainfall patterns of southwest monsoons in north-east India as a SARIMA process.” Meteorol. Atmos. Phys. 130 (1): 99–106. https://doi.org/10.1007/s00703-017-0504-2.
Nascimento Camelo, H., P. Sérgio Lucio, J. Verçosa Leal Junior, D. Von Glehn dos Santos, and P. Cesar Marques de Carvalho. 2018. “Innovative hybrid modeling of wind speed prediction involving time-series models and artificial neural networks.” Atmosphere 9 (2): 77 https://doi.org/10.3390/atmos9020077.
Osarumwense, O. I. 2013. “Applicability of Box Jenkins SARIMA model in rainfall forecasting: A case study of Port-Harcourt south south Nigeria.” Can. J. Comput. Math. Nat. Sci. Eng. Med. 4 (1): 1–4.
Ouyang, Q., W. Lu, X. Xin, Y. Zhang, W. Cheng, and T. Yu. 2016. “Monthly rainfall forecasting using EEMD-SVR based on phase-space reconstruction.” Water Resour. Manage. 30 (7): 2311–2325. https://doi.org/10.1007/s11269-016-1288-8.
Ozozen, A., G. Kayakutlu, M. Ketterer, and O. Kayalica. 2016. “A combined seasonal ARIMA and ANN model for improved results in electricity spot price forecasting: Case study in Turkey.” In Proc. of PICMET ‘16: Technology Management for Social Innovation. New York: IEEE.
Pannakkong, W., V. H. Pham, and V. N. Huynh. 2016. “A hybrid model of ARIMA, ANNs and k-means clustering for time series forecasting.” In Vol. 9978 of Integrated uncertainty in knowledge modelling and decision making: IUKM 2016: Lecture notes in computer science, edited by V. N. Huynh, M. Inuiguchi, B. Le, and T. Denoeux, 195–206. Cham, Switzerland: Springer.
Rasouli, K., W. W. Hsieh, and J. A. Cannon. 2012. “Daily streamflow forecasting by machine learning methods with weather and climate inputs.” J. Hydrol. 414–415 (Jan): 284–293. https://doi.org/10.1016/j.jhydrol.2011.10.039.
Sarhadi, A., D. H. Burn, M. Concepción Ausín, and M. P. Wiper. 2016. “Time-varying nonstationary multivariate risk analysis using a dynamic Bayesian copula.” Water Resour. Res. 52 (3): 2327–2349. https://doi.org/10.1002/2015WR018525.
Sarkodie, S. A., and V. Strezov. 2018. “Assessment of contribution of Australia’s energy production to emissions and environmental degradation using statistical dynamic approach.” Sci. Total Environ. 639 (Oct): 888–899. https://doi.org/10.1016/j.scitotenv.2018.05.204.
Sfetsos, A., and C. Siriopoulos. 2004. “Combinatorial time series forecasting based on clustering algorithms and neural networks.” Neural Comput. Appl. 13 (1): 56–64. https://doi.org/10.1007/s00521-003-0391-y.
Slater, L. J., G. Villarini, A. A. Bradley, and G. A. Vecchi. 2017. “A dynamical statistical framework for seasonal streamflow forecasting in an agricultural watershed.” Clim. Dyn. 1–17. https://doi.org/10.1007/s00382-017-3794-7.
Soares dos Santos, T., D. Mendes, and R. Rodrigues Torres. 2016. “Artificial neural networks and multiple linear regression model using principal components to estimate rainfall over South America.” Nonlinear Processes Geophys. 23 (1): 13–20. https://doi.org/10.5194/npg-23-13-2016.
Somvanshi, V. K., O. P. Pandey, P. K. Agrawal, N. V. Kalankerl, M. R. Prakash, and C. Ramesh. 2006. “Modelling and prediction of rainfall using artificial neural network and ARIMA techniques.” J. Ind. Geophys. Union. 10 (2): 141–151.
Sulaiman, J., and S. H. Wahab. 2018. Heavy rainfall forecasting model using artificial neural network for flood prone area. New York: Springer.
Sun, H., and M. Koch. 2001. “Case study: Analysis and forecasting of salinity in Apalachicola bay, Florida, using Box-Jenkins ARIMA models.” J. Hydraul. Eng. 127 (9): 718–727. https://doi.org/10.1061/(ASCE)0733-9429(2001)127:9(718).
Tamilselvi, R., B. Sivasakthi, and R. Kavitha. 2015. “A comparison of various clustering methods and algorithms in data mining.” Int. J. Multidiscip. Res. Dev. 2 (5): 32–98.
Tealab, A., H. Hefny, and A. Badr. 2017. “Forecasting of nonlinear time series using ANN.” Future Comput. Inf. J. 2 (1): 39–47. https://doi.org/10.1016/j.fcij.2017.05.001.
Thornthwaite, C. W. 1948. “An approach toward a rational classification of climate.” Geogr. Rev. 38 (1): 55–94. https://doi.org/10.2307/210739.
Tosun, E., K. Aydin, and M. Bilgili. 2016. “Comparison of linear regression and artificial neural network model of a diesel engine fueled with biodiesel-alcohol mixtures.” Alexandria Eng. J. 55 (4): 3081–3089. https://doi.org/10.1016/j.aej.2016.08.011.
Valipour, M., M. E. Banihabib, and S. M. R. Behbahani. 2013. “Comparison of the ARMA, ARIMA, and the autoregressive artificial neural network models in forecasting the monthly inflow of Dez dam reservoir.” J. Hydrol. 476 (Jan): 433–441. https://doi.org/10.1016/j.jhydrol.2012.11.017.
Wang, H. R., C. Wang, X. Lin, and J. Kang. 2014. “An improved ARIMA model for precipitation simulations.” Nonlinear Processes Geophys. 21 (6): 1159–1168. https://doi.org/10.5194/npg-21-1159-2014.
Wang, P., and Y. Yao. 2018. “CE3: A three-way clustering method based on mathematical morphology.” Knowledge-Based Syst. 155 (Sep): 54–65. https://doi.org/10.1016/j.knosys.2018.04.029.
Wang, W. C., K. W. Chau, D. M. Xu, and X. Y. Chen. 2015. “Improving forecasting accuracy of annual runoff time series using ARIMA based on EEMD decomposition.” Water Resour. Manage. 29 (8): 2655–2675. https://doi.org/10.1007/s11269-015-0962-6.
Ward, J. H. 1963. “Hierarchical grouping to optimize an objective function.” J. Am. Stat. Assoc. 58 (301): 236–244. https://doi.org/10.1080/01621459.1963.10500845.
Willmott, C. J. 1981. “On the validation of models.” Phys. Geogr. 2 (2): 184–194. https://doi.org/10.1080/02723646.1981.10642213.
Yolcu, U., E. Egrioglu, and C. H. Aladag. 2013. “A new linear and nonlinear artificial neural network model for time series forecasting.” Decision Supp. Syst. 54 (3): 1340–1347. https://doi.org/10.1016/j.dss.2012.12.006.
Zeynoddin, M., H. Bonakdari, A. Azari, I. Ebtehaj, B. Gharabaghi, and H. R. Madavar. 2018. “Novel hybrid linear stochastic with non-linear extreme learning machine methods for forecasting monthly rainfall a tropical climate.” J. Environ. Manage. 222 (Sep): 190–206. https://doi.org/10.1016/j.jenvman.2018.05.072.
Zhang, F., Z. Zhang, P. Zhang, and S. Wang. 2018. “UD-HMM: An unsupervised method for shilling attack detection based on hidden Markov model and hierarchical clustering.” Knowledge-Based Syst. 148 (May): 146–166. https://doi.org/10.1016/j.knosys.2018.02.032.
Zhang, G. P. 2003. “Time series forecasting using a hybrid ARIMA and neural network model.” Neurocomputing 50 (Jan): 159–175. https://doi.org/10.1016/S0925-2312(01)00702-0.
Information & Authors
Information
Published In
Journal of Hydrologic Engineering
Volume 24 • Issue 12 • December 2019
Copyright
©2019 American Society of Civil Engineers.
History
Received: Apr 22, 2018
Accepted: Aug 5, 2019
Published online: Sep 28, 2019
Published in print: Dec 1, 2019
Discussion open until: Feb 28, 2020
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.