Evaluating Transition Probabilities for a Stochastic Dynamic Programming Model Used in Water System Optimization
Publication: Journal of Water Resources Planning and Management
Volume 144, Issue 2
Abstract
Stochastic dynamic programming is one of the most widely used optimization techniques for water system optimization. In this study, four methods for estimating transition probabilities have been evaluated to determine how they influence water system performance for short-term operating policies. The methods are counting, ordinary least-squares regression, robust linear model regression and multivariate conditional distribution. Two discretization schemes—equal-width interval and equal-frequency and data transformation—have also been included in the study as sources of uncertainty. The study was carried out for three water systems: the Outardes River, Manicouagan River, and Lac Saint-Jean, located in Quebec, Canada. The results show that the water system configuration played a significant role in the performance of the transition probabilities. The discretization scheme and data transformation had a considerable influence on the counting and regression methods, whereas they had less of an impact on the multivariate conditional distribution. The robust linear models with equal-frequency discretization without data transformation gave satisfactory results for all the water systems.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
The authors thank Dr. Grégory Emiel from Hydro Québec for providing useful comments. The Natural Sciences and Engineering Research Council of Canada’s Collaborative Research and Development program funded this study.
References
Anvari, S., Mousavi, S. J., and Morid, S. (2014). “Sampling/stochastic dynamic programming for optimal operation of multi-purpose reservoirs using artificial neural network-based ensemble streamflow predictions.” J. Hydroinf., 16(4), 907.
Côté, P., Haguma, D., Leconte, R., and Krau, S. (2011). “Stochastic optimisation of Hydro-Quebec hydropower installations: A statistical comparison between SDP and SSDP methods.” Can. J. Civ. Eng., 38(12), 1427–1434.
Davidsen, C., Pereira-Cardenal, S. J., Liu, S., Mo, X., Rosbjerg, D., and Bauer-Gottwein, P. (2015). “Using stochastic dynamic programming to support water resources management in the Ziya River Basin, China.” J. Water Resour. Plann. Manage., 4014086.
Desreumaux, Q., Côté, P., and Leconte, R. (2014). “Role of hydrologic information in stochastic dynamic programming: A case study of the Kemano hydropower system in British Columbia.” Can. J. Civ. Eng., 41(9), 839–844.
Faber, B. A., and Stedinger, J. R. (2001). “Reservoir optimization using sampling SDP with ensemble streamflow prediction (ESP) forecasts.” J. Hydrol., 249(1–4), 113–133.
Huber, P. J., and Ronchetti, E. M. (2009). Robust statistics, Wiley, Hoboken, NJ.
Karamouz, M., and Vasiliadis, H. V. (1992). “Bayesian stochastic optimization of reservoir operation using uncertain forecasts.” Water Resour. Res., 28(5), 1221–1232.
Kim, Y.-O., Lee, E.-G., Eum, H.-I., and Ko, I. H. (2007). “Optimizing operational policies of a Korean multireservoir system using sampling stochastic dynamic programming with ensemble streamflow prediction.” J. Water Resour. Plann. Manage., 4–14.
Kotz, S., Balakrishnan, N., and Johnson, N. L. (2000). Continuous multivariate distributions, Wiley, Hoboken, NJ.
Kroll, C. N., and Stedinger, J. R. (1998). “Regional hydrologic analysis: Ordinary and generalized least squares revisited.” Water Resour. Res., 34(1), 121–128.
Labadie, J. W. (2004). “Optimal operation of multireservoir systems: State-of-the-art review.” J. Water Resour. Plann. Manage., 93–111.
Lee, Y., Kim, S.-K., and Ko, I. H. (2008). “Multistage stochastic linear programming model for daily coordinated multi-reservoir operation.” J. Hydroinf., 10(1), 23.
Mirza, M. J., and Boyer, K. L. (1993). “Performance evaluation of a class of M-estimators for surface parameter estimation in noisy range data.” IEEE Trans. Robotics Autom., 9(1), 75–85.
Stedinger, J. R., Faber, B. A., Lamontagne, J. R., and Lomantagne, J. R. (2013). “Developments in stochastic dynamic programming for reservoir operation optimization.” World Environmental and Water Resources Congress 2013, ASCE, Reston, VA, 1266–1278.
Stedinger, J. R., Sule, B. F., and Loucks, D. P. (1984). “Stochastic dynamic programming models for reservoir operation optimization.” Water Resour. Res., 20(11), 1499–1505.
Tejada-Guibert, J. A., Johnson, S. A., and Stedinger, J. R. (1993). “Comparison of two approaches for implementing multireservoir operating policies derived using stochastic dynamic programming.” Water Resour. Res., 29(12), 3969–3980.
Tejada-Guibert, J. A., Johnson, S. A., and Stedinger, J. R. (1995). “The value of hydrologic information in stochastic dynamic programming models of a multireservoir system.” Water Resour. Res., 31(10), 2571–2579.
Turgeon, A. (2005). “Solving a stochastic reservoir management problem with multilag autocorrelated inflows.” Water Resour. Res., 41(12), W12414.
Turgeon, A. (2007). “Stochastic optimization of multireservoir operation: The optimal reservoir trajectory approach.” Water Resour. Res., 43(5), 1–10.
Zhao, T., Zhao, J., and Yang, D. (2014). “Improved dynamic programming for hydropower reservoir operation.” J. Water Resour. Plann. Manage., 365–374.
Information & Authors
Information
Published In
Journal of Water Resources Planning and Management
Volume 144 • Issue 2 • February 2018
Copyright
©2017 American Society of Civil Engineers.
History
Received: Feb 27, 2017
Accepted: Aug 7, 2017
Published online: Dec 8, 2017
Published in print: Feb 1, 2018
Discussion open until: May 8, 2018
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.