Efficient Metamodel Approach to Handling Constraints in Nonlinear Optimization for Drought Management
Publication: Journal of Water Resources Planning and Management
Volume 147, Issue 12
Abstract
Rapid and informed response is needed to ensure effective water management during droughts, including reliable and immediate data synthesis, near-real-time forecasting, and model-based decision support for water operations. A service-driven approach has been developed previously to couple river modeling and genetic algorithm (GA) optimization services for determining optimal water allocation strategies under daily drought scenarios. However, the computational effort in handling the constraints, which involves executing computationally intensive models repetitively, is a major obstacle to enabling an effective real-time Web application for decision support. The objective of this work is to develop a computationally efficient metamodel approach to reduce the computational burden of the simulation-optimization model. Two types of metamodels are developed: a pretrained metamodel that is built offline before the optimization and an adaptive metamodel that is built and updated during the optimization. The metamodel is a classifier algorithm that evaluates whether a constraint is satisfied, which simplifies the prediction and leverages the metamodel’s role in water management. The metamodel framework was tested for a drought event in the Upper Guadalupe River Basin, Texas, in April 2015 and the performance of the different approaches is compared. A conservative model, which narrows the feasible region by increasing the constraint probability threshold, is needed with the pretrained metamodel to ensure convergence to a feasible near-optimal solution, but not for the adaptive metamodel. The results also show that the adaptive metamodel GA performs best in model accuracy and reduces computation time by 58%, compared with the pretrained metamodel GA, which reduces computation time by 78% but does not reliably obtain the optimal solution. The approach also does not require users to select classifiers, tune parameters, or execute simulation models offline. Therefore, a prototype Web interface is implemented that uses the best-performing adaptive metamodel approach to more efficiently assist decision makers with real-time drought management.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or code used during the study were provided by a third party. Direct requests for these materials may be made to the provider as indicated in the “Acknowledgments.” The data used in this paper were provided by Kathy Alexander, Cindy Hooper, and others from the Texas Commission on Environmental Quality (TCEQ) and are not publicly available.
Acknowledgments
The authors are grateful to Kathy Alexander, Cindy Hooper, and others from the Texas Commission on Environmental Quality (TCEQ) for providing research data. The authors also acknowledge for Professor Halit Uster from Southern Methodist University reviewing the paper and providing helpful suggestions. This work was funded by Microsoft Research.
References
Beh, E. H., F. Zheng, G. C. Dandy, H. R. Maier, and Z. Kapelan. 2017. “Robust optimization of water infrastructure planning under deep uncertainty using metamodels.” Environ. Modell. Software 93 (Jul): 92–105. https://doi.org/10.1016/j.envsoft.2017.03.013.
Behzadian, K., Z. Kapelan, D. Savic, and A. Ardeshir. 2009. “Stochastic sampling design using a multi-objective genetic algorithm and adaptive neural networks.” Environ. Modell. Software 24 (4): 530–541. https://doi.org/10.1016/j.envsoft.2008.09.013.
Breiman, L., J. Friedman, C. J. Stone, and R. A. Olshen. 1984. Classification and regression trees. Boca Raton, FL: CRC Press.
Breiman, L., and P. Spector. 1992. “Submodel selection and evaluation in regression. The X-random case.” Int. Stat. Rev./Rev. Int. Statistique 60 (3): 291–319. https://doi.org/10.2307/1403680.
Cai, X., R. Zeng, W. H. Kang, J. Song, and A. J. Valocchi. 2015. “Strategic planning for drought mitigation under climate change.” J. Water Resour. Plann. Manage. 141 (9): 04015004. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000510.
Cortes, C., and V. Vapnik. 1995. “Support-vector networks.” Mach. Learn. 20 (3): 273–297. https://doi.org/10.1007/BF00994018.
Cunge, J. A. 1969. “On the subject of a flood propagation computation method (Musklngum method).” J. Hydraul. Res. 7 (2): 205–230. https://doi.org/10.1080/00221686909500264.
Cybenko, G. 1989. “Approximation by superpositions of a sigmoidal function.” Math. Control Signals Syst. 2 (4): 303–314. https://doi.org/10.1007/BF02551274.
David, C. H. 2015. “RAPID I/O files.” Accessed January 21, 2015. http://rapid-hub.org/docs/RAPID_IO_files.pdf.
David, C. H., D. R. Maidment, G.-Y. Niu, Z.-L. Yang, F. Habets, and V. Eijkhout. 2011. “River network routing on the NHDPlus dataset.” J. Hydrometeorol. 12 (5): 913–934. https://doi.org/10.1175/2011JHM1345.1.
Deb, K. 2000. “An efficient constraint handling method for genetic algorithms.” Comput. Methods Appl. Mech. Eng. 186 (2–4): 311–338. https://doi.org/10.1016/S0045-7825(99)00389-8.
Dietterich, T. G. 2000. “Ensemble methods in machine learning.” In Proc., Int. Workshop on Multiple Classifier Systems, 1–15. Berlin: Springer.
Eusuff, M., K. Lansey, and F. Pasha. 2006. “Shuffled frog-leaping algorithm: A memetic meta-heuristic for discrete optimization.” Eng. Optim. 38 (2): 129–154. https://doi.org/10.1080/03052150500384759.
Gu, J., G. Y. Li, and Z. Dong. 2009. “Hybrid and adaptive metamodel based global optimization.” In Vol. 49026 of Proc., Int. Design Engineering Technical Conf. and Computers and Information in Engineering Conf., 751–765. Abingdon, UK: Taylor & Francis.
Haykin, S., and N. Network. 2004. “A comprehensive foundation.” Neural Networks 2 (2004): 41.
Hecht-Nielsen, R. 1992. “Theory of the backpropagation neural network.” In Neural networks for perception, 65–93. Cambridge, MA: Academic Press.
Hosmer, D. W., B. Jovanovic, and S. Lemeshow. 1989. “Best subsets logistic regression.” Biometrics 45 (4): 1265–1270. https://doi.org/10.2307/2531779.
Hsu, C. W., C. C. Chang, and C. J. Lin. 2003. A practical guide to support vector classification. Berlin: Springer.
Johansen, S., and K. Juselius. 1990. “Maximum likelihood estimation and inference on cointegration—With applications to the demand for money.” Oxford Bull. Econ. Stat. 52 (2): 169–210. https://doi.org/10.1111/j.1468-0084.1990.mp52002003.x.
Johnson, V. M., and L. L. Rogers. 2000. “Accuracy of neural network approximators in simulation-optimization.” J. Water Resour. Plann. Manage. 126 (2): 48–56. https://doi.org/10.1061/(ASCE)0733-9496(2000)126:2(48).
Kohavi, R. 1995. “A study of cross-validation and bootstrap for accuracy estimation and model selection.” Ijcai 14 (2): 1137–1145.
Kooper, R. 2014. “DataWolf.” Accessed October 13, 2015. https://opensource.ncsa.illinois.edu/projects/WOLF.
Kratica, J. 1999. “Improving performances of the genetic algorithm by caching.” Comput. Inf. 18 (3): 271–283.
L’Oreal Stepney, P. E. 2012. “Issues for the 83rd legislative session.” Accessed January 17, 2015. https://ftp.weat.org/govt/2012HorizonLOreal_presentation.pdf.
Maier, H. R., et al. 2014. “Evolutionary algorithms and other metaheuristics in water resources: Current status, research challenges and future directions.” Environ. Modell. Software 62 (2): 271–299. https://doi.org/10.1016/j.envsoft.2014.09.013.
McCarthy, G. T. 1938. “The unit hydrograph and flood routing.” In Proc., Conf. of North Atlantic Division, 608–609. Washington, DC: USACE.
McHenry, K., R. Kooper, M. Ondrejcek, L. Marini, and P. Bajcsy. 2011. “A mosaic of software.” In Proc., 7th Int. Conf. on eScience, 279–286. New York: IEEE.
Minsker, B. S. 2005. “Genetic algorithms.” In Hydroinformatics: Data integrative approaches in computation, analysis, and modeling, edited by P. Kumar. Boca Raton, FL: CRC Press.
Mirfenderesgi, G., and S. J. Mousavi. 2015. “Adaptive meta-modeling-based simulation optimization in basin-scale optimum water allocation: A comparative analysis of meta-models.” J. Hydroinf. 18 (3): 446–465. https://doi.org/10.2166/hydro.2015.157.
Pasha, M. F. K., and K. Lansey. 2010. “Strategies for real time pump operation for water distribution systems.” In Proc., Water Distribution Systems Analysis 2010, 1456–1469. Reston, VA: ASCE.
Raei, E., M. R. Alizadeh, M. R. Nikoo, and J. Adamowski. 2019. “Multi-objective decision-making for green infrastructure planning (LID-BMPs) in urban storm water management under uncertainty.” J. Hydrol. 579 (Dec): 124091. https://doi.org/10.1016/j.jhydrol.2019.124091.
Razavi, S., B. A. Tolson, and D. H. Burn. 2012. “Review of surrogate modeling in water resources.” Water Resour. Res. 48 (7): 1–32. https://doi.org/10.1029/2011WR011527.
Singh, A. 2014. “Simulation and optimization modeling for the management of groundwater resources. II: Combined applications.” J. Irrig. Drain. Eng. 140 (4): 04014002. https://doi.org/10.1061/(ASCE)IR.1943-4774.0000689.
Soleimanpour-Moghadam, M., and H. Nezamabadi-Pour. 2020. “Discrete genetic algorithm for solving task allocation of multi-robot systems.” In Proc., 4th Conf. on Swarm Intelligence and Evolutionary Computation (CSIEC), 006–009. New York: IEEE.
Solomatine, D. P., and A. Ostfeld. 2008. “Data-driven modelling: Some past experiences and new approaches.” J. Hydroinf. 10 (1): 3–22. https://doi.org/10.2166/hydro.2008.015.
TCEQ (Texas Commission on Environmental Quality). 2021. “Drought impact on Texas surface water.” Accessed September 2, 2021. https://www.tceq.texas.gov/response/drought/waterrights.html.
Tsoukalas, I., P. Kossieris, A. Efstratiadis, and C. Makropoulos. 2016. “Surrogate-enhanced evolutionary annealing simplex algorithm for effective and efficient optimization of water resources problems on a budget.” Environ. Modell. Software 77 (Mar): 122–142. https://doi.org/10.1016/j.envsoft.2015.12.008.
USEPA. n.d. “NHDPlus (National Hydrography Dataset Plus).” Accessed August 20, 2021. https://www.epa.gov/waterdata/nhdplus-national-hydrography-dataset-plus.
Viana, F. A. C., R. T. Haftka, and L. T. Watson. 2012. “Efficient global optimization algorithm assisted by multiple surrogate techniques.” J. Global Optim. 56 (2): 669–689. https://doi.org/10.1007/s10898-012-9892-5.
Vose, M. D. 1999. Vol. 12 of The simple genetic algorithm: Foundations and theory. Cambridge, MA: MIT Press.
Wu, B., Y. Zheng, X. Wu, Y. Tian, F. Han, J. Liu, and C. Zheng. 2015. “Optimizing water resources management in large river basins with integrated surface water-groundwater modeling: A surrogate-based approach.” Water Resour. Res. 51 (4): 2153–2173. https://doi.org/10.1002/2014WR016653.
Yan, S., and B. Minsker. 2003. “A dynamic meta-model approach to genetic algorithm solution of a risk-based groundwater remediation design model.” In Proc., World Water & Environmental Resources Congress 2003, 1–10. Reston, VA: ASCE.
Yan, S., and B. Minsker. 2006. “Optimizing groundwater remediation designs under uncertainty using dynamic surrogate models.” In Proc., World Environmental and Water Resource Congress 2006: Examining the Confluence of Environmental and Water Concerns, 1–10. Reston, VA: ASCE.
Yan, S., and B. Minsker. 2011. “Applying dynamic surrogate models in noisy genetic algorithms to optimize groundwater remediation designs.” J. Water Resour. Plann. Manage. 137 (3): 284–292. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000106.
Zhao, T., B. Minsker, J. Spoelstra, C. Navarro, and J. Lee. 2021. “A service-driven modeling approach to managing water allocation in priority doctrine regions.” J. Water Resour. Plann. Manage. 147 (11). https://doi.org/10.1061/(ASCE)WR.1943-5452.0001463.
Information & Authors
Information
Published In
Journal of Water Resources Planning and Management
Volume 147 • Issue 12 • December 2021
Copyright
© 2021 American Society of Civil Engineers.
History
Received: Oct 3, 2020
Accepted: Aug 6, 2021
Published online: Sep 27, 2021
Published in print: Dec 1, 2021
Discussion open until: Feb 27, 2022
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited by
- Lei Liu, Shuyu Zhang, Jianhui Qiu, Optimal allocation of water resources based on genetic algorithms: a case study in the Colorado Basin, USA, International Conference on Cloud Computing, Internet of Things, and Computer Applications (CICA 2022), 10.1117/12.2642712, (108), (2022).