Regularization of an Inverse Problem for Parameter Estimation in Water Distribution Networks
This article has a reply.
VIEW THE REPLYThis article has a reply.
VIEW THE REPLYPublication: Journal of Water Resources Planning and Management
Volume 146, Issue 9
Abstract
An accurate hydraulic model of a water distribution network (WDN) is a critical prerequisite for a multitude of operational, optimization, and planning tasks. The accuracy of a hydraulic model can only be maintained through its periodic calibration and validation with acquired pressure and flow data from a WDN. It is important that this process be robust and computationally efficient. This paper describes the regularization of an inverse problem to deal with data uncertainties and ill-posedness of parameter estimation problems in WDNs. A novel data-driven strategy is presented for tuning the regularization hyperparameter for the inverse problem and also for validating the results on an independent set of operational hydraulic data. A limited-memory quasi-Newton method (L-BFGS-B) is implemented to solve the resulting regularized nonlinear inverse problem. Furthermore, the implemented method utilizes either the Darcy-Weisbach or Hazen-Williams head loss formulas and is investigated both with and without pipe grouping. An extensive experimental program was carried out to acquire unique hydraulic data from an operational WDN in order to investigate the robustness of the proposed parameter estimation method. The hydraulic model of the operational WDN and the acquired hydraulic data are provided as supplementary data to enable the comparison of hydraulic model calibration methods with operational data and encourage reproducible research.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
The WDN model used for the case study and associated data is detailed in Appendix S1 and is available online at https://doi.org/10.17632/srt4vr5k38 in accordance with further data retention policies.
Acknowledgments
This work was supported by EPSRC (EP/P004229/1, Dynamically Adaptive and Resilient Water Supply Networks for a Sustainable Future; and EP/L016826/1 EPSRC Centre for Doctoral Training in Sustainable Civil Engineering), Anglian Water Services, and Bristol Water. Thanks also go to Bristol Water (Kevin Henderson and Frank Van Der Kleij) for allowing the authors to share the BWFL hydraulic model to encourage reproducible research for hydraulic model calibration and as a contribution to broader research purposes in the water distribution sector.
References
Abraham, E., M. Blokker, and I. Stoianov. 2017. “Decreasing the discoloration risk of drinking water distribution systems through optimized topological changes and optimal flow velocity control.” J. Water Resour. Plann. Manage. 144 (2): 04017093. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000878.
Abraham, E., and I. Stoianov. 2015. “Sparse null space algorithms for hydraulic analysis of large-scale water supply networks.” J. Hydraul. Eng. 142 (3): 04015058. https://doi.org/10.1061/(ASCE)HY.1943-7900.0001089.
Asadzadeh, M., and B. A. Tolson. 2009. “A new multi-objective algorithm, Pareto archived DDS.” In Proc., 11th Annual Conf. Companion on Genetic and Evolutionary Computation Conf.: Late Breaking Papers, 1963–1966. New York: Association for Computing Machinery.
AWWA (American Water Works Association). 1999. “Calibration guidelines for water distribution system modeling.” In Proc., AWWA 1999 ImTech Conf. Denver: AWWA.
Becker, S. 2015. “L-BFGS-B-C.” Accessed November 24, 2018. https://github.com/stephenbeckr/L-BFGS-B-C.
Benzi, M., G. H. Golubt, and J. Liesen. 2005. “Numerical solution of saddle point problems.” Acta Numer. 14 (May): 1–137. https://doi.org/10.1017/S0962492904000212.
Bhave, P. 1988. “Calibrating water distribution network models.” J. Environ. Eng. 114 (1): 120–136. https://doi.org/10.1061/(ASCE)0733-9372(1988)114:1(120).
Björck, Å. 1996. Numerical methods for least squares problems. Philadelphia: SIAM.
Blocher, C., F. Pecci, and I. Stoianov. 2020. “Localizing leakage hotspots in water distribution networks via the regularization of an inverse problem.” J. Hydraul. Eng. 146 (4): 04020025. https://doi.org/10.1061/(ASCE)HY.1943-7900.0001721.
Bonnans, J.-F., J. C. Gilbert, C. Lemaréchal, and C. A. Sagastizábal. 2006. Numerical optimization: Theoretical and practical aspects. New York: Springer.
Bottou, L., F. E. Curtis, and J. Nocedal. 2018. “Optimization methods for large-scale machine learning.” SIAM Rev. 60 (2): 223–311.
Boulos, P. F., and L. E. Ormsbee. 1991. “Explicit network calibration for multiple loading conditions.” Civ. Eng. Syst. 8 (3): 153–160. https://doi.org/10.1080/02630259108970619.
Byrd, R. H., P. Lu, J. Nocedal, and C. Zhu. 1995. “A limited memory algorithm for bound constrained optimization.” SIAM J. Sci. Comput. 16 (5): 1190–1208. https://doi.org/10.1137/0916069.
Datta, R. S. N., and K. Sridharan. 1994. “Parameter estimation in water-distribution systems by least squares.” J. Water Resour. Plann. Manage. 120 (4): 405–422. https://doi.org/10.1061/(ASCE)0733-9496(1994)120:4(405).
Díaz, S., R. Mínguez, and J. González. 2017. “Calibration via multi-period state estimation in water distribution systems.” Water Resour. Manage. 31 (15): 4801–4819. https://doi.org/10.1007/s11269-017-1779-2.
Do, N. C., A. R. Simpson, J. W. Deuerlein, and O. Piller. 2016. “Calibration of water demand multipliers in water distribution systems using genetic algorithms.” J. Water Resour. Plann. Manage. 142 (11): 04016044. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000691.
Do, N. C., A. R. Simpson, J. W. Deuerlein, and O. Piller. 2018. “Locating inadvertently partially closed valves in water distribution systems.” J. Water Resour. Plann. Manage. 144 (8): 04018039. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000958.
Elhay, S., A. R. Simpson, J. Deuerlein, B. Alexander, and W. Schilders. 2014. “A reformulated co-tree flows method competitive with the global gradient algorithm for solving the water distribution system equations.” J. Water Resour. Plann. Manage. 140 (12): 04014040. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000431.
Gill, P. E., and W. Murray. 1978. “Algorithms for the solution of the nonlinear least-squares problem.” SIAM J. Numer. Anal. 15 (5): 977–992. https://doi.org/10.1137/0715063.
Kang, D., and K. Lansey. 2010. “Demand and roughness estimation in water distribution systems.” J. Water Resour. Plann. Manage. 137 (1): 20–30. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000086.
Kapelan, Z. 2002. “Calibration of water distribution networks.” Ph.D. thesis, Dept. of Engineering, Univ. of Exeter.
Kumar, S. M., S. Narasimhan, and S. M. Bhallamudi. 2010. “Parameter estimation in water distribution networks.” Water Resour. Manage. 24 (6): 1251–1272. https://doi.org/10.1007/s11269-009-9495-1.
Kun, D., L. Tian-Yu, W. Jun-Hui, and G. Jin-Song. 2015. “Inversion model of water distribution systems for nodal demand calibration.” J. Water Resour. Plann. Manage. 141 (9): 04015002. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000506.
Lansey, K., and C. Basnet. 1991. “Parameter estimation for water distribution networks.” J. Water Resour. Plann. Manage. 117 (1): 126–144. https://doi.org/10.1061/(ASCE)0733-9496(1991)117:1(126).
Larock, B. E., R. W. Jeppson, and G. Z. Watters. 1999. Hydraulics of pipeline systems. Boca Raton, FL: CRC Press.
Mallick, K. N., I. Ahmed, K. S. Tickle, and K. Lansey. 2002. “Determining pipe groupings for water distribution networks.” J. Water Resour. Plann. Manage. 128 (2): 130–139. https://doi.org/10.1061/(ASCE)0733-9496(2002)128:2(130).
Menke, R., E. Abraham, P. Parpas, and I. Stoianov. 2016. “Demonstrating demand response from water distribution system through pump scheduling.” Appl. Energy 170 (May): 377–387. https://doi.org/10.1016/j.apenergy.2016.02.136.
Nerantzis, D., F. Pecci, and I. Stoianov. 2019. “Optimal control of water distribution networks without storage.” Eur. J. Oper. Res. 284 (1): 345–354. https://doi.org/10.1016/j.ejor.2019.12.011.
Nielsen, H. B. 1989. “Methods for analyzing pipe networks.” J. Hydraul. Eng. 115 (2): 139–157. https://doi.org/10.1061/(ASCE)0733-9429(1989)115:2(139).
Nocedal, J., and S. J. Wright. 2006. Numerical optimization. 2nd ed. New York: Springer.
Ormsbee, L. 1989. “Implicit network calibration.” J. Water Resour. Plann. Manage. 115 (2): 243–257. https://doi.org/10.1061/(ASCE)0733-9496(1989)115:2(243).
Ormsbee, L., and D. Wood. 1986. “Explicit pipe network calibration.” J. Water Resour. Plann. Manage. 112 (2): 166–182. https://doi.org/10.1061/(ASCE)0733-9496(1986)112:2(166).
Ostfeld, A., et al. 2012. “Battle of the water calibration networks.” J. Water Resour. Plann. Manage. 138 (5): 523–532. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000191.
Pecci, F., E. Abraham, and I. Stoianov. 2017. “Scalable Pareto set generation for multiobjective co-design problems in water distribution networks: A continuous relaxation approach.” Struct. Multidiscip. Optim. 55 (3): 857–869. https://doi.org/10.1007/s00158-016-1537-8.
Pecci, F., E. Abraham, and I. Stoianov. 2019. “Model reduction and outer approximation for optimizing the placement of control valves in complex water networks.” J. Water Resour. Plann. Manage. 145 (5): 04019014. https://doi.org/10.1061/(ASCE)WR.1943-5452.0001055.
Pecci, F., P. Parpas, and I. Stoianov. 2020. “Sequential convex optimization for detecting and locating blockages in water distribution networks.” J. Water Resour. Plann. Manage. 146 (8): 04020057. https://doi.org/10.1061/(ASCE)WR.1943-5452.0001233.
Piller, O. 1995. “Modeling the behavior of a network-hydraulic analysis and sampling procedures for parameter estimation.” Ph.D. thesis, Dept. of Applied Mathematics, Univ. of Bordeaux.
Piller, O., D. Gilbert, and J. E. Van Zyl. 2010. “Dual calibration for coupled flow and transport models of water distribution systems.” In Proc., 12th Int. Conf. Water Distribution Systems Analysis 2010, 722–731. Reston, VA: ASCE.
Rahal, C. M., M. J. H. Sterling, and B. Coulbeck. 1980. “Parameter tuning for simulation models of water distribution networks.” Proc. Inst. Civ. Eng. 69 (3): 751–762. https://doi.org/10.1680/iicep.1980.2375.
Reddy, P. V. N., K. Sridharan, and P. V. Rao. 1996. “WLS method for parameter estimation in water distribution networks.” J. Water Resour. Plann. Manage. 122 (3): 157–164. https://doi.org/10.1061/(ASCE)0733-9496(1996)122:3(157).
Rossman, L. A. 2000. EPANET 2: Users manual. Cincinnati: USEPA.
Sanz, G., R. Pérez, Z. Kapelan, and D. Savic. 2016. “Leak detection and localization through demand components calibration.” J. Water Resour. Plann. Manage. 142 (2): 04015057. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000592.
Savic, D. A., Z. S. Kapelan, and P. M. Jonkergouw. 2009. “Quo vadis water distribution model calibration?” Urban Water J. 6 (1): 3–22. https://doi.org/10.1080/15730620802613380.
Simpson, A., and S. Elhay. 2010. “Jacobian matrix for solving water distribution system equations with the Darcy-Weisbach head-loss model.” J. Hydraul. Eng. 137 (6): 696–700. https://doi.org/10.1061/(ASCE)HY.1943-7900.0000341.
Stuart, A. M. 2010. “Inverse problems: A Bayesian perspective.” Acta Numer. 19 (May): 451–559. https://doi.org/10.1017/S0962492910000061.
Ulusoy, A.-J., F. Pecci, and I. Stoianov. 2020. “An MINLP-based approach for the design-for-control of resilient water supply systems.” IEEE Syst. J. 1–12. https://doi.org/10.1109/JSYST.2019.2961104.
Vapnik, V. N. 1998. Statistical learning theory. New York: Wiley.
Walski, T. M. 1983. “Technique for calibrating network models.” J. Water Resour. Plann. Manage. 109 (4): 360–372. https://doi.org/10.1061/(ASCE)0733-9496(1983)109:4(360).
Walters, G., D. Savic, M. Morley, W. Schaetzen, and R. Atkinson. 1998. “Calibration of water distribution network models using genetic algorithms.” WIT Trans. Ecol. Environ. 26: 131–140.
Water Research Centre. 1989. Network analysis—A code of practice. Swindon, UK: Water Authorities Association.
Wright, R., E. Abraham, P. Parpas, and I. Stoianov. 2015. “Control of water distribution networks with dynamic DMA Topology using strictly feasible sequential convex programming.” Water Resour. Res. 51 (12): 9925–9941. https://doi.org/10.1002/2015WR017466.
Wright, R., I. Stoianov, P. Parpas, K. Henderson, and J. King. 2014. “Adaptive water distribution networks with dynamically reconfigurable topology.” J. Hydroinf. 16 (6): 1280–1301. https://doi.org/10.2166/hydro.2014.086.
Information & Authors
Information
Published In
Journal of Water Resources Planning and Management
Volume 146 • Issue 9 • September 2020
Copyright
© 2020 American Society of Civil Engineers.
History
Received: Apr 24, 2019
Accepted: Mar 23, 2020
Published online: Jul 11, 2020
Published in print: Sep 1, 2020
Discussion open until: Dec 11, 2020
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.