Streaming Smart Meter Data Integration to Enable Dynamic Demand Assignment for Real-Time Hydraulic Simulation
Publication: Journal of Water Resources Planning and Management
Volume 146, Issue 6
Abstract
Water distribution system models have long been widely used for design and planning purposes. Their application for supporting real-time operational decisions has been also gaining increasing interest over the past decade. Accurate end-user nodal demands are critical to the reliability of hydraulic simulations for real-time decision support. Conventionally, nodal demands are set to a handful of periodically updated ensembles of demand patterns, which cannot represent the vast heterogeneity and volatility of demands. With advances in metering technology, consumption data with unprecedentedly high temporal and spatial resolutions are available to water utilities on a real-time basis. A framework is developed here to create a dynamic demand assignment hydraulic model, in which consumption data are assigned to nodes to update the water network model with the streaming data from the data center and without interruption of the hydraulic simulation run. The developed framework is cloud-based and scalable, making it suitable for water distribution systems of all sizes. The framework modifies the core EPANET engine to directly assign updated demands in order to overcome current software limitations. The model is applied and demonstrated using a real-world case study in the US. The results show the importance of the real-time demand assignment for the reliability of hydraulic models for making real-time operational decisions and the realization of digital twins of water infrastructure systems.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or code generated or used during the study are proprietary or confidential in nature and may only be provided with restrictions (e.g., anonymized data).
References
Alves, Z., J. Muranho, T. Albuquerque, and A. Ferreira. 2014. “Water distribution network’s modeling and calibration: A case study based on scarce inventory data.” Procedia Eng. 70: 31–40. https://doi.org/10.1016/j.proeng.2014.02.005.
Cocking, S. 2017. “Business showcase: Sensus.” Irish Tech News, September 7, 2017.
Cominola, A., M. Giuliani, A. Castelletti, D. Rosenberg, and A. Abdallah. 2018. “Implications of data sampling resolution on water use simulation, end-use disaggregation, and demand management.” Environ. Modell. Software 102 (Apr): 199–212. https://doi.org/10.1016/j.envsoft.2017.11.022.
Davidson, J. W., and F. J.-C. Bouchart. 2006. “Adjusting nodal demands in scada constrained real-time water distribution network models.” J. Hydraul. Eng. 132 (1): 102–110. https://doi.org/10.1061/(ASCE)0733-9429(2006)132:1(102).
Dean, J., and S. Ghemawat. 2008. “Mapreduce: Simplified data processing on large clusters.” Commun. ACM 51 (1): 107–113. https://doi.org/10.1145/1327452.1327492.
Du, K., R. Y. Ding, Z. H. Wang, Z. G. Song, B. F. Xu, M. Zhou, Y. Bai, and J. Zhang. 2018. “Direct inversion algorithm for pipe resistance coefficient calibration of water distribution systems.” J. Water Resour. Plann. Manage. 144 (7): 04018027. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000948.
Kang, D., and K. Lansey. 2009. “Real-time demand estimation and confidence limit analysis for water distribution systems.” J. Hydraul. Eng. 135 (10): 825–837. https://doi.org/10.1061/(ASCE)HY.1943-7900.0000086.
Kang, D., and K. Lansey. 2011. “Demand and roughness estimation in water distribution systems.” J. Water Resour. Plann. Manage. 137 (1): 20–30. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000086.
Kun, D., L. Tian-Yu, W. Jun-Hui, and G. Jin-Song. 2015. “Inversion model of water distribution systems for nodal demand calibration.” J. Water Resour. Plann. Manage. 141 (9): 04015002. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000506.
McGann, M. 2016. “Sensing problems before they occur, with big data analytics.” Accessed May 1, 2016. http://i.dell.com/sites/doccontent/corporate/casestudies/en/Documents/2016sensus10022761bigdataiotinternetofthingsanalytics.pdf.
Morosini, A. F., F. Costanzo, P. Veltri, and D. Savić. 2014. “Identification of measurement points for calibration of water distribution network models.” Procedia Eng. 89: 693–701. https://doi.org/10.1016/j.proeng.2014.11.496.
Nguyen, K. A., R. A. Stewart, H. Zhang, O. Sahin, and N. Siriwardene. 2018. “Re-engineering traditional urban water management practices with smart metering and informatics.” Environ. Modell. Software 101 (Mar): 256–267. https://doi.org/10.1016/j.envsoft.2017.12.015.
Preis, A., A. J. Whittle, A. Ostfeld, and L. Perelman. 2011. “Efficient hydraulic state estimation technique using reduced models of urban water networks.” J. Water Resour. Plann. Manage. 137 (4): 343–351. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000113.
Rossman, L. 2000. Epanet user’s manual. Cincinnati: USEPA, Risk Reduction Engineering Lab.
Sanz, G., and R. Pérez. 2015. “Sensitivity analysis for sampling design and demand calibration in water distribution networks using the singular value decomposition.” J. Water Resour. Plann. Manage. 141 (10): 04015020. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000535.
Sensus. 2018. “Flexnet.” Accessed March 30, 2020. https://https://sensus.com/communication-networks/sensus-technologies/flexnet-north-america/.
Shafiee, M. E., Z. Barker, and A. Rasekh. 2018. “Enhancing water system models by integrating big data.” Sustainable Cities Soc. 37 (Feb): 485–491. https://doi.org/10.1016/j.scs.2017.11.042.
Shvachko, K., H. Kuang, S. Radia, and R. Chansler. 2010. “The hadoop distributed file system.” In Proc., 2010 IEEE 26th Symp. on Mass Storage Systems and Technologies (MSST), 1–10. Incline Village, NV: IEEE.
Thusoo, A., J. S. Sarma, N. Jain, Z. Shao, P. Chakka, S. Anthony, H. Liu, P. Wyckoff, and R. Murthy. 2009. “Hive: A warehousing solution over a map-reduce framework.” Proc. VLDB Endow. 2 (2): 1626–1629. https://doi.org/10.14778/1687553.1687609.
USEPA. 2015. Enhancements to the epanet-rtx (real-time analytics) software libraries. Washington, DC: US EPA Office of Research and Development.
Zhang, D., X. Chen, H. Yao, and A. James. 2016. “Moving swat model calibration and uncertainty analysis to an enterprise hadoop-based cloud.” Environ. Modell. Software 84 (Oct): 140–148. https://doi.org/10.1016/j.envsoft.2016.06.024.
Zikopoulos, P., and C. Eaton. 2011. Understanding big data: Analytics for enterprise class hadoop and streaming data. 1st ed. New York: McGraw-Hill.
Information & Authors
Information
Published In
Journal of Water Resources Planning and Management
Volume 146 • Issue 6 • June 2020
Copyright
©2020 American Society of Civil Engineers.
History
Received: Oct 1, 2018
Accepted: Jan 2, 2020
Published online: Apr 6, 2020
Published in print: Jun 1, 2020
Discussion open until: Sep 6, 2020
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.