Penalized Functional Decomposition for Detecting Bursts in Water Distribution Systems
Publication: Journal of Water Resources Planning and Management
Volume 150, Issue 10
Abstract
Detecting pipe bursts in water distribution systems (WDSs) is of critical importance for urban infrastructure maintenance. A pipe burst can be detected from measurements that are continuously collected from hydraulic meters installed in WDSs, with widely accepted statistical process control techniques. However, the significant autocorrelation inevitably embedded in the continuously collected hydraulic measurements makes it extremely difficult for existing methods to accurately estimate the breakout time and the magnitude of a burst. To overcome the limitation, this paper proposes a new method to model the autocorrelation patterns with functional basis expansion. Functional regression is adopted to detect the pipe burst by decomposing the hydraulic measurements into three components: the normal components, the burst-induced anomaly component, and noises. A regularized estimation algorithm is developed to identify the three components by incorporating the knowledge of the impacts of bursts on the autocorrelation patterns in hydraulic measurements. A simulated water distribution network is built through EPANET. Analysis results based on the simulated data show that the proposed method not only outperforms existing methods with higher burst detectability and lower false alarm rate, but can also estimate the burst starting time, and magnitude estimation.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
All the data, models, and code that support the findings of this study are available from the corresponding author upon reasonable request.
Acknowledgments
This material is based in part upon the work supported by the National Science Foundation (NSF) under Grant No. 1762862. Any opinions, findings, conclusions, or recommendations expressed in this material are those of authors and do not necessarily reflect the views of the NSF. The author thanks Dr. Donghwi Jung and Dr. Sanghoon Jun for their efforts in the simulations. The author thanks anonymous reviewers for their comments.
References
Ahn, J., and D. Jung. 2019. “Hybrid statistical process control method for water distribution pipe burst detection.” J. Water Resour. Plann. Manage. 145 (9): 06019008. https://doi.org/10.1061/(ASCE)WR.1943-5452.0001104.
Alwan, L. C. 1992. “Effects of autocorrelation on control chart performance.” Commun. Stat.- Theory Methods 21 (4): 1025–1049. https://doi.org/10.1080/03610929208830829.
American Water Works Association. 2009. Water audits and loss control programs. 3rd ed. Denver: American Water Works Association.
Bicik, J., Z. Kapelan, C. Makropoulos, and D. A. Savić. 2010. “Pipe burst diagnostics using evidence theory.” J. Hydroinf. 13 (4): 596–608. https://doi.org/10.2166/hydro.2010.201.
Brion, L. M., and L. W. Mays. 1991. “Methodology for optimal operation of pumping stations in water distribution systems.” J. Hydraul. Eng. 117 (11): 1551–1569. https://doi.org/10.1061/(ASCE)0733-9429(1991)117:11(1551).
Díaz, S., K. Lansey, and S. Schück. 2024. “Developing a PDA head–Outflow relationship from a microscale analysis.” J. Water Resour. Plann. Manage. 150 (3): 04023083. https://doi.org/10.1061/JWRMD5.WRENG-6314.
Di Nardo, A., et al. 2015. “New perspectives for smart water network monitoring, partitioning and protection with innovative on-line measuring sensors.” In Proc., 36th IAHR World Congress. Beijing: International Association for Hydro-Environment Engineering and Research.
Farah, E., and I. Shahrour. 2017. Leakage detection using smart water system: Combination of water balance and automated minimum night flow. Berlin: Springer. https://doi.org/10.1007/s11269-017-1780-9.
Hu, Z., B. Chen, W. Chen, D. Tan, and D. Shen. 2021. “Review of model-based and data-driven approaches for leak detection and location in water distribution systems.” Water Supply 21 (7): 3282–3306. https://doi.org/10.2166/ws.2021.101.
Jung, D., D. Kang, J. Liu, and K. Lansey. 2014. “Improving the rapidity of responses to pipe burst in water distribution systems: A comparison of statistical process control methods.” J. Hydroinf. 17 (2): 307–328. https://doi.org/10.2166/hydro.2014.101.
Jung, D., and K. Lansey. 2015. “Water distribution system burst detection using a nonlinear Kalman filter.” J. Water Resour. Plann. Manage. 141 (5): 04014070. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000464.
Kelly, S. E. 1996. “Gibbs phenomenon for wavelets.” Appl. Comput. Harmon. Anal. 3 (1): 72–81. https://doi.org/10.1006/acha.1996.0006.
Kim, S., S. Jun, and D. Jung. 2022. “Ensemble CNN model for effective pipe burst detection in water distribution systems.” Water Resour. Manage. 36 (13): 5049–5061. https://doi.org/10.1007/s11269-022-03291-1.
Loureiro, D., C. Amado, A. Martins, D. Vitorino, A. Mamade, and S. T. Coelho. 2016. “Water distribution systems flow monitoring and anomalous event detection: A practical approach.” Urban Water J. 13 (3): 242–252. https://doi.org/10.1080/1573062X.2014.988733.
Misiunas, D., J. Vítkovský, G. Olsson, M. Lambert, and A. Simpson. 2006. “Failure monitoring in water distribution networks.” Water Sci. Technol. 53 (4–5): 503–511. https://doi.org/10.2166/wst.2006.154.
Montgomery, D. C. 2009. Introduction to statistical quality control. 6th ed. New York: Wiley.
Mounce, S. R., and J. Machell. 2006. “Burst detection using hydraulic data from water distribution systems with artificial neural networks.” Urban Water J. 3 (1): 21–31. https://doi.org/10.1080/15730620600578538.
Mounce, S. R., R. B. Mounce, and J. B. Boxall. 2011. “Novelty detection for time series data analysis in water distribution systems using support vector machines.” J. Hydroinf. 13 (4): 672–686. https://doi.org/10.2166/hydro.2010.144.
Nesterov, Y. E. 1983. “A method of solving a convex programming problem with convergence rate .” Russ. Acad. Sci. 269 (3): 543–547.
Palau, C. V., F. J. Arregui, and M. Carlos. 2012. “Burst detection in water networks using principal component analysis.” J. Water Resour. Plann. Manage. 138 (1): 47–54. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000147.
Pan, F., Y. Zhang, L. Head, J. Liu, M. Elli, and I. Alvarez. 2022. “Quantifying error propagation in multistage perception system of autonomous vehicles via physics-based simulation.” In Proc., 2022 Winter Simulation Conf. (WSC), 2511–2522. New York: IEEE. https://doi.org/10.1109/WSC57314.2022.10015496.
Ramsay, J., and B. W. Silverman. 2006. Functional data analysis. New York: Springer.
Rossman, L. A. 2000. Epanet 2: User’s manual. Cincinnati, OH: USEPA.
Shinozuka, M., J. Liang, and M. Q. Feng. 2005. “Use of supervisory control and data acquisition for damage location of water delivery systems.” J. Eng. Mech. 131 (3): 225–230. https://doi.org/10.1061/(ASCE)0733-9399(2005)131:3(225).
Tibshirani, R. 1996. “Regression shrinkage and selection via the lasso.” J. R. Stat. Soc. B 58 (1): 267–288. https://doi.org/10.1111/j.2517-6161.1996.tb02080.x.
Vanhatalo, E., and M. Kulahci. 2015. “The effect of autocorrelation on the Hotelling T2 control chart.” Qual. Reliab. Eng. Int. 31 (8): 1779–1796. https://doi.org/10.1002/qre.1717.
Wang, X., G. Guo, S. Liu, Y. Wu, X. Xu, and K. Smith. 2020. “Burst detection in district metering areas using deep learning method.” J. Water Resour. Plann. Manage. 146 (6): 04020031. https://doi.org/10.1061/(ASCE)WR.1943-5452.0001223.
Wu, Y., and S. Liu. 2017. “A review of data-driven approaches for burst detection in water distribution systems.” Urban Water J. 14 (9): 972–983. https://doi.org/10.1080/1573062X.2017.1279191.
Yan, H., K. Paynabar, and J. Shi. 2017. “Anomaly detection in images with smooth background via smooth-sparse decomposition.” Technometrics 59 (1): 102–114. https://doi.org/10.1080/00401706.2015.1102764.
Ye, G., and R. A. Fenner. 2011. “Kalman filtering of hydraulic measurements for burst detection in water distribution systems.” J. Pipeline Syst. Eng. Pract. 2 (1): 14–22. https://doi.org/10.1061/(ASCE)PS.1949-1204.0000070.
Ye, G., and R. A. Fenner. 2014. “Weighted least squares with expectation-maximization algorithm for burst detection in UK water distribution systems.” J. Water Resour. Plann. Manage. 140 (4): 417–424. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000344.
Zhang, Y., K. Lansey, and J. Liu. 2020. “Detecting bursts in water distribution system via penalized functional decomposition.” In Proc., 2020 IEEE Int. Conf. on Industrial Engineering and Engineering Management (IEEM), 205–209. New York: IEEE.
Information & Authors
Information
Published In
Journal of Water Resources Planning and Management
Volume 150 • Issue 10 • October 2024
Copyright
© 2024 American Society of Civil Engineers.
History
Received: Nov 1, 2023
Accepted: May 9, 2024
Published online: Aug 13, 2024
Published in print: Oct 1, 2024
Discussion open until: Jan 13, 2025
ASCE Technical Topics:
- Analysis (by type)
- Biological processes
- Decomposition
- Engineering fundamentals
- Environmental engineering
- Hydraulic engineering
- Hydraulics
- Infrastructure
- Pipe failures
- Pipeline hydraulics
- Pipeline management
- Pipeline systems
- Pipelines
- Regression analysis
- Statistical analysis (by type)
- Waste management
- Water and water resources
- Water management
- Water pipelines
- Water supply
- Water supply systems
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.