Evolutionary Algorithm and Expectation Maximization Strategies for Improved Detection of Pipe Bursts and Other Events in Water Distribution Systems
Publication: Journal of Water Resources Planning and Management
Volume 140, Issue 5
Abstract
A fully automated data-driven methodology for the detection of pipe bursts and other events that induce similar abnormal pressure/flow variations (e.g., unauthorized consumptions) at the district metered area (DMA) level has been recently developed by the authors. This methodology works by simultaneously analyzing the data coming on-line from all the pressure and/or flow sensors deployed in a DMA. It makes synergistic use of several self-learning artificial intelligence (AI) and statistical techniques. These include (1) wavelets for the de-noising of the recorded pressure/flow signals; (2) artificial neural networks (ANNs) for the short-term forecasting of pressure/flow signal values; (3) statistical process control (SPC) techniques for the short-term and long-term analysis of the burst/other event-induced pressure/flow variations; and (4) Bayesian inference systems (BISs) for inferring the probability that a pipe burst/other event has occurred in the DMA being studied, raising the corresponding detection alarms, and provide information useful for performing event diagnosis. This paper focuses on the (re)calibration of the above detection methodology with the aim of improving the forecasting performances of the ANN models and the classification performances of the BIS used to raise the detection alarms (i.e., DMA-level BIS). This is achieved by using (1) an Evolutionary Algorithm optimization strategy for selecting the best ANN input structures and related parameter values to be used for training the ANN models, and (2) an Expectation Maximization strategy for (re)calibrating the values in the conditional probability tables (CPTs) of the DMA-level BIS. The (re)calibration procedure is tested on a case study involving several DMAs in the U.K. with real-life pipe bursts/other events, engineered pipe burst events (i.e., simulated by opening fire hydrants), and synthetic pipe burst events (i.e., simulated by arbitrarily adding “burst flows” to an actual flow signal). The results obtained illustrate that the new (re)calibration procedure improves the performance of the event detection methodology in terms of increased detection speed and reliability.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
This work is part of the first author’s PhD sponsored by the University of Exeter. The DMA data used in the paper have been collected as part of the Neptune project funded by the UK Engineering and Physical Sciences Research Council (EP/E003192/1) and provided by Mr Ridwan Patel from Yorkshire Water, which is gratefully acknowledged. The work presented in this paper has been patented (Publication No. WO/2010/131001).
References
Adamowski, J. F. (2008). “Peak daily water demand forecast modeling using artificial neural networks.” J. Water Resour. Plann. Manage., 119–128.
Bishop, C. M. (1995). Neural networks for pattern recognition, Oxford University Press, Oxford.
Brunone, B. (1999). “Transient test-based technique for leak detection in outfall pipes.” J. Water Resour. Plann. Manage., 302–306.
Dempster, A. P., Laird, N. M., and Rubin, D. B. (1977). “Maximum likelihood from incomplete data via the EM algorithm.” J. R. Stat. Soc. Ser. B, 39(1), 1–38.
Do, C. B., and Batzoglou, S. (2008). “What is the Expectation Maximization algorithm?” Nat. Biotech., 26(8), 897–899.
Edwards, D. (2000). Introduction to graphical modelling, 2nd Ed., Springer, New York.
Egan, J. P. (1975). Signal detection theory and ROC analysis, Series in Cognition and Perception, Academic Press, New York.
Fawcett, T. (2006). “An introduction to ROC analysis.” Pattern Recognit. Lett., 27(8), 861–874.
Fenner, R. A., and Ye, G. (2011). “Kalman filtering of hydraulic measurements for burst detection in water distribution systems.” J. Pipeline Syst. Eng. Pract., 14–22.
Field, D. B., and Ratcliffe, B. (1978). “Location of leaks in pressurised pipelines using sulphur hexafluoride as a tracer.”, Water Research Centre, U.K.
Giustolisi, O., and Simeone, V. (2006). “Optimal design of artificial neural networks by a multi-objective strategy: groundwater level predictions.” Hydrol. Sci. J., 51(3), 502–523.
Grunwell, D., and Ratcliffe, B. (1981). “Location of underground leaks using the leak noise correlator.”, Water Research Centre.
Heckerman, D. (1995). “A tutorial on learning with Bayesian networks. Learning in graphical models.” 〈http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.112.8434〉 (May 29, 2011).
Holland, J. H. (1975). Adaptation in natural and artificial systems, University of Michigan Press, Ann Arbor.
Jensen, F. V. (2001). Bayesian networks and decision graphs, Springer, New York.
Jensen, F. V. (2009). “Bayesian networks.” Wiley Interdiscip. Rev.: Comput. Stat., 1(3), 307–315.
Kim, S. H. (2005). “Extensive development of leak detection algorithm by impulse response method.” J. Hydraul. Eng., 201–208.
Lauritzen, S. L. (1995). “The EM algorithm for graphical association models with missing data.” Comput. Stat. Data Anal., 19(2), 191–201.
Liggett, J. A., and Chen, L.-C. (1994). “Inverse transient analysis in pipe networks.” J. Hydraul. Eng., 934–955.
Mergelas, B., and Henrich, G. (2005). “Leak locating method for precommissioned transmission pipelines: North American case studies.” Proc., Int. Water Association Conf.: Leakage 2005, Halifax, Canada.
Misiunas, D., Lambert, M. F., Simpson, A. R., and Olsson, G. (2005). “Burst detection and location in water distribution networks.” Water Sci. Technol.: Water Supply, 5(3–4), 71–80.
Misiunas, D., Vítkovský, J. P., Olsson, G., Lambert, M. F., and Simpson, A. R. (2006). “Failure monitoring in water distribution networks.” Water Sci. Technol., 53(4–5), 503–511.
Moody, J. E. (1992). “The effective number of parameters: an analysis of generalization and regularization in nonlinear learning systems.” Advances in neural information processing systems, J. E. Moody, S. E. Hanson, and R. P. Lippmann, Vol. 4, Morgan Kaufmann, San Francisco, 847–854.
Mounce, S. R., Boxall, J. B., and Machell, J. (2010). “Development and verification of an online artificial intelligence system for burst detection in water distribution systems.” J. Water Resour. Plann. Manage., 309–318.
Mounce, S. R., Mounce, R. B., and Boxall, J. B. (2011). “Novelty detection for time series data analysis in water distribution systems using support vector machines.” J. Hydroinf., 13(4), 672–686.
Mpesha, W., Gassman, S. L., and Chaudhry, M. H. (2001). “Leak detection in pipes by frequency response method.” J. Hydraul. Eng., 134–147.
Nash, J. E., and Sutcliffe, J. V. (1970). “River flow forecasting through conceptual models, Part I—A discussion of principles.” J. Hydrol., 10(3), 282–290.
Nelson, M. C., and Illingworth, W. T. (1991). A practical guide to neural nets, Addison-Wesley, Reading.
Neuroshell2 manual [Computer software]. (1996). Ward Systems Group, Frederick, MD.
Nicklow, J., et al. (2010). “State of the art for genetic algorithms and beyond in water resources planning and management.” J. Water Resour. Plann. Manage., 412–432.
Palau, C. V., Arregui, F. J., and Carlos, M. (2012). “Burst detection in water networks using principal component analysis.” J. Water Resour. Plann. Manage., 47–54.
Pudar, R. S., and Liggett, J. A. (1992). “Leaks in pipe networks.” J. Hydraul. Eng., 1031–1046.
Puust, R., Kapelan, Z., Savic, D. A., and Koppel, T. (2006). “Probabilistic leak detection in pipe networks using the SCEM-UA algorithm.” Proc., 8th Annual Int. Symp. on Water Distribution Systems Analysis, Steven G. Buchberger, Robert M. Clark, Walter M. Grayman, and James G. Uber, ASCE, Reston, VA.
Puust, R., Kapelan, Z., Savić, D. A., and Koppel, T. (2010). “A review of methods for leakage management in pipe networks.” Urban Water J., 7(1), 25–45.
Romano, M., Kapelan, Z., and Savić, D. A. (2014). “Automated detection of pipe bursts and other events in water distribution systems.” J. Water Resour. Plann. Manage., 457–467.
Schwefel, H.-P. (1981). Numerical optimization of computer models, Wiley, New York.
Shewhart, W. (1931). Economic control of quality of manufactured product, Van Nostrand Reinhold, New York.
Srirangarajan, S., Allen, M., Preis, A., Iqbal, M., Lim, H. B., and Whittle, A. J. (2013). “Wavelet-based burst event detection and localization in water distribution systems.” J. Signal Process. Syst., 72(1), 1–16.
Wang, X. J., Lambert, M. F., Simpson, A. R., Liggett, J. A., and Vítkovský, J. P. (2002). “Leak detection in pipelines using damping of fluid transients.” J. Hydraul. Eng., 697–711.
Wu, Z. Y., Sage, P., and Turtle, D. (2010). “Pressure-dependent leak detection model and its application to a district water system.” J. Water Resour. Plann. Manage., 116–128.
Information & Authors
Information
Published In
Journal of Water Resources Planning and Management
Volume 140 • Issue 5 • May 2014
Pages: 572 - 584
Copyright
© 2013 American Society of Civil Engineers.
History
Received: May 26, 2012
Accepted: Jan 10, 2013
Published online: Jan 12, 2013
Discussion open until: Jun 12, 2013
Published in print: May 1, 2014
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.