Burst Detection by Analyzing Shape Similarity of Time Series Subsequences in District Metering Areas
Publication: Journal of Water Resources Planning and Management
Volume 146, Issue 1
Abstract
The paper proposes a burst detection method that relies on shape similarity analysis of time series subsequences (i.e., slices of time series). Subsequence libraries are constructed using flow (or water demand) data. Increase-rate distance is used to evaluate the shape similarity between subsequences, and abnormal subsequences are those that have low shape similarity with others. An abnormal subsequence searching algorithm first is used to remove abnormal subsequences, and the remaining subsequences are used to form reference libraries. Then the shape similarity between newly collected subsequences and reference libraries is evaluated to detect bursts. In the detection, a modified version of the abnormal subsequence searching algorithm can reduce the number of false alarms by finding the don’t-care segment in subsequences and improve the method’s detection ability by crossover between night subsequences. The method was applied to a network’s hydraulic model and three real-life district metering areas. Results show that the method’s detection performance is only slightly affected by seasonal changes of data and is insensitive to data sets from different networks.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
The following data, models, or code generated or used during the study are available from the corresponding author by request: Data generated by the hydraulic model, data of the three DMAs, and code for the proposed SSB method in MATLAB R2016b.
Acknowledgments
This work was jointly supported by the Water Major Program [2017ZX07201002]; and the National Key Research and Development Program of China for International Science & Innovation Cooperation Major Project between Governments [2016YFE0118800].
References
Bakker, M., J. H. G. Vreeburg, K. M. V. Schagen, and L. C. Rietveld. 2013. “A fully adaptive forecasting model for short-term drinking water demand.” Environ. Modell. Software 48 (5): 141–151. https://doi.org/10.1016/j.envsoft.2013.06.012.
Chiu, B., E. Keogh, and S. Lonardi. 2003. “Probabilistic discovery of time series motifs.” In Proc., 9th ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining, 493–498. Washington, DC: Association for Computing Machinery.
Choi, D. Y., S. W. Kim, M. A. Choi, and Z. W. Geem. 2016. “Adaptive Kalman filter based on adjustable sampling interval in burst detection for water distribution system.” Water 8 (4): 142. https://doi.org/10.3390/w8040142.
Eliades, D. G., and M. M. Polycarpou. 2012. “Leakage fault detection in district metered areas of water distribution systems.” J. Hydroinf. 14 (4): 992–1005. https://doi.org/10.2166/hydro.2012.109.
Guo, G., S. Liu, Y. Wu, J. Li, R. Zhou, and X. Zhu. 2018. “Short-term water demand forecast based on deep learning method.” J. Water Resour. Plann. Manage. 144 (12): 04018076. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000992.
Hastie, T., R. Tibshirani, J. H. Friedman, and J. Franklin. 2009. The elements of statistical learning. New York: Springer.
He, X., C. Shao, and Y. Xiong. 2014. “A new similarity measure based on shape information for invariant with multiple distortions.” Neurocomputing 129 (Apr): 556–569. https://doi.org/10.1016/j.neucom.2013.09.003.
Jung, D., D. Kang, J. Liu, and K. Lansey. 2015. “Improving the rapidity of responses to pipe burst in water distribution systems: A comparison of statistical process control methods.” J. Hydroinf. 17 (2): 307–328. https://doi.org/10.2166/hydro.2014.101.
Jung, D. H., and K. Lansey. 2015. “Water distribution system burst detection using a nonlinear Kalman filter.” J. Water Resour. Plann. Manage. 141 (5): 04014070. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000464.
Keogh, E., J. Lin, S.-H. Lee, and H. V. Herle. 2007. “Finding the most unusual time series subsequence: Algorithms and applications.” Knowl. Inf. Syst. 11 (1): 1–27. https://doi.org/10.1007/s10115-006-0034-6.
Laucelli, D., M. Romano, D. Savic, and O. Giustolisi. 2016. “Detecting anomalies in water distribution networks using EPR modelling paradigm.” J. Hydroinf. 18 (3): 409–427. https://doi.org/10.2166/hydro.2015.113.
Loureiro, D., C. Amado, A. Martins, D. Vitorino, A. Mamade, and S. T. Coelho. 2016. “Water distribution systems flow monitoring and anomalous event detection: A practical approach.” Urban Water J. 13 (3): 242–252. https://doi.org/10.1080/1573062X.2014.988733.
Mounce, S. R., J. B. Boxall, and J. Machell. 2010. “Development and verification of an online artificial intelligence system for detection of bursts and other abnormal flows.” J. Water Resour. Plann. Manage. 136 (3): 309–318. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000030.
Mounce, S. R., A. J. Day, A. S. Wood, A. Khan, P. D. Widdop, and J. Machell. 2002. “A neural network approach to burst detection.” Water Sci. Technol. 45 (4–5): 237–246. https://doi.org/10.2166/wst.2002.0595.
Mounce, S. R., R. B. Mounce, and J. B. Boxall. 2011. “Novelty detection for time series data analysis in water distribution systems using support vector machines.” J. Hydroinf. 13 (4): 672–686. https://doi.org/10.2166/hydro.2010.144.
Mounce, S. R., R. B. Mounce, and J. B. Boxall. 2012. “Identifying sampling interval for event detection in water distribution networks.” J. Water Resour. Plann. Manage. 138 (2): 187–191. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000170.
Mounce, S. R., R. B. Mounce, T. Jackson, J. Austin, and J. B. Boxall. 2014. “Pattern matching and associative artificial neural networks for water distribution system time series data analysis.” J. Hydroinf. 16 (3): 617–632. https://doi.org/10.2166/hydro.2013.057.
Nakamura, T., K. Taki, H. Nomiya, K. Seki, and K. Uehara. 2013. “A shape-based similarity measure for time series data with ensemble learning.” Pattern Anal. Appl. 16 (4): 535–548. https://doi.org/10.1007/s10044-011-0262-6.
Palau, C. V., F. J. Arregui, and M. Carlos. 2012. “Burst detection in water networks using principal component analysis.” J. Water Resour. Plann. Manage. 138 (1): 47–54. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000147.
Romano, M., Z. Kapelan, and D. A. Savic. 2012. “Automated detection of pipe bursts and other events in water distribution systems.” J. Water Resour. Plann. Manage. 140 (4): 457–467. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000339.
Rossman. 2000. EPANET2 user’s manual. Washington, DC: Environmental Protection Agency.
Tukey, J. W. 1977. Exploratory data analysis. Upper Saddle River, NJ: Addison-Wesley.
Wu, Y., S. Liu, and X. Wang. 2018a. “Distance-based burst detection using multiple pressure sensors in district metering areas.” J. Water Resour. Plann. Manage. 144 (11): 06018009. https://doi.org/10.1061/(ASCE)WR.1943-5452.0001001.
Wu, Y., S. Liu, X. Wu, Y. Liu, and Y. Guan. 2016. “Burst detection in district metering areas using a data driven clustering algorithm.” Water Res. 100 (Sep): 28–37. https://doi.org/10.1016/j.watres.2016.05.016.
Wu, Y. P., and S. M. Liu. 2017. “Clustering-based burst detection using multiple pressure sensors in district metering areas.” In Proc., Int. Computing and Control for the Water Industry Conf. Sheffield, UK: Univ. of Sheffield.
Wu, Y. P., S. M. Liu, K. Smith, and X. T. Wang. 2018b. “Using correlation between data from multiple monitoring sensors to detect bursts in water distribution systems.” J. Water Resour. Plann. Manage. 144 (2): 04017084. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000870.
Ye, G. L., and R. A. Fenner. 2011. “Kalman filtering of hydraulic measurements for burst detection in water distribution systems.” J. Pipeline Syst. Eng. Pract. 2 (1): 14–22. https://doi.org/10.1061/(ASCE)PS.1949-1204.0000070.
Ye, G. L., and R. A. Fenner. 2014. “Weighted least squares with expectation-maximization algorithm for burst detection in U.K. water distribution systems.” J. Water Resour. Plann. Manage. 140 (4): 417–424. https://doi.org/10.1061/(ASCE)WR.1943-5452.0000344.
Information & Authors
Information
Published In
Journal of Water Resources Planning and Management
Volume 146 • Issue 1 • January 2020
Copyright
©2019 American Society of Civil Engineers.
History
Received: Oct 25, 2018
Accepted: May 10, 2019
Published online: Oct 31, 2019
Published in print: Jan 1, 2020
Discussion open until: Mar 31, 2020
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.