Automated Data-Driven Approaches to Evaluating and Interpreting Water Quality Time Series Data from Water Distribution Systems
Publication: Journal of Water Resources Planning and Management
Volume 141, Issue 11
Abstract
Water distribution networks are not inert transport systems. The high-quality water produced at water treatment works is subject to a variety of complex and interacting physical, chemical, and biological interactions within these highly variable, high-surface reactors. In particular, the aging and deteriorating asset condition in water distribution systems can result in a degradation of water quality delivered to the customer, often experienced as discoloration caused by increasing amounts of fine particulate matter. Here, it is proposed that by assessing measured turbidity over time, in particular its correlation with local hydraulics, an assessment of change in risk of fouling can be obtained and asset deterioration inferred. This paper presents a methodology for pairwise monitoring of a hydraulic parameter (flow or pressure) and turbidity using wavelet-based semblance analysis—a novel methodology from another domain, which is applied for the first time to water quality data in distribution systems. It is suggested and subsequently explored through case studies that an increasing (anti) correlation of the turbidity with the (pressure) flow diurnal cycle will be indicative of increasing fouling risk. This can be further supported through evaluation of the rate and magnitude of drift and through assessment of the change in magnitude of the daily turbidity profile. The composite of these approaches is applied to an extensive data set from a United Kingdom distribution system revealing the effectiveness of the analysis preflushing and postflushing (reducing discoloration events by 64–89%). With increasing proliferation of monitoring devices and real-time data acquisition the potential for online systems and well-informed proactive management is apparent.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
This work was supported by the Pipe Dreams project (EP/G029946/1) funded by the United Kingdom Science and Engineering Research Council. The authors would like to thank South East Water—particularly Neil Hudson and Benjamin Smith—and Evoqua Water Technologies Ltd. for field access and data provision.
References
Addison, P. S. (2002). The illustrated wavelet transform handbook, introductory theory and applications in science, engineering, medicine and finance, Institute of Physics, London.
Blokker, M. J., Schaap, P. G., and Vreeburg, J. H. G. (2011). “Comparing the fouling rate of a drinking water distribution system in two different configurations.” Urban water management: challenges and opportunities, D. A. Savic, Z. Kapelan, and D. Butler, eds., Centre for Water Systems, Univ. of Exeter, Devon, U.K.
Boxall, J. B., and Saul, A. J. (2005). “Modelling discolouration in potable water distribution systems.” J. Environ. Eng., 716–725.
Cook, D. (2007). “Field investigation of discolouration material accumulation rates in live drinking water distribution systems.” Ph.D. thesis, Univ. of Sheffield, Sheffield, U.K.
Cook, D., and Boxall, J. (2011). “Discoloration material accumulation in water distribution systems.” J. Pipeline Syst. Eng. Pract., 113–122.
Cooper, G. R. J., and Cowan, D. R. (2008). “Comparing time series using wavelet-based semblance analysis.” Comput. Geosci., 34(2), 95–102.
Daubechies, I. (1988). “Orthonormal bases of compactly supported wavelets.” Comm. Pure Appl. Math., 41(7), 909–966.
Douterelo, I., Sharpe, R. L., and Boxall, J. B. (2013). “Influence of hydraulic regimes on bacterial community structure and composition in an experimental drinking water distribution system.” Water Res., 47(2), 503–516.
DWI (Drinking Water Inspectorate). (2012). “Letter to minister—England.”, 〈http://dwi.defra.gov.uk/about/annual-report/2012/letter-english.pdf〉 (Jun. 7, 2014).
EPA. (2010). “Water quality event detection systems for drinking water contamination warning systems: Development, testing and application of CANARY.”, Washington, DC.
Furnass, W. R., Collins, R. P., Husband, P. S., Mounce, S. R., and Boxall, J. B. (2014). “Modelling both the continual erosion and regeneration of discolouration material in drinking water distribution systems.” IWA Water Sci. Technol. Water Supply, 14(1), 81–90.
Furnass, W. R., Mounce, S. R., and Boxall, J. B. (2013). “Linking distribution system water quality issues to possible causes via hydraulic pathways.” J. Environ. Model. Software, 40, 78–87.
Gaffney, J. W., and Boult, S. (2011). “The need for and use of high resolution turbidity monitoring in managing discolouration in distribution.” J. Environ. Eng., 138(6), 637–644.
Haar, A. (1910). “Zur Theorie der orthogonalen Funktionensysteme.” Math. Ann., 69(3), 331–371.
Hamao, Y., Masulis, R. W., and Ng, V. (1990). “Correlations in price changes and volatility across international stock markets.” Rev. Finan. Stud., 3(2), 281–307.
Hansen, B. E. (2001). “The new economics of structural change: Dating breaks in U.S. labor productivity.” J. Econ. Perspect., 15(4), 117–128.
Hart, D. B., and McKenna, S. A. (2009). “CANARY user’s manual, version 4.1.”, U.S. Environmental Protection Agency, Office of Research and Development, National Homeland Security Research Center, Cincinnati.
Husband, P. S., and Boxall, J. B. (2011). “Asset deterioration and discolouration in water distribution systems.” Water Res., 45(1), 113–124.
Husband, P. S., Boxall, J. B., and Saul, A. J. (2008). “Laboratory studies investigating the processes leading to discolouration in water distribution networks.” Water Res., 42(16), 4309–4318.
Husband, P. S., Jackson, M., and Boxall, J. (2011). “Trunk main discolouration trials and strategic planning.” Proc., Urban Water Management: Challenges and Opportunities, D. A. Savic, Z. Kapelan, and D. Butler, eds., Centre for Water Systems, Univ. of Exeter, Devon, U.K.
Khan, A., Widdop, P. D., Day, A. J., Wood, A. S., Mounce, S. R., and Machell, J. (2005). “Performance assessment of leak detection failure sensors used in a water distribution system.” J. Water Supply Res. Technol., 54(1), 25–36.
Lehtola, M. J., Nissinen, T. K., Miettinen, I. T., Martikainen, P. J., and Vartiainen, T. (2004). “Removal of soft deposits from the distribution system improves the drinking water quality.” Water Res., 38(3), 601–610.
Mallat, S. (1998). A wavelet tour of signal processing, Academic, New York.
Masters, T. (1995). Neural, novel and hybrid algorithms for time series prediction, Wiley, New York.
MATLAB version 7.14 [Computer software]. Natick, MA, Mathworks.
McKenna, S. A., Klise, K. A., and Wilson, M. P. (2006). “Testing water quality change detection algorithms.” Proc., 8th Annual Water Distribution Systems Analysis Symp., ASCE, Reston, VA.
Mounce, S. R., Boxall, J. B., and Machell, J. (2010). “Development and verification of an online artificial intelligence system for burst detection in water distribution systems.” Water Resour. Plann. Manage., 309–318.
Mounce, S. R., Machell, J., and Boxall, J. B. (2012). “Water quality event detection and customer complaint clustering analysis in distribution systems.” IWA J. Water Sci. Technol. Water Supply, 12(5), 580–587.
Sekar, R., Deines, P., Machell, J., Boxall, J. B., Biggs, C. A., and Osborn, A. M. (2012). “Bacterial water quality and network hydraulic characteristics: A field study of a small, looped water distribution system using culture-independent molecular methods.” J. Appl. Microbiol., 112(6), 1220–1234.
Sharpe, R. L., Smith, C. J., Biggs, C. A., and Boxall, J. B., (2010). “Pilot scale laboratory investigations into the impact of steady state conditioning hydraulics on potable water discolouration.” Proc., 11th Annual Int. Symp. on Water Distribution Systems Analysis, ASCE, Reston, VA.
Teolis, A. (1998). Computational signal processing with wavelets, Birkhauser, Boston, 352.
Torrence, C., and Compo, G. P. (1998). “A practical guide to wavelet analysis.” Bull. Am. Meteorol. Soc., 79(1), 61–78.
UKWIR (United Kingdom Water Industry Research). (2013). Cost benefit analysis of ubiquitous data collection in water distribution—CBA scenarios, London.
von Frese, R. R. B., Jones, M. B., Kim, J. W., and Kim, J. H. (1997). “Analysis of anomaly correlations.” Geophysics, 62(1), 342–351.
Vreeburg, J. (2007). Discolouration in drinking water systems: A particular approach, Technical Univ. Delft, Delft, Netherlands, 183.
Vreeburg, J., and Boxall, J. B. (2007). “Discoloration in potable water distribution systems: A review.” Water Res., 41(3), 519–529.
Information & Authors
Information
Published In
Journal of Water Resources Planning and Management
Volume 141 • Issue 11 • November 2015
Copyright
© 2015 American Society of Civil Engineers.
History
Received: Jun 8, 2014
Accepted: Feb 4, 2015
Published online: May 13, 2015
Discussion open until: Oct 13, 2015
Published in print: Nov 1, 2015
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.