Image Processing–Based Framework for Determining Deterioration in Sewer Pipe Defects
This article has a reply.
VIEW THE REPLYPublication: Journal of Infrastructure Systems
Volume 28, Issue 4
Abstract
Municipal drainage systems play a key role in public health and are considered one of the main components of every modern city’s infrastructure. However, as a drainage system ages, its pipes gradually deteriorate at rates that vary based on the conditions of utilization. To prevent unexpected failures, municipalities have adopted a proactive approach that relies on regular condition assessments of their assets. At this juncture, a question that needs to be answered is how these assessment data can be used to optimize the frequency of inspections of the drainage pipes. In fact, when the assessment information is used in conjunction with deterioration models, city managers are able to develop data-driven maintenance, rehabilitation, and replacement plans based on the current condition of the assets and their risk of failure. As a result, understanding the rate at which defects evolve over time provides valuable information in terms of understanding the relationship between the various factors affecting defect development and pipe deterioration. This research presents an image registration framework for extracting crack development information from closed-circuit television (CCTV) videos of sewer pipes. Image processing techniques are used to estimate the relative change for a given defect from images taken at two different times. Because the parameters of cameras (e.g., model, location, angle of view) are generally not expected to be identical for consecutive inspection campaigns, the images to be compared were first scaled using a technique referred to as the area scaler (AS) to ensure all images have the same frame of reference. This scaling procedure is illustrated in a case study, containing 49 pairs of images that led to a relative error (with respect to the mean) generally not exceeding 5% when frames of the same defects contained a sufficient number of matching points.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
All data generated or analyzed during the study are available from the corresponding author by request.
Acknowledgments
The authors would like to thank EPCOR Drainage Services based in Edmonton, Canada, for their technical support and consultation. We gratefully acknowledge the financial support of the Natural Sciences and Engineering Research Council of Canada.
References
Adhikari, R. S., O. Moselhi, and A. Bagchi. 2014. “Image-based retrieval of concrete crack properties for bridge inspection.” Autom. Constr. 39 (Jun): 180–194. https://doi.org/10.1016/j.autcon.2013.06.011.
Brown, L. G. 1992. “A survey of image registration techniques.” ACM Comput. Surv. 24 (4): 325–376. https://doi.org/10.1145/146370.146374.
Buatik, A., I. Pasityothin, and K. Chaiyasarn. 2019. “Image-based multiview change detection in concrete structures.” In Proc., Int. Conf. on Smart Infrastructure and Construction. London: ICE Publishing.
Calonder, M., V. Lepetit, C. Strecha, and P. Fua. 2010. “BRIEF: Binary robust independent elementary features.” Lect. Notes Comput. Sci. 6314 (1): 778–792. https://doi.org/10.1007/978-3-642-15561-1_56.
Chen, L.-C., Y.-C. Shao, H.-H. Jan, C.-W. Huang, and Y.-M. Tien. 2006. “Measuring system for cracks in concrete using multitemporal images.” J. Surv. Eng. 132 (2): 77–82. https://doi.org/10.1061/(ASCE)0733-9453(2006)132:2(77).
Cheng, J. C. P., and M. Wang. 2018. “Automated detection of sewer pipe defects in closed-circuit television images using deep learning techniques.” Autom. Constr. 95 (Nov): 155–171. https://doi.org/10.1016/j.autcon.2018.08.006.
Choudhary, B. K., N. K. Sinha, and P. Shanker. 2012. “Pyramid method in image processing.” J. Inf. Syst. Commun. 3 (1): 269–273.
Chughtai, F., and T. Zayed. 2007. “Sewer pipeline operational condition prediction using multiple regression.” In Proc., Pipelines 2007: Advances and Experiences with Trenchless Pipeline Projects. Reston, VA: ASCE. https://doi.org/10.1061/40934(252)18.
Chughtai, F., and T. Zayed. 2008. “Infrastructure condition prediction models for sustainable sewer pipelines.” J. Perform. Constr. Facil. 22 (5): 333–341. https://doi.org/10.1061/(ASCE)0887-3828(2008)22:5(333).
Daher, S. 2015. “Defect-based condition assessment model and protocol of sewer pipelines.” Master’s thesis, Dept. of Building, Civil and Environmental Engineering, Concordia Univ.
Davari, A., T. Lindenberger, A. Häberle, V. Christlein, A. Maier, and C. Riess. 2017. Image registration for the alignment of digitized historical documents, 1–39. Ithaca, NY: arXiv. https://doi.org/10.48550/arXiv.1712.04482.
Deshmukh, M., and B. Bhosle. 2011. “A survey of image registration.” Int. J. Image Process. 5 (3): 245–269.
Foskey, M., B. Davis, L. Goyal, S. Chang, E. Chaney, N. Strehl, S. Tomei, J. Rosenman, and S. Joshi. 2005. “Large deformation three-dimensional image registration in image-guided radiation therapy.” Phys. Med. Biol. 50 (24): 5869–5892. https://doi.org/10.1088/0031-9155/50/24/008.
Gionis, A., P. Indyk, and R. Motwani. 1999. “Similarity search in high dimensions via hashing.” In Proc., 25th Int. Conf. on Very Large Data Bases, 518–529. San Francisco: Morgan Kaufmann Publishers.
Harris, C., and M. Stephens. 1988. “A combined corner and edge detector.” In Proc., Alvey Vision Conf. Oxen, UK: Alvey Vision Club.
Kanan, C., and G. W. Cottrell. 2012. “Color-to-grayscale: Does the method matter in image recognition?” PLoS One 7 (1): 029740. https://doi.org/10.1371/journal.pone.0029740.
Kim, J. W., S. Kim, J. Park, and J. Nam. 2015. “Development of crack detection system with unmanned aerial vehicles and digital image processing.” In Advances in structure engineering and mechanics. Daejeon, Korea: Techno-Press.
Kumar, S. S., D. M. Abraham, M. R. Jahanshahi, T. Iseley, and J. Starr. 2018. “Automated defect classification in sewer closed circuit television inspections using deep convolutional neural networks.” Autom. Constr. 91 (Oct): 273–283. https://doi.org/10.1016/j.autcon.2018.03.028.
Kuppala, K., S. Banda, and T. R. Barige. 2020. “An overview of deep learning methods for image registration with focus on feature-based approaches.” Int. J. Image Data Fusion 11 (3): 1–23. https://doi.org/10.1080/19479832.2019.1707720.
Li, D., A. Cong, and S. Guo. 2019. “Sewer damage detection from imbalanced CCTV inspection data using deep convolutional neural networks with hierarchical classification.” Autom. Constr. 101 (Jan): 199–208. https://doi.org/10.1016/j.autcon.2019.01.017.
Luo, C., W. Yang, P. Huang, and J. Zhou. 2019. “Overview of image matching based on ORB algorithm.” J. Phys. Conf. Ser. 1237 (3): 032020. https://doi.org/10.1088/1742-6596/1237/3/032020.
Meeker, E. 1971. “The improving health of the United States, 1850–1915.” Explorations Econ. History 9 (4): 353–373. https://doi.org/10.1016/0014-4983(71)90066-0.
Micevski, T., G. Kuczera, and P. Coombes. 2002. “Markov model for storm water pipe deterioration.” J. Infrastruct. Syst. 8 (2): 49–56. https://doi.org/10.1061/(ASCE)1076-0342(2002)8:2(49).
Oliveira, F. P. M., and J. M. R. S. Tavares. 2014. “Medical image registration: A review.” Comput. Methods Biomech. Biomed. Eng. 17 (2): 73–93. https://doi.org/10.1080/10255842.2012.670855.
Padmavathi, K., and K. Thangadurai. 2016. “Implementation of RGB and grayscale images in plant leaves disease detection—Comparative study.” Indian J. Sci. Technol. 9 (6): 4–9. https://doi.org/10.17485/ijst/2016/v9i6/77739.
Rosin, P. L. 1999. “Measuring corner properties.” Comput. Vision Image Understanding 73 (2): 291–307. https://doi.org/10.1006/cviu.1998.0719.
Rosten, E., and T. Drummond. 2005. “Fusing points and lines for high performance tracking.” In Proc., IEEE Int. Conf. on Computer Vision. New York: IEEE.
Rosten, E., and T. Drummond. 2006. “Machine learning for high-speed corner detection.” In Vol. 3951 of Computer Vision—ECCV 2006, edited by A. Leonardis, H. Bischof, and A. Pinz. Berlin: Springer. https://doi.org/10.1007/11744023_34.
Rublee, E., V. Rabaud, K. Konolige, and G. Bradski. 2011. “ORB: An efficient alternative to SIFT or SURF.” In Proc., 2011 Int. Conf. on Computer Vision, 2564–2571. New York: IEEE.
Saravanan, C. 2010. “Color image to grayscale image conversion.” In Proc., Int. Conf. on Computer Engineering and Applications, 196–199. New York: IEEE.
Siddharth, S., and K. Rajeev. 2014. “A survey of recent and classical image registration methods.” Int. J. Signal Process. Image Process. Pattern Recognit. 7 (4): 167–176. https://doi.org/10.14257/ijsip.2014.7.4.16.
Sohn, H. G., Y. M. Lim, K. H. Yun, and G. H. Kim. 2005. “Monitoring crack changes in concrete structures.” Comput.-Aided Civ. Infrastruct. Eng. 20 (1): 52–61. https://doi.org/10.1111/j.1467-8667.2005.00376.x.
Song, Z., S. Zhou, and J. Guan. 2014. “A novel image registration algorithm for remote sensing under affine transformation.” IEEE Trans. Geosci. Remote Sens. 52 (8): 4895–4912. https://doi.org/10.1109/TGRS.2013.2285814.
Syachrani, S., H. S. Jeong, and C. S. Chung. 2013. “Decision tree–based deterioration model for buried wastewater pipelines.” J. Perform. Constr. Facil. 27 (5): 633–645. https://doi.org/10.1061/(ASCE)CF.1943-5509.0000349.
Tareen, S. A. K., and Z. Saleem. 2018. “A comparative analysis of SIFT, SURF, KAZE, AKAZE, ORB, and BRISK.” In Proc., Int. Conf. on Computing, Mathematics and Engineering Technologies—ICoMET, 1–10. New York: IEEE. https://doi.org/10.1109/ICOMET.2018.8346440.
Yang, Y. S., C. Wu, T. T. C. Hsu, H. C. Yang, H. J. Lu, and C. C. Chang. 2018. “Image analysis method for crack distribution and width estimation for reinforced concrete structures.” Autom. Constr. 91 (Mar): 120–132. https://doi.org/10.1016/j.autcon.2018.03.012.
Yin, X., Y. Chen, A. Bouferguene, and M. Al-Hussein. 2020a. “Data-driven bi-level sewer pipe deterioration model: Design and analysis.” Autom. Constr. 116 (Aug): 103181. https://doi.org/10.1016/j.autcon.2020.103181.
Yin, X., Y. Chen, A. Bouferguene, H. Zaman, M. Al-Hussein, and L. Kurach. 2020b. “A deep learning-based framework for an automated defect detection system for sewer pipes.” Autom. Constr. 109 (Jun): 102967. https://doi.org/10.1016/j.autcon.2019.102967.
Yin, X., Y. Chen, A. Bouferguene, H. Zaman, M. Al-Hussein, R. Russell, and L. Kurach. 2019. “Standard closed-circuit television (CCTV) collection time extraction of sewer pipes with machine learning algorithm.” In Proc., 36th Int. Symp. on Automation and Robotics in Construction, 107–113. Edmonton, AB, Canada: International Association for Automation and Robotics in Construction, Univ. of Alberta. https://doi.org/10.22260/ISARC2019/0015.
Yin, X., T. Ma, A. Bouferguene, and M. Al-Hussein. 2021. “Automation for sewer pipe assessment: CCTV video interpretation algorithm and sewer pipe video assessment (SPVA) system development.” Autom. Constr. 125 (Jul): 103622. https://doi.org/10.1016/j.autcon.2021.103622.
Zelinski, M. E., J. R. Henderson, and E. Held. 2018. “Image registration and change detection for artifact detection in remote sensing imagery.” Proc. SPIE Int. Soc. Opt. Eng. 24 (May): 10644. https://doi.org/10.1117/12.2303934.
Zitová, B., and J. Flusser. 2003. “Image registration methods: A survey.” Image Vision Comput. 21 (11): 977–1000. https://doi.org/10.1016/S0262-8856(03)00137-9.
Information & Authors
Information
Published In
Journal of Infrastructure Systems
Volume 28 • Issue 4 • December 2022
Copyright
© 2022 American Society of Civil Engineers.
History
Received: Mar 4, 2021
Accepted: Jun 3, 2022
Published online: Aug 29, 2022
Published in print: Dec 1, 2022
Discussion open until: Jan 29, 2023
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.