New Crack Detection Method for Bridge Inspection Using UAV Incorporating Image Processing
Publication: Journal of Aerospace Engineering
Volume 31, Issue 5
Abstract
Unmanned aerial vehicle (UAV) technologies combined with digital image processing have been applied to the crack inspection of bridge structures to overcome the drawbacks of manual visual inspection. However, because of environmental interference such as uneven natural light, noises produced by the UAV hardware, spots on the road surface, and UAV jitter, the collected images by UAVs are usually fuzzy and have relatively low contrast. In the processing of such collected images the traditional edge detection algorithms such as Canny algorithm, Prewitt algorithm, and Sobel algorithm have low detection accuracy because of their poor antinoise ability. K-means clustering method is one of the unsupervised learning methods. Nevertheless, in the case of a small amount of images, it cannot achieve the accurate identification of the cracks from the collected image. In this paper, a new crack detection method based on the crack central point, namely crack central point method (CCPM), is proposed to address these essential issues. With a small amount of images, the new method can quickly and accurately identify the cracks in the collected images. Compared with the traditional edge detection methods and K-means clustering method, the CCPM method has better adaptability and robustness.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
This material is based on research supported by supported by the National Natural Science Foundation of China (No. 61305110), and the Research Project of Hubei Provincial Department of Education (No. D20171101). The data present, the statements made, and the view expressed are solely the responsibility of the authors.
References
Abdel-Qader, I., O. Abudayyeh, and M. E. Kelly. 2003. “Analysis of edge-detection techniques for crack identification in bridges.” J. Comput. Civ. Eng. 17 (4): 255–263. https://doi.org/10.1061/(ASCE)0887-3801(2003)17:4(255).
Basu, M. 2002. “Gaussian-based edge-detection methods-a survey.” IEEE Trans. Syst. Man, and Cybern. Part C: Appl. Rev. 32 (3): 252–260. https://doi.org/10.1109/TSMCC.2002.804448.
Berthelot, M., N. Nony, L. Gugi, A. Bishop, and L. De Luca. 2015. “The Avignon bridge: A 3D reconstruction project integrating archaeological, historical and gemorphological issues.” Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci. XL-5/W4 (5): 223–227. https://doi.org/10.5194/isprsarchives-XL-5-W4-223-2015.
Cha, Y. J., W. Choi, and O. Büyüköztürk. 2017. “Deep learning-based crack damage detection using convolutional neural networks.” Comput.-Aided Civ. Infrastruct. Eng. 32 (5): 361–378. https://doi.org/10.1111/mice.12263.
Chinese Standard. 2008. Standard for appraisal of reliability of industrial buildings and structures. GB 50144-2008, 38. Beijing: Chinese Standard.
Chitade, A. Z., and S. K. Katiyar. 2010. “Color based image segmentation using k-means clustering.” Int. J. Eng. Sci. Technol. 2 (10): 5319–5325.
Choi, S. S., and E. K. Kim. 2015. “Building crack inspection using small UAV.” In Proc., 17th Int. Conf. on Advanced Communication Technology (ICACT), 235–238. PyeongChang, Korea: IEEE.
Dong, Y., R. Song, and H. Liu. 2010. “Bridges structural health monitoring and deterioration detection-synthesis of knowledge and technology.” Fairbanks, AK: Univ. of Alaska Fairbanks, Dept. of Civil and Environmental Engineering.
Eschmann, C., C. M. Kuo, C. H. Kuo, and C. Boller. 2013. “High-resolution multisensor infrastructure inspection with unmanned aircraft systems.” Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci. XL-1/W2: 125–129. https://doi.org/10.5194/isprsarchives-XL-1-W2-125-2013.
Gallagher, K., and P. Lawrence. 2016. “Unmanned systems and managing from above: The practical implications of UAVs for research applications addressing urban sustainability.” In Urban sustainability: Policy and praxis, 217–232. Cham, Switzerland: Springer.
He, K., J. Sun, and X. Tang. 2013. “Guided image filtering.” IEEE Trans. Pattern Anal. Mach. Intell. 35 (6): 1397–1409. https://doi.org/10.1109/TPAMI.2012.213.
Hill, D. 2014. “Researchers have high hopes for drone use in transportation.” Civ. Eng. Mag. Archive 84 (4): 38–39. https://doi.org/10.1061/ciegag.0000661.
Hutchinson, T. C., and Z. Chen. 2006. “Improved image analysis for evaluating concrete damage.” J. Comput. Civ. Eng. 20 (3): 210–216. https://doi.org/10.1061/(ASCE)0887-3801(2006)20:3(210).
Kanistras, K., G. Martins, M. J. Rutherford, and K. P. Valavanis. 2015. “Survey of unmanned aerial vehicles (UAVs) for traffic monitoring.” In Handbook of unmanned aerial vehicles, 2643–2666. Dordrecht, Netherlands: Springer.
Khaloo, A., D. Lattanzi, K. Cunningham, R. Dell’Andrea, and M. Riley. 2017. “Unmanned aerial vehicle inspection of the Placer river trail bridge through image-based 3D modelling.” Struct. Infrastruct. Eng. 14 (1): 124–136. https://doi.org/10.1080/15732479.2017.1330891.
Khan, F., A. Ellenberg, S. Ye, A. E. Aktan, F. Moon, A. Kontsos, A. Pradhan, and I. Bartoli. 2014. “Multispectral aerial imaging for infrastructure evaluation.” In Proc., NDE/NDT for Structural Materials Technology for Highway and Bridges Conf., 123–130. Washington, DC: American Society for Nondestructive Testing.
Kheradmand, A., and P. Milanfar. 2014. “A general framework for regularized, similarity-based image restoration.” IEEE Trans. Image Process. 23 (12): 5136–5151. https://doi.org/10.1109/TIP.2014.2362059.
Kim, H., S. H. Sim, and S. Cho. 2015. “Unmanned aerial vehicle (UAV)-powered concrete crack detection based on digital image processing.” In Proc., 6th Int. Conf. on Advances in Experimental Structural Engineering, 11th Int. Workshop on Advanced Smart Materials and Smart Structures Technology, 1–2. Urbana, IL: Univ. of Illinois Urbana-Champaign.
Kim, R. E., and B. F. Spencer Jr. 2015. Modeling and monitoring of the dynamic response of railroad bridges using wireless smart sensors. Champaign, IL: Univ. of Illinois at Urbana-Champaign.
Kumar, M., and R. Saxena. 2013. “Algorithm and technique on various edge detection: A survey.” Signal Image Process. 4 (3): 65–75. https://doi.org/10.5121/sipij.2013.4306.
Liu, M., D. M. Frangopol, and S. Kim. 2009. “Bridge safety evaluation based on monitored live load effects.” J. Bridge Eng. 14 (4): 257–269. https://doi.org/10.1061/(ASCE)1084-0702(2009)14:4(257).
Liu, Y., S. Cho, B. F. Spencer Jr., and J. Fan. 2014a. “Automated assessment of cracks on concrete surfaces using adaptive digital image processing.” Smart Struct. Syst. 14 (4): 719–741. https://doi.org/10.12989/sss.2014.14.4.719.
Liu, Y., S. Cho, B. F. Spencer Jr., and J. Fan. 2014b. “Concrete crack assessment using digital image processing and 3D scene reconstruction.” J. Comput. Civ. Eng. 30 (1): 04014124. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000446.
Marques, O. 2011. Practical image and video processing using MATLAB. New York: Wiley.
McCrea, A., D. Chamberlain, and R. Navon. 2002. “Automated inspection and restoration of steel bridges—A critical review of methods and enabling technologies.” Autom. Constr. 11 (4): 351–373.
Metni, N., and T. Hamel. 2007. “A UAV for bridge inspection: Visual serving control law with orientation limits.” Autom. Constr. 17 (1): 3–10. https://doi.org/10.1016/j.autcon.2006.12.010.
Nishikawa, T., J. Yoshida, T. Sugiyama, and Y. Fujino. 2012. “Concrete crack detection by multiple sequential image filtering.” Comput.-Aided Civ. Infrastruct. Eng. 27 (1): 29–47. https://doi.org/10.1111/j.1467-8667.2011.00716.x.
Omar, T., and M. L. Nehdi. 2017. “Remote sensing of concrete bridge decks using unmanned aerial vehicle infrared thermography.” Autom. Constr. 83 (Nov): 360–371. https://doi.org/10.1016/j.autcon.2017.06.024.
Otero, L. D., N. Gagliardo, D. Dalli, W. H. Huang, and P. Cosentino. 2015. Proof of concept for using unmanned aerial vehicles for high mast pole and bridge inspections. Melbourne, FL: Dept. of Engineering System, Florida Institute of Technology.
Parker, J. R. 2010. Algorithms for image processing and computer vision. New York: Wiley.
Pereira, F. C., and C. E. Pereira. 2015. “Embedded image processing systems for automatic recognition of cracks using UAVs.” IFAC-PapersOnLine 48 (10): 16–21. https://doi.org/10.1016/j.ifacol.2015.08.101.
Ramamurthy, B., and K. R. Chandran. 2011. “CBMIR: Shape-based image retrieval using canny edge detection and k-means clustering algorithms for medical images.” Int. J. Eng. Sci. Technol. 3 (3): 209–212.
Sigurdardottir, D. H., and B. Glisic. 2015. “On-site validation of fiber-optic methods for structural health monitoring: Streicker bridge.” J. Civ. Struct. Health Monitor. 5 (4): 529–549. https://doi.org/10.1007/s13349-015-0123-x.
Sinha, S. K., and P. W. Fieguth. 2006. “Automated detection of cracks in buried concrete pipe images.” Autom. Constr. 15 (1): 58–72. https://doi.org/10.1016/j.autcon.2005.02.006.
Su, M. C., and C. H. Chou. 2001. “A modified version of the K-means algorithm with a distance based on cluster symmetry.” IEEE Trans. Pattern Anal. Mach. Intell. 23 (6): 674–680. https://doi.org/10.1109/34.927466.
Sulaiman, S. N., and N. A. M Isa. 2010. “Adaptive fuzzy-K-means clustering algorithm for image segmentation.” IEEE Trans. Consum. Electron. 56 (4): 2661–2668. https://doi.org/10.1109/TCE.2010.5681154.
Vincent, O. R., and O. Folorunso. 2009. “A descriptive algorithm for Sobel image edge detection.” In Vol. 40 of Proc., Informing Science and IT Education Conf. (InSITE), 97–107. Macon, GA: Information Science Institute.
Wang, N., X. Chen, G. Song, Q. Lan, and H. R. Parsaei. 2017. “Design of a new mobile-optimized remote laboratory application architecture for M-learning.” IEEE Trans. Ind. Electron. 64 (3): 2382–2391. https://doi.org/10.1109/TIE.2016.2620102.
Wang, N., X. Chen, G. Song, and H. Parsaei. 2015. “Using node-HTTP-proxy for remote experiment data transmission traversing firewall.” Int. J. Online Eng. 11 (2): 60–67. https://doi.org/10.3991/ijoe.v11i2.4443.
Yamaguchi, T., and S. Hashimoto. 2010. “Fast crack detection method for large-size concrete surface images using percolation-based image processing.” Mach. Vision Appl. 21 (5): 797–809. https://doi.org/10.1007/s00138-009-0189-8.
Yehia, S., O. Abudayyeh, I. Fazal, and D. Randolph. 2008. “A decision support system for concrete bridge deck maintenance.” Adv. Eng. Software 39 (3): 202–210. https://doi.org/10.1016/j.advengsoft.2007.02.002.
Zhao, H., G. Qin, and X. Wang. 2010. “Improvement of canny algorithm based on pavement edge detection.” In Vol. 2 of Proc., Image and Signal Processing (CISP), 2010 3rd Int. Congress, 964–967. Yantai, China: IEEE.
Zheng, Y., X. Zhang, B. Hou, and G. Liu. 2014. “Using combined difference image and k-means clustering for SAR image change detection.” IEEE Geosci. Remote Sens. Lett. 11 (3): 691–695. https://doi.org/10.1109/LGRS.2013.2275738.
Zhu, J., M. Ho, D. Patil, N. Wang, R. Hirsch, and G. Song. 2017. “Underwater pipeline impact localization using piezoceramic transducers.” Smart Mater. Struct. 26 (10): 107002. https://doi.org/10.1088/1361-665X/aa80c9.
Information & Authors
Information
Published In
Journal of Aerospace Engineering
Volume 31 • Issue 5 • September 2018
Copyright
©2018 American Society of Civil Engineers.
History
Received: Oct 3, 2017
Accepted: Feb 26, 2018
Published online: Jun 11, 2018
Published in print: Sep 1, 2018
Discussion open until: Nov 11, 2018
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.