A Robot System for Rapid and Intelligent Bridge Damage Inspection Based on Deep-Learning Algorithms
Publication: Journal of Performance of Constructed Facilities
Volume 37, Issue 6
Abstract
Large numbers of bridges have already suffered various types of damage but still operate all year round without proper treatment. Conducted primarily manually, the routine bridge inspections are ineffective in detecting potential damage in time due to a lack of relevant instruments and equipment, particularly modern measures. In this study, a rapid and intelligent bridge inspection system that integrates multiple modules and deep learning algorithms was established. First, the robot inspection equipment is established. Then, the You Only Look Once version 3 (YOLOv3) object detection algorithm is employed to classify four types of defects from the acquired data. Finally, an image segmentation algorithm is used to identify crack defects at a pixel level. Experimental results reveal that the proposed system can be effectively applied to accurately locate defects (e.g., cracks, spalls, exposed tendons, and free lime) and identify cracks at a pixel level on various types of bridges without affecting traffic.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
All data, models, and code generated or used during the study appear in the published article.
Acknowledgments
The authors gratefully acknowledge the National Natural Science Foundation of China (No. 52108163), the 03 Special and 5G Projects in Jiangxi Province (20224ABC03A03), and Jiangxi Natural Science Foundation General Project (20202babl2040058) for providing the funding that made this study possible.
Author contributions: conceptualization, Q. L., J. B., Z. Y., Y. Y., and J. B.; methodology, Q. L., and J. B.; writing—original draft preparation, Z. Y.; writing—review and editing, Y. Y.; and supervision, Q. L., and J. B.
References
Abdeljaber, O., O. Avci, S. Kiranyaz, M. Gabbouj, and D. J. Inman. 2017. “Real-time vibration-based structural damage detection using one-dimensional convolutional neural networks.” J. Sound Vib. 388 (Feb): 154–170. https://doi.org/10.1016/j.jsv.2016.10.043.
Atha, D. J., and M. R. Jahanshahi. 2018. “Evaluation of deep learning approaches based on convolutional neural networks for corrosion detection.” Struct. Health Monit. 17 (5): 1110–1128. https://doi.org/10.1177/1475921717737051.
Cha, Y. J., W. Choi, and O. Büyüköztürk. 2017. “Deep learning-based crack damage detection using convolutional neural networks.” Comput.-Aided Civ. Infrastruct. Eng. 32 (5): 361–378. https://doi.org/10.1111/mice.12263.
Charron, N., E. McLaughlin, S. Phillips, K. Goorts, S. Narasimhan, and S. L. Waslander. 2019. “Automated bridge inspection using mobile ground robotics.” J. Struct. Eng. 145 (11): 04019137. https://doi.org/10.1061/(ASCE)ST.1943-541X.0002404.
Chen, S., D. F. Laefer, E. Mangina, I. Zolanvari, and J. Byrne. 2019. “UAV bridge inspection through evaluated 3D reconstructions.” J. Bridge Eng. 24 (4): 05019001. https://doi.org/10.1061/(ASCE)BE.1943-5592.0001343.
Chen, Y. C., C. E. Yang, and S. C. Kang. 2014. “A lightweight bridge inspection system using a dual-cable suspension mechanism.” Autom. Constr. 46 (Oct): 52–63. https://doi.org/10.1016/j.autcon.2014.06.005.
Ho, H. N., K. D. Kim, Y. S. Park, and J. J. Lee. 2013. “An efficient image-based damage detection for cable surface in cable-stayed bridges.” NDT & E Int. 58 (Sep): 18–23. https://doi.org/10.1016/j.ndteint.2013.04.006.
Kocer, B. B., T. Tjahjowidodo, M. Pratama, and G. G. L. Seet. 2019. “Inspection-while-flying: An autonomous contact-based nondestructive test using UAV-tools.” Autom. Constr. 106 (Oct): 102895. https://doi.org/10.1016/j.autcon.2019.102895.
La, H. M., N. Gucunski, K. Dana, and S. H. Kee. 2017. “Development of an autonomous bridge deck inspection robotic system.” J. Field Rob. 34 (8): 1489–1504. https://doi.org/10.1002/rob.21725.
La, H. M., R. S. Lim, B. B. Basily, N. Gucunski, J. Yi, A. Maher, F. A. Romero, and H. Parvardeh. 2013. “Mechatronic systems design for an autonomous robotic system for high-efficiency bridge deck inspection and evaluation.” IEEE/ASME Trans. Mechatron. 18 (6): 1655–1664. https://doi.org/10.1109/TMECH.2013.2279751.
Lattanzi, D., and G. R. Miller. 2014. “3D scene reconstruction for robotic bridge inspection.” J. Infrastruct. Syst. 21 (2): 04014041. https://doi.org/10.1061/(ASCE)IS.1943-555X.0000229.
Lee, J. K., J. O. Kim, and S. J. Park. 2019. “A study on the UAV image-based efficiency improvement of bridge maintenance and inspection.” J. Intell. Fuzzy Syst. 36 (2): 967–983. https://doi.org/10.3233/JIFS-169873.
Li, G., S. He, Y. Ju, and K. Du. 2014. “Long-distance precision inspection method for bridge cracks with image processing.” Autom. Constr. 41 (May): 83–95. https://doi.org/10.1016/j.autcon.2013.10.021.
Li, Z., W. Lin, and Y. Zhang. 2023. “Real-time drive-by bridge damage detection using deep auto-encoder.” Structures 47 (Jan): 1167–1181. https://doi.org/10.1016/j.istruc.2022.11.094.
Lim, R. S., H. M. La, and W. Sheng. 2014. “A robotic crack inspection and mapping system for bridge deck maintenance.” IEEE Trans. Autom. Sci. Eng. 11 (2): 367–378. https://doi.org/10.1109/TASE.2013.2294687.
Ma, B. 2021. “Research on application of deep learning model for bridge damage detection.” Struct. Health Monit. 22 (2): 897–912. https://doi.org/10.26976/d.cnki.gchau.2021.001692.
Oh, J. K., G. Jang, S. Oh, J. H. Lee, B. J. Yi, Y. S. Moon, J. S. Lee, and Y. Choi. 2009. “Bridge inspection robot system with machine vision.” Autom. Constr. 18 (7): 929–941. https://doi.org/10.1016/j.autcon.2009.04.003.
Sanchez-Cuevas, P. J., P. Ramon-Soria, B. Arrue, A. Ollero, and G. Heredia. 2019. “Robotic system for inspection by contact of bridge beams using UAVs.” Sensors 19 (2): 305. https://doi.org/10.3390/s19020305.
Sithole, G., and G. Vosselman. 2006. “Bridge detection in airborne laser scanner data.” ISPRS J. Photogramm. Remote Sens. 61 (1): 33–46. https://doi.org/10.1016/j.isprsjprs.2006.07.004.
Sun, H. 2022. Bridge defect detection based on images captured by UAV. Xi’an, China: Chang’an Univ.
Sutter, B., A. Lelevé, M. T. Pham, O. Gouin, N. Jupille, M. Kuhn, P. Lulé, P. Michaud, and P. Rémy. 2018. “A semi-autonomous mobile robot for bridge inspection.” Autom. Constr. 91 (Jul): 111–119. https://doi.org/10.1016/j.autcon.2018.02.013.
Wickramasinghe, W. R., D. P. Thambiratnam, T. H. Chan, and T. Nguyen. 2016. “Vibration characteristics and damage detection in a suspension bridge.” J. Sound Vib. 375 (Aug): 254–274. https://doi.org/10.1016/j.jsv.2016.04.025.
Yeum, C. M., and S. J. Dyke. 2015. “Vision-based automated crack detection for bridge inspection.” Comput.-Aided Civ. Infrastruct. Eng. 30 (10): 759–770. https://doi.org/10.1111/mice.12141.
Zhang, C., C. C. Chang, and M. Jamshidi. 2020. “Concrete bridge surface damage detection using a single-stage detector.” Comput.-Aided Civ. Infrastruct. Eng. 35 (4): 389–409. https://doi.org/10.1111/mice.12500.
Zhu, S. 2020. Research on bridge crack detection algorithm based on convolutional neural network. Xi’an, China: Xi’an Univ.
Zhu, Z., S. German, and I. Brilakis. 2010. “Detection of large-scale concrete columns for automated bridge inspection.” Autom. Constr. 19 (8): 1047–1055. https://doi.org/10.1016/j.autcon.2010.07.016.
Information & Authors
Information
Published In
Journal of Performance of Constructed Facilities
Volume 37 • Issue 6 • December 2023
Copyright
© 2023 American Society of Civil Engineers.
History
Received: Dec 3, 2022
Accepted: Apr 24, 2023
Published online: Sep 23, 2023
Published in print: Dec 1, 2023
Discussion open until: Feb 23, 2024
ASCE Technical Topics:
- Algorithms
- Automation and robotics
- Bridge engineering
- Bridges
- Construction engineering
- Construction management
- Continuum mechanics
- Cracking
- Defects and imperfections
- Engineering fundamentals
- Engineering mechanics
- Equipment and machinery
- Fracture mechanics
- Inspection
- Integrated systems
- Materials characterization
- Materials engineering
- Mathematics
- Solid mechanics
- Structural engineering
- Systems engineering
- Systems management
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.