A Detection Method for Bridge Cables Based on Intelligent Image Recognition and Magnetic-Memory Technology
Publication: Journal of Performance of Constructed Facilities
Volume 36, Issue 6
Abstract
In recent years, more and more disasters caused by the fracture of bridge cables have been reported. Brittle fracture of cables is mainly caused by corrosion fatigue, and thus it is crucial to find cable defects early. The present study developed a cable inspection method embedded with a lightweight deep-learning model and equipped with micromagnetic sensors, based on intelligent image recognition and magnetic memory technology. After four cable-stayed bridges were found with defects, five types of defects and features on the surface of cables were identified by the SqueezeNet network model with the image denoising algorithm and transfer-learning method, with accuracy of 97.18%. The corrosion along the cable was positioned with micromagnetic sensors. Four alerting levels were proposed and corresponding remedial measures were suggested to be implemented. The novelty of this work lies in the intelligent detection of bridge defects, as well as accurate evaluation of long-term performance of bridge cables.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
All data, models, and code generated or used during the study appear in the published article.
Acknowledgments
The authors gratefully acknowledge the National Natural Science Foundation of China (No. 52108163), the Major Special Project of Tianjin Rail Transit (No. 18ZXGDGX00050), the Tianjin Education Commission (No. 2017KJ047) for providing the funding that made this study possible, and the 03 special and 5G projects in Jiangxi Province (20203ABC03B05).
References
Atha, D. J., and M. R. Jahanshahi. 2018. “Evaluation of deep learning approaches based on convolutional neural networks for corrosion detection.” Struct. Health Monit. 17 (5): 1110–1128. https://doi.org/10.1177/1475921717737051.
Bastian, B. T., N. Jaspreeth, S. K. Ranjith, and C. V. Jiji. 2019. “Visual inspection and characterization of external corrosion in pipelines using deep neural network.” NDT&E Int. 107 (Oct): 102134. https://doi.org/10.1016/j.ndteint.2019.102134.
Diederich, H., and T. Vogel. 2017. “Evaluation of reinforcing bars using the magnetic flux leakage method.” J. Infrastruct. Syst. 23 (1): B4016001. https://doi.org/10.1061/(ASCE)IS.1943-555X.0000306.
Ding, N., Z. Zheng, J. Song, Z. Sun, T. L. Lam, and H. Qian. 2020. “CCRobot-III: A split-type wire-driven cable climbing robot for cable-stayed bridge inspection.” In Proc., 2020 IEEE Int. Conf. on Robotics and Automation (ICRA), 9308–9314. New York: IEEE. https://doi.org/10.1109/ICRA40945.2020.9196772.
Gao, M., H. Wu, Y. Shen, X. Wang, and Y. Zeng. 2019. “A peak detection algorithm adopting magnetic sensor signal for rail spike location in tamping machine.” Adv. Mech. Eng. 11 (11): 1687814019891570. https://doi.org/10.1177/1687814019891570.
Gopalakrishnan, K., S. K. Khaitan, A. Choudhary, and A. Agrawal. 2017. “Deep convolutional neural networks with transfer learning for computer vision-based data-driven pavement distress detection.” Constr. Build. Mater. 157 (Dec): 322–330. https://doi.org/10.1016/j.conbuildmat.2017.09.110.
He, K., X. Zhang, S. Ren, and J. Sun. 2016. “Deep residual learning for image recognition.” In Proc., IEEE Conf. on Computer Vision and Pattern Recognition, 770–778. New York: IEEE.
Hou, S., B. Dong, H. Wang, and G. Wu. 2020. “Inspection of surface defects on stay cables using a robot and transfer learning.” Autom. Constr. 119 (Nov): 103382. https://doi.org/10.1016/j.autcon.2020.103382.
Humpe, A. 2020. “Bridge inspection with an off-the-shelf 360° camera drone.” Drones 4 (4): 67. https://doi.org/10.3390/drones4040067.
Iandola, F. N., S. Han, M. W. Moskewicz, K. Ashraf, W. J. Dally, and K. Keutzer. 2016. “SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and model size.” Preprint, submitted February 24, 2016. https://arxiv.org/abs/1602.07360.
Jeon, C. H., C. D. Nguyen, and C. S. Shim. 2020. “Assessment of mechanical properties of corroded prestressing strands.” Appl. Sci. 10 (12): 4055. https://doi.org/10.3390/app10124055.
Jordan, M. I., and T. M. Mitchell. 2015. “Machine learning: Trends, perspectives, and prospects.” Science 349 (6245): 255–260. https://doi.org/10.1126/science.aaa8415.
Kamilaris, A., and F. X. Prenafeta-Boldú. 2018. “Deep learning in agriculture: A survey.” Comput. Electron. Agric. 147 (Apr): 70–90. https://doi.org/10.1016/j.compag.2018.02.016.
Kaur, T., and T. K. Gandhi. 2020. “Deep convolutional neural networks with transfer learning for automated brain image classification.” Mach. Vision Appl. 31 (3): 1–16. https://doi.org/10.1007/s00138-020-01069-2.
LeCun, Y., Y. Bengio, and G. Hinton. 2015. “Deep learning.” Nature 521 (7553): 436–444. https://doi.org/10.1038/nature14539.
Li, X., Y. Guo, and Y. Li. 2019. “Particle swarm optimization-based SVM for classification of cable surface defects of the cable-stayed bridges.” IEEE Access 8 (Dec): 44485–44492. https://doi.org/10.1109/ACCESS.2019.2961755.
Lin, J., C. Gan, and S. Han. 2019. “Temporal shift module for efficient video understanding.” In Proc., IEEE[C]//CVF Int. Conf. on Computer Vision (ICCV), 7082–7092. New York: IEEE.
Masters, D., and C. Luschi. 2018. “Revisiting small batch training for deep neural networks.” Preprint, submitted April 20, 2018. https://arxiv.org/abs/1804.07612.
Ministry of Transport of the People’s Republic of China. 2011. Standards for technical condition evaluation of highway bridges. JTG/T H21. Beijing, China: Ministry of Transport of the People’s Republic of China.
Perez, H., J. H. Tah, and A. Mosavi. 2019. “Deep learning for detecting building defects using convolutional neural networks.” Sensors 19 (16): 3556. https://doi.org/10.3390/s19163556.
Redmon, J., and A. Farhadi. 2017. “YOLO9000: Better, faster, stronger.” In Proc., IEEE Conf. on Computer Vision and Pattern Recognition, 7263–7271. New York: IEEE.
Rumelhart, D. E., G. E. Hinton, and R. J. Williams. 1986. “Learning representations by back-propagating errors.” Nature 323 (6088): 533–536. https://doi.org/10.1038/323533a0.
Seo, J., L. Duque, and J. Wacker. 2018. “Drone-enabled bridge inspection methodology and application.” Autom. Constr. 94 (Oct): 112–126. https://doi.org/10.1016/j.autcon.2018.06.006.
Shindo, Y., and O. Noro. 2014. “Simple circuit simulation models for eddy current in magnetic sheets and wires.” IEEJ Trans. Fundam. Mater. 134 (4): 173–181. https://doi.org/10.1541/ieejfms.134.173.
Silva, W. R. L. D., and D. S. D. Lucena. 2018. “Concrete cracks detection based on deep learning image classification.” Multidiscip. Dig. Publ. Inst. Proc. 2 (8): 489. https://doi.org/10.3390/ICEM18-05387.
Simonyan, K., and A. Zisserman. 2014. “Very deep convolutional networks for large-scale image recognition.” Preprint, submitted September 4, 2014. https://arXiv.org/abs/1409.1556.
Szegedy, C., W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, and A. Rabinovich. 2015. “Going deeper with convolutions.” In Proc., IEEE Conf. on Computer Vision and Pattern Recognition, 1–9. New York: IEEE.
Tang, Z. F., X. D. Sui, Y. F. Duan, P. F. Zhang, and C. B. Yun. 2021. “Guided wave-based cable damage detection using wave energy transmission and reflection.” Struct. Control Health Monit. 28 (5): e2688. https://doi.org/10.1002/stc.2688.
Wang, L., J. Dang, X. Wang, and A. Shrestha. 2021. “Waveform-based fracture identification of steel beam ends using convolutional neural networks.” Struct. Control Health Monit. 28 (9): e2777. https://doi.org/10.1002/stc.2777.
Wang, Y., W. Zhang, and Y. Zheng. 2020. “Experimental study on corrosion fatigue performance of high-strength steel wire with initial defect for bridge cable.” Appl. Sci. 10 (7): 2293. https://doi.org/10.3390/app10072293.
Wei, X., Z. Yang, Y. Liu, D. Wei, L. Jia, and Y. Li. 2019. “Railway track fastener defect detection based on image processing and deep learning techniques: A comparative study.” Eng. Appl. Artif. Intell. 80 (Dec): 66–81. https://doi.org/10.1016/j.engappai.2019.01.008.
Wei, Y. W., J. F. Lai, X. B. Sun, J. P. Liu, D. Z. Tan, H. B. Ye, H. L. Chen, J. Lu, J. L. Chen, and A. X. Peng. 2021. “Fracture failure analysis and finite element assessment of bridge detection vehicle.” Eng. Fail. Anal. 125 (Jun): 105423. https://doi.org/10.1016/j.engfailanal.2021.105423.
Xia, R., H. Zhang, J. Zhou, L. Liao, Z. Zhang, and F. Yang. 2021. “Probability evaluation method of cable corrosion degree based on self-magnetic flux leakage.” J. Magn. Magn. Mater. 522 (Mar): 167544. https://doi.org/10.1016/j.jmmm.2020.167544.
Xu, F., X. Wang, and L. Wang. 2011. “Cable inspection robot for cable-stayed bridges: Design, analysis, and application.” J. Field Rob. 28 (3): 441–459. https://doi.org/10.1002/rob.20390.
Xu, H., and S. K. Sinha. 2019. “A framework for statistical analysis of water pipeline field performance data.” In Pipelines 2019: Multidisciplinary topics, utility engineering, and surveying, 180–189. Reston, VA: ASCE. https://doi.org/10.1061/9780784482506.019.
Xu, H., and S. K. Sinha. 2021. “Modeling pipe break data using survival analysis with machine learning imputation methods.” J. Perform. Constr. Facil. 35 (5): 04021071. https://doi.org/10.1061/(ASCE)CF.1943-5509.0001649.
Xu, J., and W. Chen. 2013. “Behavior of wires in parallel wire stayed cable under general corrosion effects.” J. Constr. Steel Res. 85 (Jun): 40–47. https://doi.org/10.1016/j.jcsr.2013.02.010.
Yu, C. Y. 2020. “Research on intelligent apperance algorithm of stay cable detection robot.” [In Chinese.] J. Highway Transp. Res. Dev. 36 (02): 86–92.
Zalapa-Damian, A., E. M. Alonso-Guzmán, J. M. Ponce-Ortega, W. Martínez-Molina, C. Bernabé-Reyes, and H. L. Chavez-Garcia. 2021. “Machine learning for modeling the bearing capacity of prestressed concrete elements damaged by corrosion.” In Vol. 1166 of Advanced materials research, 65–79. Bäch, Switzerland: Trans Tech Publications. https://doi.org/10.4028/www.scientific.net/amr.1166.65.
Zhang, P., Z. Tang, Y. Duan, C. B. Yun, and F. Lv. 2018. “Ultrasonic guided wave approach incorporating SAFE for detecting wire breakage in bridge cable.” Smart Struct. Syst. 22 (4): 481–493.
Zhang, Q., and R. Xin. 2018. “The defect-length effect in corrosion detection with magnetic method for bridge cables.” Front. Struct. Civ. Eng. 12 (4): 662–671. https://doi.org/10.1007/s11709-018-0512-4.
Zhao, Y., J. Zhou, R. Xia, Q. He, and Z. Zhang. 2019. “The detection of corrosion of steel strands based on weak magnetic flux leakage effect of metal magnetic memory.” J. Shenzhen Univ. Sci. Eng. 36 (3): 221–346. https://doi.org/10.3724/SP.J.1249.2019.03229.
Zoph, B., V. Vasudevan, J. Shlens, and Q. V. Le. 2018. “Learning transferable architectures for scalable image recognition.” In Proc., IEEE Conf. on Computer Vision and Pattern Recognition, 8697–8710. New York: IEEE.
Information & Authors
Information
Published In
Journal of Performance of Constructed Facilities
Volume 36 • Issue 6 • December 2022
Copyright
© 2022 American Society of Civil Engineers.
History
Received: Mar 11, 2022
Accepted: Jul 14, 2022
Published online: Sep 26, 2022
Published in print: Dec 1, 2022
Discussion open until: Feb 26, 2023
ASCE Technical Topics:
- Bridge engineering
- Bridge tests
- Bridges
- Bridges (by type)
- Cable stayed bridges
- Cables
- Continuum mechanics
- Corrosion
- Cracking
- Defects and imperfections
- Detection methods
- Deterioration
- Dynamics (solid mechanics)
- Engineering fundamentals
- Engineering mechanics
- Equipment and machinery
- Field tests
- Forces (type)
- Fracture mechanics
- Magnetic fields
- Materials characterization
- Materials engineering
- Methodology (by type)
- Solid mechanics
- Structural engineering
- Tests (by type)
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.