Automatic Detection of Brick Pavement Defects Using Convolutional Neural Network
Publication: ICCREM 2021
ABSTRACT
Discovering the pavement defect is critical for maintaining the pavement health condition. However, a majority of pavement defect inspections are manual processes, which are time-consuming and labor-intensive. This process heavily relies on engineers’ experiences, and thus the judgments are prone to human error. To solve the limitations, this research achieves detection on brick pavement defects using a convolutional neural network. The Mask R-CNN is trained and validated on a subset of 600 and 100 annotated 512 × 512-pixel labeled images for segmentation, respectively. The Mask R-CNN to detect brick pavement defects: spalling, efflorescence, and hole obtains high precisions of 94.62%, 90.79%, and 93.75%, and high recalls of 84.06%, 73.67%, and 71.43%, respectively. The results demonstrate that the proposed method has a good performance and can achieve the detection of different brick pavement defects at the pixel level. This research not only benefits the extensive application of the method, but also can help engineers improve productivity for assessing the pavement conditions in operation and maintenance.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Bang, S., Park, S., Kim, H., and Kim, H. (2019). “Encoder-decoder network for pixel-level road crack detection in black-box images.” Computer-Aided Civil and Infrastructure Engineering, 34(8), 713–727.
Bursanescu, L., Bursanescu, M., Hamdi, M., Lardigue, A., and Paiement, D. (2001). “Three-dimensional infrared laser vision system for road surface features analysis.” Romopto 2000: Sixth conference on optics (International Society for Optics and Photonics), 4430, 801–808.
Cha, Y. J., Choi, W., and Büyüköztürk, O. (2017). “Deep learning-based crack damage detection using convolutional neural networks.” Computer-Aided Civil and Infrastructure Engineering, 32(5), 361–378.
Cha, Y. J., Choi, W., Suh, G., Mahmoudkhani, S., and Büyüköztürk, O. (2018). “Autonomous structural visual inspection using region-based deep learning for detecting multiple damage types.” Computer-Aided Civil and Infrastructure Engineering, 33(9), 731–747.
Dung, C. V., Sekiya, H., Hirano, S., Okatani, T., and Miki, C. (2019). “A vision-based method for crack detection in gusset plate welded joints of steel bridges using deep convolutional neural networks.” Automation in Construction, 102, 217–229.
Fang, W., Zhong, B., Zhao, N., Love, P. E., Luo, H., Xue, J., and Xu, S. (2019). “A deep learning-based approach for mitigating falls from height with computer vision: convolutional neural network.” Advanced Engineering Informatics, 39, 170–177.
Gavilán, M., Balcones, D., Marcos, O., Llorca, D. F., Sotelo, M. A., Parra, I., Ocaña, M., Aliseda, P., Yarza, P., and Amírola, A. (2011). “Adaptive road crack detection system by pavement classification.” Sensors, 11(10), 9628–9657.
He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017). “Mask R-CNN.” Proceedings of the IEEE international conference on computer vision, 2961–2969.
Hoang, N. D., Nguyen, Q.-L., and Tran, V.-D. (2018). “Automatic recognition of asphalt pavement cracks using metaheuristic optimized edge detection algorithms and convolution neural network.” Automation in Construction, 94, 203–213.
Jahanshahi, M. R., Jazizadeh, F., Masri, S. F., and Becerik-Gerber, B. (2012). “Unsupervised approach for autonomous pavement-defect detection and quantification using an inexpensive depth sensor.” Journal of Computing in Civil Engineering, 27(6), 743–754.
Ji, A., Xue, X., Wang, Y., Luo, X., and Xue, W. (2020). “An integrated approach to automatic pixel-level crack detection and quantification of asphalt pavement.” Automation in Construction, 114, 103176.
Koch, C., Georgieva, K., Kasireddy, V., Akinci, B., and Fieguth, P. (2015). “A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure.” Advanced Engineering Informatics, 29(2), 196–210.
Kong, X., and Li, J. (2019). “Non-contact fatigue crack detection in civil infrastructure through image overlapping and crack breathing sensing.” Automation in Construction, 99, 125–139.
Li, S., Zhao, X., and Zhou, G. (2019). “Automatic pixel-level multiple damage detection of concrete structure using fully convolutional network.” Computer-Aided Civil and Infrastructure Engineering, 34(7), 616–634.
Long, J., Shelhamer, E., and Darrell, T. (2015). “Fully convolutional networks for semantic segmentation.” IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(4), 640–651.
Mohan, A., and Poobal, S. (2018). “Crack detection using image processing: a critical review and analysis.” Alexandria Engineering Journal, 57, 787–798.
Noh, Y., Koo, D., Kang, Y.-M., Park, D., and Lee, D. (2017). “Automatic crack detection on concrete images using segmentation via fuzzy C-means clustering.” 2017 International Conference on Applied System Innovation (ICASI) (IEEE), 877–880.
Oliveira, H., and Correia, P. L. (2009). “Supervised crack detection and classification in images of road pavement flexible surfaces.” In Recent advances in signal processing, Ashraf A Zaher, IntechOpen, 159–184.
Ouma, Y. O., and Hahn, M. (2017). “Pothole detection on asphalt pavements from 2D-colour pothole images using fuzzy c-means clustering and morphological reconstruction.” Automation in Construction, 83, 196–211.
Radopoulou, S. C., and Brilakis, I. (2016). “Automated detection of multiple pavement defects.” Journal of Computing in Civil Engineering, 31(2), 04016057.
Rawat, W., and Wang, Z. (2017). “Deep convolutional neural networks for image classification: a comprehensive review.” Neural computation, 29(9), 2352–2449.
Russell, B. C., Torralba, A., Murphy, K. P., and Freeman, W. T. (2008). “LabelMe: a database and web-based tool for image annotation.” International journal of computer vision, 77(1-3), 157–173.
Tong, Z., Gao, J., Sha, A., Hu, L., and Li, S. (2018). “Convolutional neural network for asphalt pavement surface texture analysis.” Computer-Aided Civil and Infrastructure Engineering, 33(12), 1056–1072.
Wada, K. (2019). “LabelMe” <https://githubcom/wkentaro> (Mar. 16, 2019).
Wang, L., Zhuang, L., and Zhang, Z. (2019a). “Automatic detection of rail surface cracks with a superpixel-based data-driven framework.” Journal of Computing in Civil Engineering, 33(1), 04018053.
Wang, N., Zhao, Q., Li, S., Zhao, X., and Zhao, P. (2018). “Damage classification for masonry historic structures using convolutional neural networks based on still images.” Computer-Aided Civil and Infrastructure Engineering, 33(12), 1073–1089.
Wang, N., Zhao, X., Zhao, P., Zhang, Y., Zou, Z., and Ou, J. (2019b). “Automatic damage detection of historic masonry buildings based on mobile deep learning.” Automation in Construction, 103, 53–66.
Yang, X. C., Li, H., Yu, Y., Luo, X., Huang, T., and Yang, X. (2018). “Automatic pixel-level crack detection and measurement using fully convolutional network.” Computer-Aided Civil and Infrastructure Engineering, 33, 1090–1109.
Yousaf, M. H., Azhar, K., Murtaza, F., and Hussain, F. (2018). “Visual analysis of asphalt pavement for detection and localization of potholes.” Advanced Engineering Informatics, 38, 527–537.
Zhang, A., Wang, K. C., Li, B., Yang, E., Dai, X., Peng, Y., Fei, Y., Liu, Y., Li, J. Q., and Chen, C. (2017). “Automated pixel-level pavement crack detection on 3D asphalt surfaces using a deep-learning network.” Computer-Aided Civil and Infrastructure Engineering, 32, 805–819.
Zhang, D., Zou, Q., Lin, H., Xu, X., He, L., Gui, R., and Li, Q. (2018). “Automatic pavement defect detection using 3D laser profiling technology.” Automation in Construction, 96, 350–365.
Zou, Z., Shi, Z., Guo, Y., and Ye, J. (2019). “Object detection in 20 years: a survey”. arXiv preprint arXiv, 1905.05055.
Information & Authors
Information
Published In
ICCREM 2021
Pages: 255 - 263
Copyright
© 2021 American Society of Civil Engineers.
History
Published online: Dec 9, 2021
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.