Recognition of Pavement Structural Damage Based on Nondestructive Testing and Computer Vision
Publication: Computing in Civil Engineering 2023
ABSTRACT
Despite the growing body of research on pavement quality assessment in civil and infrastructure engineering, the issue of achieving rapid analysis of nondestructive structural damage remains unresolved. The application of nondestructive testing, such as ground penetrating radar (GPR) in highway engineering, provides opportunities to analyze distress hidden under pavement surfaces. However, the traditional analysis process of GPR image databases mainly relies on technicians’ experience. Furthermore, existing methods for the recognition and identification of internal damage, such as looseness and cracks, require a high technical threshold and a tremendous amount of time, leading to low efficiency and unstable accuracy of the results. To address this issue, this paper developed an automatic identification method by combining nondestructive testing and computer vision for pavement structural damage. First, the GPR images of the internal damage were calibrated by comparing them to the cores drilled onsite. Then, an object detection (OB) algorithm, called YOLOv5, was adapted to construct machine learning models. A total of 1,000 labeled images were fed into the model, which was trained and optimized to learn and identify the images’ features. The result indicated that the developed method achieved high-speed and accurate identification of the location and type of pavement structural damage. The prediction accuracy of the OB model reached 88.2%, and the GPR image dataset of 10 km pavement with 1,000 samples can be processed in 1 min. The contribution of this research facilitates the development of pavement maintenance decision systems to provide a real-time assessment method for onsite pavement structures.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Aavik, A., and O. Talvik. 2021. Use of falling weight deflectometer (FWD) measurement data for pavement structural evaluation and repair design.
Cao, W., Q. Liu, and Z. He. 2020. “Review of Pavement Defect Detection Methods.” IEEE Access, 8: 14531–14544. https://doi.org/10.1109/ACCESS.2020.2966881.
Data Mining: Practical Machine Learning Tools and Techniques. 2011. Elsevier.
Dong, Z., S. Ye, Y. Gao, G. Fang, X. Zhang, Z. Xue, and T. Zhang. 2016. “Rapid Detection Methods for Asphalt Pavement Thicknesses and Defects by a Vehicle-Mounted Ground Penetrating Radar (GPR) System.” Sensors, 16 (12): 2067. Multidisciplinary Digital Publishing Institute. https://doi.org/10.3390/s16122067.
Gao, J., D. Yuan, Z. Tong, J. Yang, and D. Yu. 2020. “Autonomous pavement distress detection using ground penetrating radar and region-based deep learning.” Measurement, 164: 108077. https://doi.org/10.1016/j.measurement.2020.108077.
Gong, H., Y. Sun, W. Hu, P. A. Polaczyk, and B. Huang. 2019a. “Investigating impacts of asphalt mixture properties on pavement performance using LTPP data through random forests.” Construction and Building Materials, 204: 203–212. https://doi.org/10.1016/j.conbuildmat.2019.01.198.
Gong, H., Y. Sun, and B. Huang. 2019b. “Gradient Boosted Models for Enhancing Fatigue Cracking Prediction in Mechanistic-Empirical Pavement Design Guide.” J. Transp. Eng., Part B: Pavements, 145 (2): 04019014. https://doi.org/10.1061/JPEODX.0000121.
Gong, H., Y. Sun, Z. Mei, and B. Huang. 2018a. “Improving accuracy of rutting prediction for mechanistic-empirical pavement design guide with deep neural networks.” Construction and Building Materials, 190: 710–718. https://doi.org/10.1016/j.conbuildmat.2018.09.087.
Gong, H., Y. Sun, X. Shu, and B. Huang. 2018b. “Use of random forests regression for predicting IRI of asphalt pavements.” Construction and Building Materials, 189: 890–897. https://doi.org/10/gk88dm.
Guo, X., and P. Hao. 2021a. “Influential Factors and Evaluation Methods of the Performance of Grouted Semi-Flexible Pavement (GSP)—A Review.” Applied Sciences, 11 (15): 6700. Multidisciplinary Digital Publishing Institute. https://doi.org/10.3390/app11156700.
Guo, X., and P. Hao. 2021b. “Using a Random Forest Model to Predict the Location of Potential Damage on Asphalt Pavement.” Applied Sciences, 11 (21): 10396. Multidisciplinary Digital Publishing Institute. https://doi.org/10.3390/app112110396.
Hamzah, M. O., M. R. Kakar, and M. R. Hainin. 2015. “An Overview of Moisture Damage in Asphalt Mixtures.” Jurnal Teknologi, 7.
Jia, X., M. Woods, H. Gong, W. Hu, B. Huang, and B. Faraj. 2019. “Utilization of State Performance Indices to Correlate National Performance Measures for Asphalt Pavements in Tennessee.” Transportation Research Record, 2673 (6): 379–388. https://doi.org/10.1177/0361198119837500.
Jia, X., M. Woods, H. Gong, D. Zhu, W. Hu, and B. Huang. 2021. “Evaluation of influence of pavement data on measurement of deflection on asphalt surfaced pavements utilizing traffic speed deflection device.” Construction and Building Materials, 270: 121842. https://doi.org/10.1016/j.conbuildmat.2020.121842.
Justo-Silva, R., A. Ferreira, and G. Flintsch. 2021. “Review on Machine Learning Techniques for Developing Pavement Performance Prediction Models.” Sustainability, 13 (9): 5248. https://doi.org/10.3390/su13095248.
Karballaeezadeh, N., H. Ghasemzadeh Tehrani, D. Mohammadzadeh Shadmehri, and S. Shamshirband. 2020. “Estimation of flexible pavement structural capacity using machine learning techniques.” Front. Struct. Civ. Eng., 14 (5): 1083–1096. https://doi.org/10.1007/s11709-020-0654-z.
Kim, N., K. Kim, Y.-K. An, H.-J. Lee, and J.-J. Lee. 2020. “Deep learning-based underground object detection for urban road pavement.” International Journal of Pavement Engineering, 21 (13): 1638–1650. Taylor & Francis. https://doi.org/10.1080/10298436.2018.1559317.
Li, Y., P. Hao, C. Zhao, J. Ling, T. Wu, D. Li, J. Liu, and B. Sun. 2021. “Anti-rutting performance evaluation of modified asphalt binders: a review.” Journal of Traffic and Transportation Engineering (English Edition). Elsevier.
Li, Y., C. Liu, Y. Du, and S. Jiang. 2020. “A novel evaluation method for pavement distress based on impact of ride comfort.” International Journal of Pavement Engineering, 1–13. https://doi.org/10.1080/10298436.2020.1765241.
Liu, X., P. Hao, A. Wang, L. Zhang, B. Gu, and X. Lu. 2021a. “Non-destructive detection of highway hidden layer defects using a ground-penetrating radar and adaptive particle swarm support vector machine.” PeerJ Computer Science, 7. PeerJ, Inc.
Liu, Z., W. Wu, X. Gu, S. Li, L. Wang, and T. Zhang. 2021b. “Application of Combining YOLO Models and 3D GPR Images in Road Detection and Maintenance.” Remote Sensing, 13 (6): 1081. https://doi.org/10.3390/rs13061081.
Mahesh, B. 2018. “Machine Learning Algorithms - A Review.” 9 (1): 7.
Marcelino, P., M. de Lurdes Antunes, E. Fortunato, and M. C. Gomes. 2021. “Machine learning approach for pavement performance prediction.” International Journal of Pavement Engineering, 22 (3): 341–354. https://doi.org/10.1080/10298436.2019.1609673.
Miller, J. S., W. Y. Bellinger, and United States. Federal Highway Administration. Office of Infrastructure Research and Development. 2003. Distress Identification Manual for the Long-Term Pavement Performance Program (Fourth Revised Edition).
Mohamed, O. A., M. Ati, and O. F. Najm. 2017. “Predicting Compressive Strength of Sustainable Self-Consolidating Concrete Using Random Forest.” KEM, 744: 141–145. https://doi.org/10.4028/www.scientific.net/KEM.744.141.
Saarenketo, T., and T. Scullion. 2000. “Road evaluation with ground penetrating radar.” Journal of Applied Geophysics, 43 (2): 119–138. https://doi.org/10.1016/S0926-9851(99)00052-X.
Santos, J., J. Bryce, G. Flintsch, and A. Ferreira. 2017. “A comprehensive life cycle costs analysis of in-place recycling and conventional pavement construction and maintenance practices.” International Journal of Pavement Engineering, 18 (8): 727–743. Taylor & Francis. https://doi.org/10.1080/10298436.2015.1122190.
Solanki, U. 2014. “A Review on Structural Evaluation of Flexible Pavements using Falling Weight Deflectometer.” STM Journal, 2: 1 to 10.
Torres-Machi, C., A. Osorio-Lird, A. Chamorro, C. Videla, S. L. Tighe, and C. Mourgues. 2018. “Impact of environmental assessment and budgetary restrictions in pavement maintenance decisions: Application to an urban network.” Transportation Research Part D: Transport and Environment, 59: 192–204. https://doi.org/10.1016/j.trd.2017.12.017.
Tsai, Y.-C. J., Y. Zhao, B. Pop-Stefanov, and A. Chatterjee. 2021. “Automatically detect and classify asphalt pavement raveling severity using 3D technology and machine learning.” Int. J. Pavement Res. Technol., 14 (4): 487–495. https://doi.org/10.1007/s42947-020-0138-5.
Xiao, M., R. Luo, and X. Yu. 2022. “Assessment of asphalt pavement overall performance condition using functional indexes and FWD deflection basin parameters.” Construction and Building Materials, 341: 127872. https://doi.org/10.1016/j.conbuildmat.2022.127872.
Zhang, X.-D. 2020. “Machine Learning.” A Matrix Algebra Approach to Artificial Intelligence, 223–440. Singapore: Springer Singapore.
Information & Authors
Information
Published In
History
Published online: Jan 25, 2024
ASCE Technical Topics:
- Communication systems
- Computer vision and image processing
- Engineering fundamentals
- Field tests
- Gravels
- Highway engineering
- Highway transportation
- Infrastructure
- Lifeline systems
- Methodology (by type)
- Nondestructive tests
- Pavement condition
- Pavements
- Structural analysis
- Structural engineering
- Tests (by type)
- Transportation engineering
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.