Computer Vision for Infrastructure Health Monitoring: Automated Detection of Pavement Rutting from Street-Level Images
Publication: Computing in Civil Engineering 2023
ABSTRACT
The increasing availability of low-cost sensors, such as smartphones and the cameras embedded in cars for driving assistance, provides new opportunities to enhance pavement health monitoring. While computer vision techniques have been successfully used to detect pavement distresses using 2D images, distresses involving depth measurements, such as rutting, remain a challenge. The objective of this study is to develop an object detection model to automatically detect instances of rutting in pavements. This study leverages pavement images and distress data collected from the United States Federal Highway Administration Long-Term Pavement Performance (LTPP) database to train a rutting detection model. Transfer learning is used to analyze the generalizability of the model. Results indicate that street-level images are highly suitable for detecting pavement rutting using computer vision algorithms. Future research is needed to quantify the severity of rutting using image processing techniques.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Al-Mosawe, H. 2016. Prediction of permanent deformation in asphalt mixtures.
Bashar, M., and C. Torres-Machi. 2023. “Quantifying the Value of Satellite-Based Pavement Monitoring in Partially Observable Stochastic Environments.” J. Comput. Civ. Eng., 37 (3): 04023004. American Society of Civil Engineers. https://doi.org/10.1061/JCCEE5.CPENG-5108.
CDOT, C. D. of T. 2022. “OTIS Online Transportation Information System.” Accessed December 20, 2022. https://dtdapps.coloradodot.info/otis.
Farashah, M. K., S. Salehiashani, S. Varamini, and S. Tighe. 2021. Best Practices in Measuring Rutting and Shoving on Asphalt Pavements.
FHWA. 2023. “LTPP: Long-Term Pavement Performance program.” Accessed March 1, 2023. http://www.fhwa.dot.gov/research/tfhrc/programs/infrastructure/pavements/ltpp/.
Gopalakrishnan, K. 2018. “Deep Learning in Data-Driven Pavement Image Analysis and Automated Distress Detection: A Review.” Data, 3 (3): 28. Multidisciplinary Digital Publishing Institute. https://doi.org/10.3390/data3030028.
Gopalakrishnan, K., S. K. Khaitan, A. Choudhary, and A. Agrawal. 2017. “Deep Convolutional Neural Networks with transfer learning for computer vision-based data-driven pavement distress detection.” Constr. Build. Mater., 157: 322–330. https://doi.org/10.1016/j.conbuildmat.2017.09.110.
Guo, F., Y. Qian, and Y. Shi. 2021. “Real-time railroad track components inspection based on the improved YOLOv4 framework.” Autom. Constr., 125: 103596. https://doi.org/10.1016/j.autcon.2021.103596.
Lees, A. 2021. “Types of pavement and road construction methods.” Tensar. Accessed July 26, 2022. https://info.tensar.co.uk/blog/what-are-the-different-types-of-road-construction-methods.
Majidifard, H., P. Jin, Y. Adu-Gyamfi, and W. G. Buttlar. 2020. “Pavement Image Datasets: A New Benchmark Dataset to Classify and Densify Pavement Distresses.” Transp. Res. Rec., 2674 (2): 328–339. SAGE Publications Inc. https://doi.org/10.1177/0361198120907283.
Pierce, L. M., and N. D. Weitzel. 2019. Automated Pavement Condition Surveys. Washington D.C., USA: National Cooperative Highway Research Program, Transportation Research Board of the National Academies.
Tzutalin. 2023. “LabelImg repository.” https://github.com/heartexlabs/labelImg.
Wu, P., A. Liu, J. Fu, X. Ye, and Y. Zhao. 2022. “Autonomous surface crack identification of concrete structures based on an improved one-stage object detection algorithm.” Eng. Struct., 272: 114962. https://doi.org/10.1016/j.engstruct.2022.114962.
Zhou, Z., J. Zhang, and C. Gong. 2022. “Automatic detection method of tunnel lining multi-defects via an enhanced You Only Look Once network.” Comput.-Aided Civ. Infrastruct. Eng., 37 (6): 762–780. https://doi.org/10.1111/mice.12836.
Zou, D., M. Zhang, Z. Bai, T. Liu, A. Zhou, X. Wang, W. Cui, and S. Zhang. 2022. “Multicategory damage detection and safety assessment of post-earthquake reinforced concrete structures using deep learning.” Comput.-Aided Civ. Infrastruct. Eng., 37 (9): 1188–1204. https://doi.org/10.1111/mice.12815.
Information & Authors
Information
Published In
Computing in Civil Engineering 2023
Pages: 1089 - 1096
History
Published online: Jan 25, 2024
ASCE Technical Topics:
- Automation and robotics
- Computer aided operations
- Computer programming
- Computer software
- Computer vision and image processing
- Computing in civil engineering
- Engineering fundamentals
- Gravels
- Infrastructure
- Methodology (by type)
- Pavement condition
- Pavement rutting
- Pavements
- Systems engineering
- Transportation engineering
- Vehicle-pavement interaction
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.