Integration of Small Unmanned Aircraft Systems and Deep Learning for Efficient Airfield Pavement Crack Detection and Assessment
Publication: International Conference on Transportation and Development 2024
ABSTRACT
Airfield pavement inspection and maintenance are critical aspects of aviation infrastructure, representing a substantial portion of life-cycle costs. Longitudinal, transverse, and diagonal (LTD) cracks; corner breaks; shattered slabs in Portland cement concrete (PCC) pavement; and longitudinal and transverse (L&T) cracks of asphalt concrete (AC) pavement consist of most of the airfield pavement distresses. Traditional airfield pavement inspection methods are manual, time-consuming, laborious, and reliant on the inspector’s experience, leading to increased expenses and safety risks. This research explores the potential to automatically identify those distresses in red-green-blue images using four variants of deep learning (DL) model YOLOv8, ranging from nano to large. YOLOv8 is a widely used off-the-shelf DL object detection model that allows rapid training and easy execution. A DL training dataset of 5,273 small uncrewed aircraft systems (sUAS) collected images was developed. The transfer learning technique was used, and the dataset passed through each model 100 times for adequate training. The model exhibits mean average precision values exceeding 0.65, with varying processing times. Such accuracy showed that crack-related distress detection using DL models could enhance airfield pavement inspection efficiency.
Get full access to this chapter
View all available purchase options and get full access to this chapter.
REFERENCES
Airport Improvement. (2020). Savannah/Hilton Head Int’l Prepares to Integrate Drones Into Airport & Airfield Operations | Airport Improvement Magazine.
Airsight. (2020). Runway pavement inspections using airsight drone. https://www.airsight.de/projects/item/runway-pavement-inspections-using-airsight-drone/.
Banks, E., et al. (2018). Successful Approaches for the Use of Unmanned Aerial System by Surface Transportation Agencies. https://domesticscan.org/download/4364/.
Congress, S. S. C., and Puppala, A. J. (2022). Lessons Learned in Airport Asset Inspection Using Unmanned Aerial Vehicle (UAV) Based Close-Range Photogrammetry. International Conference on Transportation and Development 2022, 212–222.
Ellenberg, A., Kontsos, A., Moon, F., and Bartoli, I. (2016). Bridge related damage quantification using unmanned aerial vehicle imagery. Structural Control and Health Monitoring, 23(9), 1168–1179. https://doi.org/10.1002/STC.1831.
Everingham, M., Eslami, S. M. A., Van Gool, L., Williams, C. K. I., Winn, J., and Zisserman, A. (2014). The Pascal Visual Object Classes Challenge: A Retrospective. International Journal of Computer Vision. https://doi.org/10.1007/s11263-014-0733-5.
FAA. (2022). Report to Congress on the Airport Improvement Program for FY 2019. https://www.faa.gov/sites/faa.gov/files/2022-08/Report_Congress_AIP_accomplishments_FY2019.pdf.
FHWA. (2018). Use of Unmanned Aerial Systems (UAS) by State DOTs. https://rosap.ntl.bts.gov/view/dot/43679.
Geiger, A., Lenz, P., Stiller, C., and Urtasun, R. (2013). Vision meets robotics: The KITTI dataset. International Journal of Robotics Research. https://doi.org/10.1177/0278364913491297.
Hubbard, B., and Hubbard, S. (2020). Unmanned Aircraft Systems (UAS) for Bridge Inspection Safety. Drones, 4(3), 40.
Kim, H., Kim, H., Hong, Y. W., and Byun, H. (2018). Detecting Construction Equipment Using a Region-Based Fully Convolutional Network and Transfer Learning. Journal of Computing in Civil Engineering. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000731.
Kuznetsova, A., et al. (2020). The Open Images Dataset V4: Unified Image Classification, Object Detection, and Visual Relationship Detection at Scale. International Journal of Computer Vision. https://doi.org/10.1007/s11263-020-01316-z.
Li, R., Yu, J., Li, F., Yang, R., Wang, Y., and Peng, Z. (2023). Automatic bridge crack detection using Unmanned aerial vehicle and Faster R-CNN. Construction and Building Materials, 362, 129659.
Li, Y., Ma, J., Zhao, Z., and Shi, G. (2022). A Novel Approach for UAV Image Crack Detection. Sensors, 22(9), 3305.
Lin, T.-Y., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Ramanan, D., Zitnick, C. L., and Dollár, P. (2015). Microsoft COCO: Common Objects in Context. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. https://doi.org/10.1109/CVPR.2014.471.
Pietersen, R. A., Beauregard, M. S., and Einstein, H. H. (2022). Automated method for airfield pavement condition index evaluations. Automation in Construction, 141, 104408. https://doi.org/10.1016/J.AUTCON.2022.104408.
roboflow. (2023). https://roboflow.com/.
Russakovsky, O., et al. (2015). ImageNet Large Scale Visual Recognition Challenge. International Journal of Computer Vision. https://doi.org/10.1007/s11263-015-0816-y.
Seo, J., Duque, L., and Wacker, J. (2018). Drone-enabled bridge inspection methodology and application. Automation in Construction, 94, 112–126. https://doi.org/10.1016/j.autcon.2018.06.006.
Shin, H. C., Roth, H. R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D., and Summers, R. M. (2016). Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning. IEEE Transactions on Medical Imaging. https://doi.org/10.1109/TMI.2016.2528162.
Sourav, M. A. A., Ceylan, H., Brooks, C., Peshkin, D., Kim, S., Dobson, R., Cook, C., Mahedi, M., and Brouillette, O. (2022). Small Unmanned Aircraft System for Pavement Inspection: Task 4—Execute the Field Demonstration Plan and Analyze the Collected Data. United States. Department of Transportation. Federal Aviation Administration. https://doi.org/https://doi.org/10.21949/1524511.
Sourav, M. A. A., Ceylan, H., Brooks, C., Peshkin, D., Kim, S., Dobson, R., Cook, C., Mahedi, M., and Jenkins, A. (2023). Small Unmanned Aircraft System for Pavement Inspection. United States. Department of Transportation. Federal Aviation Administration. Airport Engineering Division. https://doi.org/10.21949/1528226.
Sourav, M. A. A., Ceylan, H., Kim, S., Brooks, C., Peshkin, D., Dobson, R., and Brynick, M. (2023). Use of Digital Elevation Model for Detecting Airfield Pavement Distress. In Airfield and Highway Pavements 2023 (pp. 254–265).
Sourav, M. A. A., Ceylan, H., Kim, S., Brooks, C., Peshkin, D., Dobson, R., Brynick, M., and DiPilato, M. (2022). Small Uncrewed Aircraft Systems-Based Orthophoto and Digital Elevation Model Creation and Accuracy Evaluation for Airfield Portland Cement Concrete Pavement Distress Detection and Rating. International Conference on Transportation and Development 2022, 168–180. https://doi.org/10.1061/9780784484371.016.
Tzutalin. (2015). LabelImg. https://github.com/tzutalin/labelImg.
Wells, J., and Lovelace, B. (2018). Improving the quality of bridge inspections using unmanned aircraft systems (UAS).
YOLOV8. (2023). https://github.com/ultralytics/ultralytics.
Zhu, J., Zhong, J., Ma, T., Huang, X., Zhang, W., and Zhou, Y. (2022). Pavement distress detection using convolutional neural networks with images captured via UAV. Automation in Construction, 133, 103991.
Information & Authors
Information
Published In
International Conference on Transportation and Development 2024
Pages: 884 - 893
History
Published online: Jun 13, 2024
ASCE Technical Topics:
- Air transportation
- Airport and airfield pavements
- Airports and airfields
- Asphalt concrete
- Asphalt pavements
- Composite materials
- Concrete pavements
- Construction engineering
- Construction management
- Continuum mechanics
- Cracking
- Engineering materials (by type)
- Engineering mechanics
- Fiber reinforced composites
- Fracture mechanics
- Gravels
- Infrastructure
- Inspection
- Materials engineering
- Pavement condition
- Pavements
- Solid mechanics
- Transportation engineering
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.