Automated Detection of Roadway Obstructions Using UAVs and Reference Images
Publication: Construction Research Congress 2024
ABSTRACT
Natural disasters such as wildfires, landslides, and earthquakes result in obstructions on roads due to fallen trees, landslides, and rocks. Such obstructions can cause significant mobility problems for both evacuees and first responders, especially in the immediate aftermath of disasters. Unmanned Aerial Vehicles (UAVs) provide an opportunity to perform rapid and remote reconnaissance of planned routes and thus provide decision-makers with information relating to a route’s feasibility. However, detecting obstacles on roads manually is a laborious and error-prone task, especially when attention is diverted to needs that are more urgent during disaster scenarios. This paper thus proposes a computer vision and machine-learning framework to detect obstacles on a road automatically to ensure its possibility in the aftermath of disasters. The framework implements the YOLO algorithm to detect and segment roads on images from UAVs and reference images from publicly available datasets. The images retrieved from UAVs and reference images are segmented and counted pixels of the roadway for comparison of the difference in pixels to identify the obstruction on the road. In addition, the method is proposed to automatically detect obstructions found in the region of interest (ROI) only on a roadway with images and videos from UAVs. Preliminary results from test runs are presented along with the future steps for implementing a real-time UAV-based road obstruction system.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Bang, S., F. Baek, S. Park, W. Kim, and H. Kim. 2020. “Image augmentation to improve construction resource detection using generative adversarial networks, cut-and-paste, and image transformation techniques.” Autom Constr, 115. Elsevier B.V. https://doi.org/10.1016/j.autcon.2020.103198.
Broggi, A., C. Caraffi, R. I. Fedriga, and P. Grisleri. 2005. “Obstacle detection with stereo vision for off-road vehicle navigation.” IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops. IEEE Computer Society.
Dadrasjavan, F., N. Zarrinpanjeh, and A. Ameri. 2019. Automatic Crack Detection of Road Pavement Based 2 on Aerial UAV Imagery 3 4. https://doi.org/10.20944/preprints201907.0009.v1.
Dunai, L., B. D. Garcia, I. Lengua, and G. Peris-Fajarnes. 2012. “3D CMOS sensor based acoustic object detection and navigation system for blind people.” IECON Proceedings (Industrial Electronics Conference), 4208–4215.
Dwyer, B., and J. Nelson. 2022. Roboflow (Version 1.0).
Van Etten, A. 2018. You Only Look Twice: Rapid Multi-Scale Object Detection In Satellite Imagery.
Guo, W., W. Yang, H. Zhang, and G. Hua. 2018. “Geospatial object detection in high resolution satellite images based on multi-scale convolutional neural network.” Remote Sens (Basel), 10 (1). MDPI AG. https://doi.org/10.3390/rs10010131.
Gupta, H., and O. P. Verma. 2022. “Monitoring and surveillance of urban road traffic using low altitude drone images: a deep learning approach.” Multimed Tools Appl, 81 (14): 19683–19703. Springer. https://doi.org/10.1007/s11042-021-11146-x.
Haris, M., and A. Glowacz. 2021. “Road object detection: A comparative study of deep learning-based algorithms.” Electronics (Switzerland). MDPI.
Hu, D., S. Li, J. Du, and J. Cai. 2023. “Automating Building Damage Reconnaissance to Optimize Drone Mission Planning for Disaster Response.” Journal of Computing in Civil Engineering, 37 (3). https://doi.org/10.1061/(ASCE)CP.1943-5487.0001061.
Ju, R.-Y., and W. Cai. 2023. Fracture Detection in Pediatric Wrist Trauma X-ray Images Using YOLOv8 Algorithm.
Kim, J., D. S. Han, and B. Senouci. 2018. “Radar and Vision Sensor Fusion for Object Detection in Autonomous Vehicle Surroundings.” International Conference on Ubiquitous and Future Networks, ICUFN, 76–78. IEEE Computer Society.
Lalak, M., and D. Wierzbicki. 2022. “Automated Detection of Atypical Aviation Obstacles from UAV Images Using a YOLO Algorithm.” Sensors, 22 (17). MDPI. https://doi.org/10.3390/s22176611.
Latham, D. 2021. “Rockslide cleanup will keep Oregon 138 West closed through the weekend (Photo).” ODOT: SW Oregon. https://flashalert.net/id/ODOTSWOregon/150094.
Lee, J., J. Z. Xu, K. Sohn, W. Lu, D. Berthelot, I. Gur, P. Khaitan, K.-W. Huang, K. Koupparis, and B. Kowatsch. 2020. Assessing Post-Disaster Damage from Satellite Imagery using Semi-Supervised Learning Techniques.
Li, S. E., G. Li, J. Yu, C. Liu, B. Cheng, J. Wang, and K. Li. 2018. “Kalman filter-based tracking of moving objects using linear ultrasonic sensor array for road vehicles.” Mech Syst Signal Process, 98: 173–189. Academic Press. https://doi.org/10.1016/j.ymssp.2017.04.041.
Li, Y., and J. Ibanez-Guzman. 2020. “Lidar for Autonomous Driving: The Principles, Challenges, and Trends for Automotive Lidar and Perception Systems.” IEEE Signal Process Mag, 37 (4): 50–61. Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/MSP.2020.2973615.
Li, Y., J. Ma, Z. Zhao, and G. Shi. 2022. “A Novel Approach for UAV Image Crack Detection.” Sensors, 22 (9). MDPI. https://doi.org/10.3390/s22093305.
Massaro, A., N. Savino, S. Selicato, A. Panarese, A. Galiano, and G. Dipierro. 2021. “Thermal IR and GPR UAV and vehicle embedded sensor non-invasive systems for road and bridge inspections.” 2021 IEEE International Workshop on Metrology for Industry 4.0 and IoT - Proceedings, 248–253. Institute of Electrical and Electronics Engineers Inc.
Paulet, M. V., A. Salceanu, and O. M. Neacsu. 2016. “Ultrasonic radar.” Proceedings of the 2016 International Conference and Exposition on Electrical and Power Engineering, EPE 2016, 551–554. Institute of Electrical and Electronics Engineers Inc.
Pi, Y., N. D. Nath, and A. H. Behzadan. 2020. “Convolutional neural networks for object detection in aerial imagery for disaster response and recovery.” Advanced Engineering Informatics, 43. Elsevier Ltd. https://doi.org/10.1016/j.aei.2019.101009.
Pi, Y., N. D. Nath, and A. H. Behzadan. 2021. “Detection and Semantic Segmentation of Disaster Damage in UAV Footage.” Journal of Computing in Civil Engineering, 35 (2). American Society of Civil Engineers (ASCE). https://doi.org/10.1061/(asce)cp.1943-5487.0000947.
Ravi, R., D. Bullock, and A. Habib. 2021. “Pavement distress and debris detection using a mobile mapping system with 2d profiler lidar.” Transp Res Rec, 2675 (9): 428–438. SAGE Publications Ltd. https://doi.org/10.1177/03611981211002529.
Redmon, J., S. Divvala, R. Girshick, and A. Farhadi. 2015. You Only Look Once: Unified, Real-Time Object Detection.
Tkáč, M., and P. Mésároš. 2019. “Utilizing drone technology in the civil engineering.” Selected Scientific Papers - Journal of Civil Engineering, 14 (1): 27–37. Walter de Gruyter GmbH. https://doi.org/10.1515/sspjce-2019-0003.
Yan, S., and Y. L. Shih. 2009. “Optimal scheduling of emergency roadway repair and subsequent relief distribution.” Comput Oper Res, 36 (6): 2049–2065. https://doi.org/10.1016/j.cor.2008.07.002.
Information & Authors
Information
Published In
History
Published online: Mar 18, 2024
ASCE Technical Topics:
- Aerospace engineering
- Aircraft and spacecraft
- Automation and robotics
- Disaster risk management
- Disasters and hazards
- Engineering fundamentals
- Geohazards
- Geotechnical engineering
- Highway and road management
- Highway transportation
- Highways and roads
- Infrastructure
- Landslides
- Natural disasters
- Routing (transportation)
- Systems engineering
- Traffic engineering
- Transportation engineering
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.