Deep Learning-Based Automation of Road Surface Extraction from UAV-Derived Dense Point Clouds in Large-Scale Environment
Publication: Computing in Civil Engineering 2023
ABSTRACT
Investigating road conditions is an essential task to maintain service life, ensure safety, and preserve smoothness. Digital road surface information is gaining interest as the main database for planning, design, and inspection. However, the implementation of this still confronts several challenges, such as automated surface extraction, typical geometric features, large scene size, and so on. Although active research on point cloud-based automated road surface extraction has addressed this issue, previous studies mainly relied on experts’ perceptions to decide on the result produced by the selected semantic classification and estimated value, consequently requiring trial and error. This study proposes a U-net image segmentation model-aided method to automatically extract 3D point cloud road surface in typical circumstances generated by UAV images. The proposed method starts by developing a road curb detecting model for geometric 3D spatial data with U-net. Then, the road surface is derived by using geometric feature extraction and machine learning classification algorithms. The outcome is assessed by comparing it with manually classified points and the surface produced by a method from a previous study. The proposed method is capable of extracting road surfaces while reducing human involvement, elevating the road extraction from an unstructured 3D point cloud to a more fully automated approach.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Tan, Y., and Y. Li. UAV Photogrammetry-Based 3D Road Distress Detection. ISPRS International Journal of Geo-Information, 2019. 8(9): p. 409.
Guan, J., et al. Full field-of-view pavement stereo reconstruction under dynamic traffic conditions: Incorporating height-adaptive vehicle detection and multi-view occlusion optimization. Automation in Construction, 2022. 144: p. 104615.
Akturk, E., and A. O. Altunel. Accuracy assessment of a low-cost UAV derived digital elevation model (DEM) in a highly broken and vegetated terrain. Measurement, 2019. 136: p. 382–386.
Biçici, S., and M. Zeybek. An approach for the automated extraction of road surface distress from a UAV-derived point cloud. Automation in Construction, 2021. 122: p. 103475.
Xu, S., R. Wang, and H. Zheng. Road Curb Extraction From Mobile LiDAR Point Clouds. IEEE Transactions on Geoscience and Remote Sensing, 2017. 55(2): p. 996–1009.
Ronneberger, O., P. Fischer, and T. Brox. U-Net: Convolutional Networks for Biomedical Image Segmentation, in Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015. 2015. p. 234–241.
Zeybek, M., and S. Biçici. Geometric Feature Extraction of Road from UAV Based Point Cloud Data. in Innovations in Smart Cities Applications Volume 4. 2021. Cham: Springer International Publishing.
Weinmann, M., B. Jutzi, and C. Mallet. Feature relevance assessment for the semantic interpretation of 3D point cloud data. ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci., 2013. II-5/W2: p. 313–318.
Hackel, T., J. D. Wegner, and K. Schindler. Contour Detection in Unstructured 3D Point Clouds. in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2016.
Barrile, V., G. Candela, and A. Fotia. Point cloud segmentation using image processing techniques for structural analysis. Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., 2019. XLII-2/W11: p. 187–193.
WuDunn, M., J. Dunn, and A. Zakhor. Point Cloud Segmentation using RGB Drone Imagery. in 2020 IEEE International Conference on Image Processing (ICIP). 2020.
Majidizadeh, A., H. Hasani, and M. Jafari. Semantic segmentation of UAV images based on U-NET in urban area. ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci., 2021. X-4/W1-2022: p. 451–457.
Mahmud, M. N., et al. Road Image Segmentation using Unmanned Aerial Vehicle Images and DeepLab V3+ Semantic Segmentation Model, in 2021 11th IEEE International Conference on Control System, Computing and Engineering (ICCSCE), IEEE, Editor. 2021, IEEE: Penang, Malaysia.
SZ DJI Technology Co., L. MAVIC 2 product information. Available from: https://www.dji.com/mavic-2/info.
Xu, Y., X. Tong, and U. Stilla. Voxel-based representation of 3D point clouds: Methods, applications, and its potential use in the construction industry. Automation in Construction, 2021. 126: p. 103675.
Ester, M., et al. A density-based algorithm for discovering clusters in large spatial databases with noise, in Proceedings of the Second International Conference on Knowledge Discovery and Data Mining. 1996, AAAI Press: Portland, Oregon. p. 226–231.
CloudCompare. CloudCompare 3D point cloud and mesh processing software. 2019; Available from: https://www.danielgm.net/cc/.
Information & Authors
Information
Published In
History
Published online: Jan 25, 2024
ASCE Technical Topics:
- Automation and robotics
- Computer networks
- Computing in civil engineering
- Design (by type)
- Engineering fundamentals
- Geometrics
- Highway and road conditions
- Highway and road design
- Highway and road management
- Highway transportation
- Highways and roads
- Infrastructure
- Models (by type)
- Systems engineering
- Three-dimensional models
- Traffic engineering
- Traffic management
- Traffic safety
- Transportation engineering
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.