AI-Driven 3D Point Cloud-Based Highway Infrastructure Monitoring System Using UAV
Publication: Computing in Civil Engineering 2021
ABSTRACT
Highway maintenance and infrastructure monitoring tasks often involve labor-intensive activities and long inspection times. Examples of these maintenance tasks include landscaping and lawn care, detecting damaged road segments, and identifying missing road signs. While several infrastructure monitoring methods have been proposed, many of them are only carried out using 2D images and do not fully utilize the 3D geometric information in the scene. Additionally, most methods often downscale the data and did not consider the fine resolution needed for inspection tasks. To efficiently automate the maintenance inspection tasks, this research proposes a new approach that combines a data collection framework using unmanned aerial vehicle (UAV) with artificial intelligence (AI)-driven data processing techniques. Structure from motion (SfM) is used to create dense 3D point clouds from image data, and deep learning techniques are used to segment and classify different highway assets. Point cloud-based temporal change detection is carried out with a focus on grass height estimation for monitoring highway mowing operations. A field highway data set is collected to evaluate the proposed method. Experimental results show that the method achieved 93% semantic segmentation accuracy and 6.31 cm root mean square error (RMSE) in grass height estimation.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Adams, T. M., and Sokolowski, D. (2007). “Routine Highway Maintenance: Relationship between Cost and Condition.” (August), 0–13.
de Castro, A. I., Torres-Sánchez, J., Peña, J. M., Jiménez-Brenes, F. M., Csillik, O., and López-Granados, F. (2018). “An automatic random forest-OBIA algorithm for early weed mapping between and within crop rows using UAV imagery.” Remote Sensing, 10(2), 1–21.
Davis, A. G., Rens, K. L., Wipf, T. J., and Klaiber, F. W. (1999). “Review of Nondestructive Evaluation Techniques of Civil Infrastructure.” Journal of Performance of Constructed Facilities, 13(1), 47–48.
Dong, J., Burnham, J. G., Boots, B., Rains, G., and Dellaert, F. (2017). “4D crop monitoring: Spatio-temporal reconstruction for agriculture.” Proceedings - IEEE International Conference on Robotics and Automation, 3878–3885.
GDOT, G. D. of T. (2020). Mowing Scope of Work.
Kim, J., and Ham, Y. (2020). Construction Research Congress 2020: Computer Applications. American Society of Civil Engineer, 2018(2008), 1384p.
Kim, S., and Irizarry, J. (2020). “Knowledge-Based Considerations for Developing UAS Operational Procedures on Infrastructure and Construction Task Environments.” Construction Research Congress 2020, 268–277.
López-Granados, F., Torres-Sánchez, J., De Castro, A. I., Serrano-Pérez, A., Mesas-Carrascosa, F. J., and Peña, J. M. (2016). “Object-based early monitoring of a grass weed in a grass crop using high resolution UAV imagery.” Agronomy for Sustainable Development, Agronomy for Sustainable Development, 36(4).
Maturana, D., and Scherer, S. (2015). “VoxNet: A 3D Convolutional Neural Network for real-time object recognition.” IEEE International Conference on Intelligent Robots and Systems, IEEE, 2015-Decem, 922–928.
Milioto, A., Vizzo, I., Behley, J., and Stachniss, C. (2019). “RangeNet ++: Fast and Accurate LiDAR Semantic Segmentation.” IEEE International Conference on Intelligent Robots and Systems, (i), 4213–4220.
Obanawa, H., Yoshitoshi, R., Watanabe, N., and Sakanoue, S. (2020). “Portable lidar-based method for improvement of grass height measurement accuracy: Comparison with SFM methods.” Sensors (Switzerland), 20(17), 1–11.
Qi, C. R., Su, H., Mo, K., and Guibas, L. J. (2017a). “PointNet: Deep learning on point sets for 3D classification and segmentation.” Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, 2017-Janua, 77–85.
Qi, C. R., Yi, L., Su, H., and Guibas, L. J. (2017b). “PointNet++: Deep hierarchical feature learning on point sets in a metric space.” Advances in Neural Information Processing Systems, 2017-Decem, 5100–5109.
Eck, R. W., and McGee, H. W. (2008). Vegetation Control for Safety A Guide for Local Highway and Street.
Spencer, B. F., Hoskere, V., and Narazaki, Y. (2019). “Advances in Computer Vision-Based Civil Infrastructure Inspection and Monitoring.” Engineering, Chinese Academy of Engineering, 5(2), 199–222.
Sun, T., Di, Z., Che, P., Liu, C., and Wang, Y. (2019). “Leveraging crowdsourced gps data for road extraction from aerial imagery.” Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2019-June, 7501–7510.
Information & Authors
Information
Published In
Computing in Civil Engineering 2021
Pages: 894 - 901
History
Published online: May 24, 2022
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.