Analysis of Flight Parameters on UAV Semantic Segmentation Performance for Highway Infrastructure Monitoring
Publication: Computing in Civil Engineering 2021
ABSTRACT
In the long-term operation of highway infrastructure, timely monitoring and performance verification of maintenance tasks are integral. Some examples of these maintenance tasks are mowing the landscape of highway areas, detecting debris, patching unfilled holes in the pavement, and identifying and repairing road signs. This study will develop a framework that integrates unmanned aerial vehicle (UAV) image acquisition with image segmentation methods to automate the tasks needed to effectively maintain highway infrastructure. Existing research for UAV-based environment monitoring has limitations in the number of data sets relevant for highway monitoring and did not comprehensively analyze the effect of changing flight parameters. To overcome these limitations, the proposed research investigates the effect of flight parameters on UAV semantic segmentation performance by considering images taken from varying UAV heights and both vertical and oblique camera angles. This research uses a deep neural network based on U-Net to automatically processes the images and segments them into different regions. Efficient training data annotation is also carried out by performing large-scale ground truth annotation through automatic co-labeling of images and point cloud data. Validation experiments were performed on a real highway data set, showing that while the segmentation performance varies by 3%–25% depending on the flight height, the performance only varies by 0.5% depending on the camera angle.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Bhatnagar, S., Gill, L., and Ghosh, B. (2020). “Drone Image Segmentation Using Machine and Deep Learning for Mapping Raised Bog Vegetation Communities.” Remote Sensing, MDPI AG, 12(16), 2602.
De Castro, A. I., Torres-Sánchez, J., Peña, J. M., Jiménez-Brenes, F. M., Csillik, O., and López-Granados, F. (2018). “An Automatic Random Forest-OBIA Algorithm for Early Weed Mapping between and within Crop Rows Using UAV Imagery.” Remote Sensing, 10(2).
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., and Schiele, B. (2016). The Cityscapes Dataset for Semantic Urban Scene Understanding. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.
Geng, L., Zhang, Y. F., Wang, J. J., Fuh, J. Y. H., and Teo, S. H. (2013). “Mission planning of autonomous UAVs for urban surveillance with evolutionary algorithms.” IEEE International Conference on Control and Automation, ICCA, 828–833.
Karar, M. E., Alotaibi, F., Al Rasheed, A., and Reyad, O. (2021). “A pilot study of smart agricultural irrigation using unmanned aerial vehicles and IoT-based cloud system.” Information Sciences Letters, Natural Sciences Publishing, 10(1), 131–140.
Kim, S., and Irizarry, J. (2020). “Knowledge-Based Considerations for Developing UAS Operational Procedures on Infrastructure and Construction Task Environments.” Construction Research Congress 2020, 268–277.
Lin, T. Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., and Zitnick, C. L. (2014). “Microsoft COCO: Common objects in context.” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Springer Verlag, 740–755.
López-Granados, F., Torres-Sánchez, J., De Castro, A. I., Serrano-Pérez, A., Mesas-Carrascosa, F. J., and Peña, J. M. (2016). “Object-based early monitoring of a grass weed in a grass crop using high resolution UAV imagery.” Agronomy for Sustainable Development, Springer-Verlag France, 36(4), 1–12.
Lottes, P., Khanna, R., Pfeifer, J., Siegwart, R., and Stachniss, C. (2017). “UAV-based crop and weed classification for smart farming.” Proceedings - IEEE International Conference on Robotics and Automation, Institute of Electrical and Electronics Engineers Inc., 3024–3031.
Lyu, Y., Vosselman, G., Xia, G.-S., Yilmaz, A., and Yang, M. Y. (2020). “UAVid: A semantic segmentation dataset for UAV imagery.” ISPRS Journal of Photogrammetry and Remote Sensing, 165, 108–119.
Pap, M., Kiraly, S., and Moljak, S. (2019). “Investigating the usability of UAV obtained multispectral imagery in tree species segmentation.” International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, International Society for Photogrammetry and Remote Sensing, 159–165.
Pi, Y., Nath, N. D., and Behzadan, A. H. (2021). “Detection and Semantic Segmentation of Disaster Damage in UAV Footage.” Journal of Computing in Civil Engineering, American Society of Civil Engineers (ASCE), 35(2), 04020063.
Rottensteiner, F., Sohn, G., Jung, J., Gerke, M., Baillard, C., Benitez, S., and Breitkopf, U. (2012). “The ISPRS benchmark on urban object classification and 3D building reconstruction.” ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences.
“Semantic Drone Dataset.” (2019). <http://dronedataset.icg.tugraz.at/>(Apr. 10, 2021).
Xiang, H., and Tian, L. (2011). “Development of a low-cost agricultural remote sensing system based on an autonomous unmanned aerial vehicle (UAV).” Biosystems Engineering, Academic Press, 108(2), 174–190.
Information & Authors
Information
Published In
History
Published online: May 24, 2022
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.