Construction Site Segmentation Using Drone-Based Ortho-Image and Convolutional Encoder-Decoder Network Model
Publication: Construction Research Congress 2022
ABSTRACT
This paper presents a convolutional encoder-decoder network model for pixelwise segmentation of drone-based ortho-images of construction sites. The input ortho-image disassembling and output label-image prediction assembling algorithms are supplemented with the encoder-decoder to process high-resolution inputs. Parameter analyses were conducted to evaluate the performances between differently sized small-patches and different model training epochs. Testing results showed using the 64 × 64-pixel patch with 100-epoch can produce a well-trained encoder-decoder for pixelwise segmentation with a pixel accuracy of 0.98 in validation and 0.93 in testing, and had weighted average results of the precision, recall and f1-score larger than 0.98 in validation, and larger than 0.93 in testing. The developed method was also applied to object detection in drone photogrammetric orthophoto for objects’ contour extraction, then the extracted contours were used for as-built modeling in AutoCAD. The results of this work can benefit construction professionals in automatic as-built modeling and earthwork estimation if they have the corresponding elevations.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Badrinarayanan, V., Kendall, A., and Cipolla, R. (2017). “SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation.” IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(12), 2481–2495.
Bianchi, E., Abbott, A. L., Tokekar, P., and Hebdon, M. (2021). “COCO-Bridge: Structural Detail Data Set for Bridge Inspections.” Journal of Computing in Civil Engineering, 35(3), 04021003.
Chen, K., Reichard, G., Akanmu, A., and Xu, X. (2021). “Geo-registering UAV-captured close-range images to GIS-based spatial model for building façade inspections.” Automation in Construction, Elsevier B.V., 122(January 2020), 103503.
Dung, C. V., and Anh, L. D. (2019). “Autonomous concrete crack detection using deep fully convolutional neural network.” Automation in Construction, Elsevier, 99(December 2018), 52–58.
Han, J., Zhang, D., Cheng, G., Guo, L., and Ren, J. (2015). “Object detection in optical remote sensing images based on weakly supervised learning and high-level feature learning.” IEEE Transactions on Geoscience and Remote Sensing, Institute of Electrical and Electronics Engineers Inc., 53(6), 3325–3337.
Jiang, Y. (2021). “As-Built CAD Drawing Tool.” <https://www.yuhanjiang.com/research/DT/CAD> (May 18, 2021).
Jiang, Y., Bai, Y., and Han, S. (2020). “Determining Ground Elevations Covered by Vegetation on Construction Sites Using Drone-Based Orthoimage and Convolutional Neural Network.” Journal of Computing in Civil Engineering, 34(6), 04020049.
Jiang, Y., Han, S., and Bai, Y. (2021). “Development of a Pavement Evaluation Tool Using Aerial Imagery and Deep Learning.” Journal of Transportation Engineering, Part B: Pavements, 147(3), 04021027.
Lippoldt, F. (2019). “Window Detection in Facades for Aerial Texture Files of 3D CityGML Models.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 11–19.
Noh, H., Hong, S., and Han, B. (2015). “Learning Deconvolution Network for Semantic Segmentation.” 2015 IEEE International Conference on Computer Vision (ICCV), IEEE, 1520–1528.
Protopapadakis, E., Voulodimos, A., Doulamis, A., Doulamis, N., and Stathaki, T. (2019). “Automatic crack detection for tunnel inspection using deep learning and heuristic image post-processing.” Applied Intelligence, 49(7), 2793–2806.
Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation. 234–241.
Westoby, M. J., Brasington, J., Glasser, N. F., Hambrey, M. J., and Reynolds, J. M. (2012). “‘Structure-from-Motion’ photogrammetry: A low-cost, effective tool for geoscience applications.” Geomorphology, 179, 300–314.
Yeum, C. M., and Dyke, S. J. (2015). “Vision-Based Automated Crack Detection for Bridge Inspection.” Computer-Aided Civil and Infrastructure Engineering, 30(10), 759–770.
Information & Authors
Information
Published In
Construction Research Congress 2022
Pages: 1096 - 1105
History
Published online: Mar 7, 2022
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited by
- Yuhan Jiang, Sisi Han, Yong Bai, Scan4Façade: Automated As-Is Façade Modeling of Historic High-Rise Buildings Using Drones and AI, Journal of Architectural Engineering, 10.1061/(ASCE)AE.1943-5568.0000564, 28, 4, (2022).