Technical Papers
May 28, 2020

Estimation of Construction Site Elevations Using Drone-Based Orthoimagery and Deep Learning

Publication: Journal of Construction Engineering and Management
Volume 146, Issue 8

Abstract

Using deep learning to recover depth information from a single image has been studied in many situations, but there are no published articles related to the determination of construction site elevations. This paper presents the research results of developing and testing a deep learning model for estimating construction site elevations using a drone-based orthoimage. The proposed method includes an orthoimage-based convolutional neural network (CNN) encoder, an elevation map CNN decoder, and an overlapping orthoimage disassembling and elevation map assembling algorithm. In the convolutional encoder-decoder network model, the max pooling and up-sampling layers link the orthoimage pixel and elevation map pixel in the same coordinate. The experiment data sets are eight orthoimage and elevation map pairs (1,536×1,536  pixels), which are cropped into 64,800 patch pairs (128×128  pixels). Experimental results indicated that the 128×128-pixel patch had the best model prediction performance. After 100 training epochs, 21.22% of the selected 2,304 points from the testing data set were exactly matched with their ground truth elevation values; and 52.43% points were accurately matched in ±5  cm and 66.15% points in ±10  cm, less than 10% points exceeded ±25  cm. This research project advanced drone applications in construction, evaluated CNNs’ effectiveness in site surveying, and strengthened CNNs to work with large-scale construction site images.

Get full access to this article

View all available purchase options and get full access to this article.

Data Availability Statement

The model training and testing data sets [orthoimage and elevation map pairs appear in Figs. 8(a and b)] are available from the corresponding author upon reasonable request. The Python code (convolutional encoder-decoder network model appears in Fig. 5 and Table 2) is available from the corresponding author upon reasonable request.

Acknowledgments

This work was supported by the McShane Endowment fund at Marquette University.

References

Badrinarayanan, V., A. Kendall, and R. Cipolla. 2017. “SegNet: A deep convolutional encoder-decoder architecture for image segmentation.” IEEE Trans. Pattern Anal. Mach. Intell. 39 (12): 2481–2495. https://doi.org/10.1109/TPAMI.2016.2644615.
Chen, W., Z. F1u, D. Yang, and J. Deng. 2016. “Single-image depth perception in the wild.” In Proc., Conf. on 30th Neural Information Processing Systems (NIPS 2016), 730–738. Barcelona, Spain: NeurIPS.
Chollet, F. 2015. “Keras: The Python deep learning library.” Accessed August 7, 2019. https://keras.io/.
Dettmers, T. 2015. “Deep learning in a nutshell: Core concepts.” Accessed August 7, 2019. https://devblogs.nvidia.com/deep-learning-nutshell-core-concepts/.
Du, J. C., and H. C. Teng. 2007. “3D laser scanning and GPS technology for landslide earthwork volume estimation.” Autom. Constr. 16 (5): 657–663. https://doi.org/10.1016/j.autcon.2006.11.002.
Eigen, D., C. Puhrsch, and R. Fergus. 2014. “Depth map prediction from a single image using a multi-scale deep network.” In Proc., 28th Conf. on Neural Information Processing Systems (NIPS 2014), 2366–2374. Montréal, Canada: NeurIPS.
Garg, R., V. K. BG, G. Carneiro, and I. Reid. 2016. “Unsupervised CNN for single view depth estimation: Geometry to the rescue.” In Proc. 14th European Conf. on Computer Vision (ECCV 2016), 740–756. Amsterdam, Netherlands: Springer.
Haur, C. J., L. S. Kuo, C. P. Fu, Y. L. Hsu, and C. Da Heng. 2018. “Feasibility study on UAV-assisted construction surplus soil tracking control and management technique.” In Proc., 5th Annual Int. Conf. on Material Science and Environmental Engineering (MSEE2017). Xiamen, China: IOP Publishing.
Jiang, Y., and Y. Bai. 2020. “Determination of construction site elevations using drone technology.” In Proc. Construction Research Congress. Reston, VA: ASCE.
Kim, H., and H. Kim. 2018. “3D reconstruction of a concrete mixer truck for training object detectors.” Autom. Constr. 88 (Apr): 23–30. https://doi.org/10.1016/j.autcon.2017.12.034.
Kwon, S., J. W. Park, D. Moon, S. Jung, and H. Park. 2017. “Smart merging method for hybrid point cloud data using UAV and LIDAR in earthwork construction.” Procedia Eng. 196 (Jan): 21–28. https://doi.org/10.1016/j.proeng.2017.07.168.
Laina, I., C. Rupprecht, V. Belagiannis, F. Tombari, and N. Navab. 2016. “Deeper depth prediction with fully convolutional residual networks.” In Proc., 4th Int. Conf. on 3D Vision (3DV 2016), 239–248. New York: IEEE.
Li, Z., and N. Snavely. 2018. “MegaDepth: Learning single-view depth prediction from internet photos.” In Proc., 2018 IEEE/CVF Conf. on Computer Vision and Pattern Recognition, 2041–2050. New York: IEEE.
Liu, F., C. Shen, and G. Lin. 2015. “Deep convolutional neural fields for depth estimation from a single image.” In Proc., 2015 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR 2015), 5162–5170. New York: IEEE.
Nair, V. and G. Hinton. 2010. “Rectified linear units improve restricted Boltzmann machines.” In Proc., 27th Int. Conf. on Machine Learning (ICML 2010), 807–814. Haifa, Israel: International Machine Learning Society.
Nassar, K., and Y. Jung. 2012. “Structure-from-motion approach to the reconstruction of surfaces for earthwork planning.” J. Constr. Eng. Project Manage. 2 (3): 1–7. https://doi.org/10.6106/JCEPM.2012.2.3.001.
Noh, H., S. Hong, and B. Han. 2015. “Learning deconvolution network for semantic segmentation.” In Proc., 2015 IEEE Int. Conf. on Computer Vision (ICCV 2015), 1520–1528. New York: IEEE.
Siebert, S., and J. Teizer. 2014. “Mobile 3D mapping for surveying earthwork projects using an unmanned aerial vehicle (UAV) system.” Autom. Constr. 41 (May): 1–14. https://doi.org/10.1016/j.autcon.2014.01.004.
Sung, C., and P. Y. Kim. 2016. “3D terrain reconstruction of construction sites using a stereo camera.” Autom. Constr. 64 (Apr): 65–77. https://doi.org/10.1016/j.autcon.2015.12.022.
Takahashi, N., R. Wakutsu, T. Kato, T. Wakaizumi, T. Ooishi, and R. Matsuoka. 2017. “Experiment on UAV photogrammetry and terrestrial laser scanning for ICT-integrated construction.” In Proc., 2017 Int. Conf. on Unmanned Aerial Vehicles in Geomatics, 371–377. Bonn, Germany: ISPRS.
Zhou, X., G. Zhong, L. Qi, J. Dong, T. D. Pham, and J. Mao. 2017. “Surface height map estimation from a single image using convolutional neural networks.” In Proc., 8th Int. Conf. on Graphic and Image Processing (ICGIP 2016). Tokyo: Society of Photo-Optical Instrumentation Engineers.

Information & Authors

Information

Published In

Go to Journal of Construction Engineering and Management
Journal of Construction Engineering and Management
Volume 146Issue 8August 2020

History

Received: Aug 21, 2019
Accepted: Jan 31, 2020
Published online: May 28, 2020
Published in print: Aug 1, 2020
Discussion open until: Oct 28, 2020

Permissions

Request permissions for this article.

Authors

Affiliations

Ph.D. Candidate, Dept. of Civil, Construction and Environmental Engineering, Marquette Univ., P.O. Box 1881, Milwaukee, WI 53201-1881 (corresponding author). ORCID: https://orcid.org/0000-0001-9661-1022. Email: [email protected]
Yong Bai, Ph.D., F.ASCE [email protected]
P.E.
McShane Chair and Professor, Dept. of Civil, Construction and Environmental Engineering, Marquette Univ., P.O. Box 1881, Milwaukee, WI 53201-1881. Email: [email protected]

Metrics & Citations

Metrics

Citations

Download citation

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

Cited by

View Options

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share