UAV Bridge Inspection through Evaluated 3D Reconstructions
Publication: Journal of Bridge Engineering
Volume 24, Issue 4
Abstract
Imagery-based, three-dimensional (3D) reconstruction from unmanned aerial vehicles (UAVs) holds the potential to provide safer, more economical, and less disruptive bridge inspection. In support of those efforts, this paper proposes a process using an imagery-based point cloud. First, a bridge inspection procedure is introduced, including data acquisition, 3D reconstruction, data quality evaluation, and subsequent damage detection. Next, evaluation mechanisms are proposed including checking data coverage, analyzing point distribution, assessing outlier noise, and measuring geometric accuracy. The overall approach is illustrated in the form of a case study with a low-cost UAV. Areas of particular coverage difficulty involved slim features such as railings, in which obtaining sufficient features for image matching proved challenging. Shadowing and large tilt angles hid or weakened texturing surfaces, which also interfered with the matching process.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
This project was made possible through the generous support of the European Union’s Horizon 2020 Research and Innovation program under Marie Skłodowska-Curie Grant 642453.
References
AASHTO. 1970. Manual for maintenance inspection of bridges. Washington, DC: AASHTO.
Berger, M., A. Tagliasacchi, L. M. Seversky, P. Alliez, J. A. Levine, A. Sharf, and C. T. Silva. 2014. “State of the art in surface reconstruction from point clouds.” In Vol. 1 of Proc., Eurographics 2014–State of the Art Reports, edited by S. Lefebvre and M. Spagnuolo, 161–185. Geneva, Switzerland: Eurographics Association. https://doi.org/10.2312/egst.20141040.
Besl, P. J., and N. D. McKay. 1992. “A method for registration of 3-D shapes.” IEEE Trans. Pattern Anal. Mach. Intell. 14 (2): 239–256. https://doi.org/10.1109/34.121791.
Bircher, A., K. Alexis, M. Burri, P. Oettershagen, S. Omari, T. Mantel, and R. Siegwart. 2015. “Structural inspection path planning via iterative viewpoint resampling with application to aerial robotics.” In Proc., Int. Conf. on Robotics and Automation, 6423–6430. Piscataway, NJ: IEEE. https://doi.org/10.1109/ICRA.2015.7140101.
Byrne, J., and D. F. Laefer. 2016. “Variables effecting photomosaic reconstruction and ortho-rectification from aerial survey datasets.” Preprint submitted November 10, 2016. https://arxiv.org/abs/1611.03318.
Byrne, J., D. F. Laefer, and E. O’Keeffe. 2017a. “Maximizing feature detection in aerial unmanned aerial vehicle datasets.” J. Appl. Remote Sens. 11 (2): 025015. https://doi.org/10.1117/1.JRS.11.025015.
Byrne, J., E. O’Keeffe, D. Lennon, and D. F. Laefer. 2017b. “3D Reconstructions using unstabilized video footage from an unmanned aerial vehicle.” J. Imaging 3 (2): 15. https://doi.org/10.3390/jimaging3020015.
Chan, B., H. Guan, J. Jo, and M. Blumenstein. 2015. “Towards UAV-based bridge inspection systems: A review and an application perspective.” Struct. Monit. Maint. 2 (3): 283–300. https://doi.org/10.12989/smm.2015.2.3.283.
Chen, S., D. F. Laefer, and E. Mangina. 2016. “State of technology review of civilian UAVs.” Recent Pat. Eng. 10 (3): 160–174. https://doi.org/10.2174/1872212110666160712230039.
Chen, S., D. F. Laefer, J. Byrne, and A. S. Natanzi. 2017. “The effect of angles and distance on image-based, three-dimensional re-constructions.” In Proc., 2nd Int. Conf. on Engineering Sciences and Technologies, 2757–2761. Boca Raton, FL: CRC Press.
Cheng, S.-W., and M.-K. Lau. 2017. “Denoising a point cloud for surface reconstruction.” Preprint submitted April 13, 2017. https://arxiv.org/abs/1704.04038.
Díaz-Vilariño, L., H. González-Jorge, J. Martínez-Sánchez, M. Bueno, and P. Arias. 2016. “Determining the limits of unmanned aerial photogrammetry for the evaluation of road runoff.” Measurement 85 (May): 132–141. https://doi.org/10.1016/j.measurement.2016.02.030.
Eschmann, C., C. M. Kuo, C. H. Kuo, and C. Boller. 2013. “High-resolution multisensor infrastructure inspection with unmanned aircraft systems.” Int. Arch. Photogramm. Remote Sensing Spatial Inf. Sci. XL-1/W2: 125–129. https://doi.org/10.5194/isprsarchives-XL-1-W2-125-2013.
Escobar-Wolf, R., T. Oommen, C. N. Brooks, R. J. Dobson, and T. M. Ahlborn. 2017. “Unmanned aerial vehicle (UAV)-based assessment of concrete bridge deck delamination using thermal and visible camera sensors: A preliminary analysis.” Res. Nondestr. Eval. 29 (4): 183–198. https://doi.org/10.1080/09349847.2017.1304597.
Fernandez Galarreta, J., N. Kerle, and M. Gerke. 2015. “UAV-based urban structural damage assessment using object-based image analysis and semantic reasoning.” Nat. Hazards Earth Syst. Sci. Discuss. 15: 1087–1101. https://doi.org/10.5194/nhessd-2-5603-2014.
Hallermann, N., and G. Morgenthal. 2016. “From aerial photography to 3-dimensional inspection of bridges.” In Proc., IABSE Conf.: Bridges and Structures Sustainability-Seeking Intelligent Solutions, 546–553. Zurich, Switzerland: IABSE. https://doi.org/10.2749/222137816819258898.
Hassanalian, M., and A. Abdelke. 2017. “Classifications, applications, and design challenges of drones: A review.” Prog. Aerosp. Sci. 91 (May): 99–131. https://doi.org/10.1016/j.paerosci.2017.04.003.
Hinks, T., H. Carr, and D. F. Laefer. 2009. “Flight optimization algorithms for aerial LiDAR capture for urban infrastructure model generation.” J. Comput. Div. Eng. 23 (6): 330–339. https://doi.org/10.1061/(ASCE)0887-3801(2009)23:6(330).
Huang, H., D. Li, H. Zhang, U. Ascher, and D. Cohen-Or. 2009. “Consolidation of unorganized point clouds for surface reconstruction.” ACM Trans. Graphics 28 (5): 176. https://doi.org/10.1145/1618452.1618522.
Jahanshahi, M. R., S. F. Masri, and G. S. Sukhatme. 2011. “Multi-image stitching and scene reconstruction for evaluating defect evolution in structures.” Struct. Health Monit. 10 (6): 643–657. https://doi.org/10.1177/1475921710395809.
JCGM/WG 1 (Working Group 1 of the Joint Committee for Guides in Metrology). 2008. Evaluation of measurement data—Guide to the expression of uncertainty in measurement. JCGM 100:2008. Paris: JCGM.
Katz, D. 2018. “Surveyors and other professional drone operators should be focused on accuracy and reliability.” Commercial UAV News. Accessed December 8, 2018. https://www.expouav.com/news/latest/surveyors-and-other-professional-drone-operators-should-be-focused-on-accuracy-and-reliability/.
Kim, J.-W., S.-B. Kim, J.-C. Park, and J.-W. Nam. 2015. “Development of crack detection system with unmanned aerial vehicles and digital image processing.” In Proc., 2015 World Congress on Advances in Structure Engineering and Mechanics (AESM15), 1–11. Incheon, Korea: AESM15.
Koutsoudis, A., B. Vidmar, G. Ioannakis, F. Arnaoutoglou, G. Pavlidis, and C. Chamzas. 2014. “Multi-image 3D reconstruction data evaluation.” J. Cult. Heritage 15 (1): 73–79. https://doi.org/10.1016/j.culher.2012.12.003.
Laefer, D. F., J. Gannon, and E. Deely. 2010. “Reliability of crack detection for baseline condition.” J. Infrastruct. Syst. 16 (2): 129–137. https://doi.org/10.1061/(ASCE)1076-0342(2010)16:2(129).
Laefer, D. F., M. Fitzgerald, E. M. Maloney, D. Coyne, D. Lennon, and S. Morrish. 2009. “Lateral image degradation in terrestrial laser scanning.” Struct. Eng. Int. 19 (2): 184–189. https://doi.org/10.2749/101686609788220196.
Laefer, D. F., L. Truong-Hong, H. Carr, and M. Singh. 2014. “Crack detection limits in unit based masonry with terrestrial laser scanning.” NDT & E Int. 62 (Mar): 66–76. https://doi.org/10.1016/j.ndteint.2013.11.001.
Lowe, D. G. 2004. “Distinctive image features from scale-invariant keypoints.” Int. J. Comput. Vision 60 (2): 91–110. https://doi.org/10.1023/B:VISI.0000029664.99615.94.
Lueker, M., and J. Marr. 2014. Scour monitoring technology implementation. MN/RC 2014-37. St. Paul, MN: Minnesota DOT.
Moenning, C., and N. A. Dodgson. 2003. “A new point cloud simplification algorithm.” In Proc., 3rd IASTED Int. Conf. on Visualization, Imaging, and Image Processing (VIIP 2003), 1027–1033. Calgary, AB, Canada: ACTA Press.
Mosbrucker, A. R., J. J. Major, K. R. Spicer, and J. Pitlick. 2017. “Camera system considerations for geomorphic applications of SfM photogrammetry.” Earth Surf. Processes Landforms 42 (6): 969–986. https://doi.org/10.1002/esp.4066.
Muja, M., and D. G. Lowe. 2009. “Fast approximate nearest neighbors with automatic algorithm configuration.” In Vol. 1 of Proc., 4th Int. Conf. on Computer Vision Theory and Applications (VISAPP 2009), 331–340. Setubal, Portugal: Scitepress.
Nishimura, S., K. Kimoto, S. Kusuhara, S. Kawabata, A. Abe, and T. Okazawa. 2012. “Development of a hybrid camera system for bridge inspection.” In Bridge maintenance, safety, management, resilience and sustainability, edited by F. Biondini and D. M. Frangopol, 2197–2203. London: Taylor & Francis.
Paine, D. P. 2003. Aerial photography and image interpretation. Hoboken, NJ: John Wiley & Sons.
Palmer, L., K. Franke, R. Martin, B. Sines, K. Rollins, and J. Hedengren. 2015. “The application and accuracy of structure from motion computer vision models with full- scale geotechnical field tests.” In IFCEE 2015, Geotechnical Special Publication 256, edited by M. Iskander, M. T. Suleiman, B. Anderson, and D. F. Laefer, 2432–2441. Reston, VA: ASCE. https://doi.org/10.1061/9780784479087.225.
Quagliarini, E., P. Clini, and M. Ripanti. 2017. “Fast, low cost and safe methodology for the assessment of the state of conservation of historical buildings from 3D laser scanning: The case study of Santa Maria in Portonovo (Italy).” J. Cult. Heritage 24 (Mar): 175–183. https://doi.org/10.1016/j.culher.2016.10.006.
RAIU (Railway Accident Investigation Unit). 2010. Malahide Viaduct Collapse on the Dublin to Belfast Line, on the 21st August 2009. Investigation Rep. No. 2010-R004. Blackrock, Ireland: RAIU.
Sargent, I., J. Harding, and M. Freeman. 2007. “Data quality in 3D: Gauging quality measures from users’ requirements.” In Proc., 5th Int. Symp. Spatial Data Quality 2007: Modelling Qualities in Space and Time, edited by A. Stein, 8. Newcastle, UK: ISPRS.
Schonberger, J. L., and J.-M. Frahm. 2016. “Structure-from-motion revisited.” In Proc., IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 4104–4113. Piscataway, NJ: IEEE.
Slocum, R. K., and C. E. Parrish. 2017. “Simulated imagery rendering workflow for UAS-based photogrammetric 3D reconstruction accuracy assessments.” Remote Sens. 9 (4): 396. https://doi.org/10.3390/rs9040396.
Sterritt, G. 2009. Review of Bridge Inspection Competence and Training Project Rep. Research Project UG637. London: UK Bridges Board.
Szeliski, R. 2010. Computer vision: Algorithms and applications. London: Springer-Verlag.
Tagliasacchi, A., H. Zhang, and D. Cohen. 2009. “Curve skeleton extraction from incomplete point cloud.” ACM Trans. Graphics 28 (3): 71. https://doi.org/10.1145/1531326.1531377.
Truong-Hong, L., H. Falter, D. Lennon, and D. F. Laefer. 2016. “Framework for bridge inspection with laser scanning.” In Proc., 14th East Asia-Pacific Conf. on Structural Engineering and Construction (EASEC-14), 1–9. Ho Chi Minh City, Vietnam: EASEC.
Truong-Hong, L., and D. F. Laefer. 2015. “Documentation of bridges by terrestrial laser scanner.” In Vol. 105 of Proc., IABSE Symp. Rep., IABSE Conf., 1–8. Zurich, Switzerland: IABSE. https://doi.org/10.2749/222137815818358691.
Ullman, S. 1979. “The interpretation of structure from motion.” Proc. R. Soc. London, Ser. B 203 (1153): 405–426. https://doi.org/10.1098/rspb.1979.0006.
Wallace, L., A. Lucieer, C. Watson, and D. Turner. 2012. “Development of a UAV-LiDAR system with application to forest inventory.” Remote Sens. 4 (6): 1519–1543. https://doi.org/10.3390/rs4061519.
Wallace, L., A. Lucieer, Z. Malenovsky, D. Turner, and P. Vopenka. 2016. “Assessment of forest structure using two UAV techniques: A comparison of airborne laser scanning and structure from motion (SfM) point clouds.” Forests 7 (3): 62. https://doi.org/10.3390/f7030062.
Westoby, M. J., J. Brasington, N. F. Glasser, M. J. Hambrey, and J. M. Reynolds. 2012. “‘Structure-from-motion’ photogrammetry: A low-cost, effective tool for geoscience applications.” Geomorphology 179 (Dec): 300–314. https://doi.org/10.1016/j.geomorph.2012.08.021.
Wolff, K., C., Kim, H., Zimmer, C., Schroers, M. Botsch, and O. Sorkine-Hornung, and A. Sorkine-Hornung. 2016. “Point cloud noise and outlier removal for image-based 3D reconstruction.” In Proc., 2016 4th Int. Conf. on 3D Vision Point, 118–27. Piscataway, NJ: IEEE.
Yin, Z., Y. Mao, and C. Seto. 2015. Develop a UAV platform for automated bridge inspection. Final Rep. No. 25-1121-0003-295. Rolla, MO: Missouri Univ. of Science and Technology.
Zarco-Tejada, P. J., R. Diaz-Varela, V. Angileri, and P. Loudjani. 2014. “Tree height quantification using very high resolution imagery acquired from an unmanned aerial vehicle (UAV) and automatic 3D photo-reconstruction methods.” Eur. J. Agron. 55 (Apr): 89–99. https://doi.org/10.1016/j.eja.2014.01.004.
Information & Authors
Information
Published In
Journal of Bridge Engineering
Volume 24 • Issue 4 • April 2019
Copyright
© 2019 American Society of Civil Engineers.
History
Received: Mar 15, 2018
Accepted: Jul 31, 2018
Published online: Jan 16, 2019
Published in print: Apr 1, 2019
Discussion open until: Jun 16, 2019
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.