3D Scene Reconstruction for Robotic Bridge Inspection
Publication: Journal of Infrastructure Systems
Volume 21, Issue 2
Abstract
This paper provides a comparative study of two methods for reconstructing three-dimensional (3D) scenes from monocular two-dimensional (2D) images with respect to their applicability to robotic civil infrastructure inspection. The two methods considered are dense structure from motion (DSfM) and image mosaicing (IM). The primary metrics used in the comparison include: (1) the accuracy of the reconstructions for inspection measurement purposes, (2) the nature and prevalence of reconstruction artifacts, and (3) resolution demands for adequate reconstruction accuracy. A series of small-scale model reconstructions using both approaches were developed and compared. Findings from the small-scale tests were then applied to a full-scale field test of the robotic reconstruction system. Both methods generally produced geometrically accurate reconstructions, but the DSfM method was found to be more adaptable to complex field scenarios. There were also key differences in the frequency and nature of artifacts introduced by each method.
Get full access to this article
View all available purchase options and get full access to this article.
References
123D Catch [Computer software]. San Francisco, Autodesk.
Akbarzadeh, A., et al. (2006). “Towards urban 3D reconstruction from video.” 3D Data Processing, Visualization, and Transmission, 3rd Int. Symp., IEEE, 1–8.
Bay, H., Tuytelaars, T., and Gool, L. V. (2006). “Surf: Speeded up robust features.” Computer Vision-ECCV 2006, Springer, Heidelberg, 404–417.
Bhatla, A., Choe, S. Y., Fierro, O., and Leite, F. (2012). “Evaluation of accuracy of as-built 3D modeling from photos taken by handheld digital cameras.” Autom. Constr., 28(0), 116–127.
Bradski, G. (2000). “The opencv library.” Dr. Dobb’s J., 25(11), 120–126.
Brilakis, I., Fathi, H., and Rashidi, A. (2011). “Progressive 3D reconstruction of infrastructure with videogrammetry.” Autom. Constr., 20(7), 884–895.
Bristeau, P.-J., Callou, F., Vissire, D., and Petit, N. (2011). “The navigation and control technology inside the ar. drone micro uav.” World Congr., 18(1), 1477–1484.
Caballero, F., Merino, L., Ferruz, J., and Ollero, A. (2005). “A visual odometer without 3d reconstruction for aerial vehicles. Applications to building inspection.” Robotics and Automation, 2005. ICRA 2005. Proc., 2005 IEEE Int. Conf., IEEE, 4673–4678.
Chambers, A. D., et al. (2011). “Perception for a river mapping robot.” Proc., 2011 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS ’11), IEEE.
Choset, H. (2000). “Bridge inspection with serpentine robots.”, Transportation Research Board, Washington, DC.
Cignoni, P., Corsini, M., and Ranzuglia, G. (2008). “Meshlab: An open-source 3D mesh processing system.” Ercim News, 73, 45–46.
Dai, F., Dong, S., Kamat, V. R., and Lu, M. (2011). “Photogrammetry assisted measurement of interstory drift for rapid post-disaster building damage reconnaissance.” J. Nondestr. Eval., 30(3), 201–212.
Dai, F., and Lu, M. (2010). “Assessing the accuracy of applying photogrammetry to take geometric measurements on building products.” J. Constr. Eng. Manage., 242–250.
DeVault, J. E. (2000). “Robotic system for underwater inspection of bridge piers.” IEEE Instrum. Meas. Mag., 3(3), 32–37.
Frueh, C., Sammon, R., and Zakhor, A. (2004). “Automated texture mapping of 3D city models with oblique aerial imagery.” 3D Data Processing, Visualization and Transmission, Proc., 2nd Int. Symp., IEEE, 396–403.
Furukawa, Y., and Ponce, J. (2010). “Accurate, dense, and robust multiview stereopsis.” IEEE Trans. Pattern Anal. Mach. Intell., 32(8), 1362–1376.
Golparvar-Fard, M., Bohn, J., Teizer, J., Savarese, S., and Pea-Mora, F. (2011). “Evaluation of image-based modeling and laser scanning accuracy for emerging automated performance monitoring techniques.” Autom. Constr., 20(8), 1143–1155.
Guo, W., Soibelman, L., and Garrett, J. H., Jr. (2009). “Automated defect detection for sewer pipeline inspection and condition assessment.” Autom. Constr., 18(5), 587–596.
Hartle, R. A., and Administration, F. H. (2004). Bridge inspector’s reference manual, U.S. Dept. of Transportation, Washington, DC.
Hartley, R., and Zisserman, A. (2000). Multiple view geometry in computer vision, 2nd Ed., Cambridge University Press, Cambridge, U.K.
Huston, D., Esser, B., Miller, J., and Wang, X. (2003). “Robotic and mobile sensor systems for structural health monitoring.” Proc., 4th Int. Workshop on Structural Health Monitoring, Stanford, CA.
Jahanshahi, M. R., Masri, S. F., and Sukhatme, G. S. (2011). “Multi-image stitching and scene reconstruction for evaluating defect evolution in structures.” Struct. Health Monit., 10(6), 643–657.
Jankó, Z., Kós, G., and Chetverikov, D. (2005). “Creating entirely textured 3d models of real objects using surface flattening.” Mach. Graphics Vision, 14(4), 379–398.
Jauregui, D. V., Tian, Y., and Jiang, R. (2006). “Photogrammetry applications in routine bridge inspection and historic bridge documentation.”, Transportation Research Board, Washington, DC, 24–32.
Kazhdan, M., Bolitho, M., and Hoppe, H. (2006). “Poisson surface reconstruction.” Proc., 4th Eurographics Symp. on Geometry Processing, Eurographics Association, 61–70.
Lee, J. H., Lee, J. M., Kim, H. J., and Moon, Y. S. (2008). “Machine vision system for automatic inspection of bridges.” Image and Signal Processing, 2008. CISP’08. Congress, IEEE, 363–366.
Lensch, H. P. A., Heidrich, W., and Seidel, H. P. (2000). “Automated texture registration and stitching for real world models.” Computer Graphics and Applications, Proc., 8th Pacific Conf., IEEE, 317–452.
Lightroom version 4.4 [Computer software]. San Jose, CA, Adobe.
Lim, R. S., La, H. M., Shan, Z., and Sheng, W. (2011). “Developing a crack inspection robot for bridge maintenance.” Robotics and Automation (ICRA), IEEE Int. Conf., IEEE, 6288–6293.
Metni, N., and Hamel, T. (2007). “A uav for bridge inspection: Visual servoing control law with orientation limits.” Autom. Constr., 17(1), 3–10.
Murphy, R. R., et al. (2011a). “Robot-assisted bridge inspection.” J. Intell. Rob. Syst., 64(1), 77–95.
Murphy, R. R., et al. (2011b). “Use of remotely operated marine vehicles at Minamisanriku and Rikuzentakata Japan for disaster recovery.” Safety, Security, and Rescue Robotics (SSRR), 2011 IEEE Int. Symp., IEEE, 19–25.
Murphy, R. R., Steimle, E., Griffin, C., Cullins, C., Hall, M., and Pratt, K. (2008). “Cooperative use of unmanned sea surface and micro aerial vehicles at hurricane Wilma.” J. Field Rob., 25(3), 164–180.
Pizarro, O., Eustice, R., and Singh, H. (2004). “Large area 3d reconstructions from underwater surveys.” OCEANS’04. MTTS/IEEE Techno-Ocean’04, IEEE, 678–687.
Pollefeys, M., et al. (2004). “Visual modeling with a hand-held camera.” Int. J. Comput. Vision, 59(3), 207–232.
Snavely, N., Seitz, S. M., and Szeliski, R. (2008). “Modeling the world from internet photo collections.” Int. J. Comput. Vision, 80(2), 189–210.
Tingdahl, D., and Gool, L. V. (2011). “A public system for image based 3d model generation.” Computer Vision/Computer Graphics Collaboration Techniques, Springer, Heidelberg, 262–273.
Torok, M. M. (2012). “Autonomous sample collection using image-based 3d reconstructions.” M.S. thesis, Virginia Polytechnic Institute and State Univ., Blacksburg, VA.
Tung, P. C., Hwang, Y. R., and Wu, M. C. (2002). “The development of a mobile manipulator imaging system for bridge crack inspection.” Autom. Constr., 11(6), 717–729.
Valença, J., Júlio, E., and Araújo, H. (2012). “Applications of photogrammetry to structural assessment.” Exp. Tech., 36(5), 71–81.
Wright, R. S., Haemel, N., Sellers, G., and Lipchak, B. (2010). OpenGL SuperBible: Comprehensive tutorial and reference, Pearson Education, Upper Saddle River, NJ.
Zhang, Z. (2000). “A flexible new technique for camera calibration.” IEEE Trans. Pattern Anal. Mach. Intell., 22(11), 1330–1334.
Information & Authors
Information
Published In
Journal of Infrastructure Systems
Volume 21 • Issue 2 • June 2015
Copyright
© 2014 American Society of Civil Engineers.
History
Received: Sep 23, 2013
Accepted: Jun 12, 2014
Published online: Aug 6, 2014
Discussion open until: Jan 6, 2015
Published in print: Jun 1, 2015
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.