Technical Papers
May 17, 2019

Automating Data Collection for Robotic Bridge Inspections

Publication: Journal of Bridge Engineering
Volume 24, Issue 8

Abstract

Regular bridge inspections are key to maintaining healthy infrastructure and to preventing unanticipated structural failures. In recent years, mobile inspection robots have been proposed as a tool to aid bridge inspections. Their key advantages include the ability to access areas of a bridge that are otherwise difficult to inspect and the ability to automate the process of collecting and processing data to increase repeatability and reliability of inspections. Although software algorithms have successfully demonstrated the ability to automate defect detection, many data collection platforms, such as drones and ground vehicles, still require an operator to control the robot via teleoperation, and they do not adequately address the challenges associated with automating data collection for bridge inspection, which is central to achieve repeatability of inspections over time. In this study, the challenges associated with automating data collection for visual inspection of bridges are addressed using a ground-based robot, and an autonomy framework, which can meet the requirements for management and execution of inspection plans, is presented. Key tasks considered in this study are managing inspection plan execution on a ground-based robot, robot localization and mapping, and autonomous navigation in a bridge environment. This automated data collection framework is demonstrated on a concrete bridge by automatically building an accurate point cloud reconstruction of the bridge. Automating data collection can enable more systematic and repeatable inspections, which is a critical upstream task to constructing deterioration models in structural components using inspection data collected over the lifetime of a bridge.

Get full access to this article

View all available purchase options and get full access to this article.

References

AASHTO. 2018. “Summary of results from state dot drone usage surveys.” Accessed April 9, 2018. https://transportation.libguides.com/uav/surveys.
Bedkowski, J., T. Röhling, F. Hoeller, D. Shulz, and F. E. Schneider. 2017. “Benchmark of 6D slam (6D simultaneous localisation and mapping) algorithms with robotic mobile mapping systems.” Found. Comput. Decis. Sci. 42 (3): 275–295. https://doi.org/10.1515/fcds-2017-0014.
Besl, P. J., and N. D. McKay. 1992. “Method for registration of 3-D shapes.” In Vol. 1611 of Sensor fusion IV: Control paradigms and data structures, edited by P. S. Schenker, 586–607. Bellingham, WA: SPIE.
Bircher, A., K. Alexis, M. Burri, P. Oettershagen, S. Omari, T. Mantel, and R. Siegwart. 2015. “Structural inspection path planning via iterative viewpoint resampling with application to aerial robotics.” In Proc., 2015 IEEE International Conf. on Robotics and Automation (ICRA), 6423–6430. Piscataway, NJ: IEEE.
Borrmann, D., J. Elseberg, K. Lingemann, A. Nüchter, and J. Hertzberg. 2008. “Globally consistent 3D mapping with scan matching.” Rob. Auton. Syst. 56 (2): 130–142. https://doi.org/10.1016/j.robot.2007.07.002.
Brown, A. S. 2018. “Something to prove.” Mech. Eng. 140 (8): 30–35. https://doi.org/10.1115/1.2018-AUG-1.
Cadena, C., L. Carlone, H. Carrillo, Y. Latif, D. Scaramuzza, J. Neira, I. Reid, and J. J. Leonard. 2016. “Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age.” IEEE Trans. Rob. 32 (6): 1309–1332. https://doi.org/10.1109/TRO.2016.2624754.
FHWA (Federal Highway Administration). 2017. “National Bridge Inventory (NBI).” Accessed January 17, 2017. https://www.fhwa.dot.gov/bridge/nbi.cfm.
Fox, D., W. Burgard, and S. Thrun. 1997. “The dynamic window approach to collision avoidance.” IEEE Rob. Autom. Mag. 4 (1): 23–33. https://doi.org/10.1109/100.580977.
Gibb, S., H. M. La, T. Le, L. Nguyen, R. Schmid, and H. Pham. 2017. “Nondestructive evaluation sensor fusion with autonomous robotic system for civil infrastructure inspection.” J. Field Rob. 35 (6): 988–1004.
Hallermann, N., and G. Morgenthal. 2014. “Visual inspection strategies for large bridges using unmanned aerial vehicles (UAV).” In Proc., 7th IABMAS, Int. Conf. on Bridge Maintenance, Safety and Management, 661–667. Shanghai, China: IABMAS.
Kazhdan, M., and H. Hoppe. 2013. “Screened Poisson surface reconstruction.” ACM Trans. Graphics 32 (3): 29. https://doi.org/10.1145/2487228.2487237.
Koch, C., K. Georgieva, V. Kasireddy, B. Akinci, and P. Fieguth. 2015. “A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure.” Adv. Eng. Inf. 29 (2): 196–210. https://doi.org/10.1016/j.aei.2015.01.008.
La, H. M., N. Gucunski, K. Dana, and S.-H. Kee. 2017. “Development of an autonomous bridge deck inspection robotic system.” J. Field Rob. 34 (8): 1489–1504. https://doi.org/10.1002/rob.21725.
Lattanzi, D., and G. Miller. 2017. “Review of robotic infrastructure inspection systems.” J. Infrastruct. Syst. 23 (3): 04017004. https://doi.org/10.1061/(ASCE)IS.1943-555X.0000353.
Lu, F., and E. Milios. 1997. “Globally consistent range scan alignment for environment mapping.” Auton. Rob. 4 (4): 333–349. https://doi.org/10.1023/A:1008854305733.
Moore, T., and D. Stouch. 2016. “A generalized extended Kalman filter implementation for the robot operating system.” In Intelligent autonomous systems 13, edited by E. Menegatti, N. Michael, K. Berns, and H. Yamaguchi, 335–348. Cham, Switzerland: Springer.
Nüchter, A., K. Lingemann, J. Hertzberg, and H. Surmann. 2007. “6D slam–3D mapping outdoor environments.” J. Field Rob. 24 (8–9): 699–722. https://doi.org/10.1002/rob.20209.
Peel, H., S. Luo, A. Cohn, and R. Fuentes. 2018. “Localisation of a mobile robot for bridge bearing inspection.” Autom. Constr. 94 (Oct): 244–256. https://doi.org/10.1016/j.autcon.2018.07.003.
Quigley, M., K. Conley, B. Gerkey, J. Faust, T. Foote, E. Berger, J. Leibs, R. Wheeler, and A. Y. Ng. 2009. “Ros: An open-source robot operating system.” In ICRA Workshop on Open Source Software, 5. Kobe, Japan: ICRA.
Segal, A., D. Haehnel, and S. Thrun. 2009. “Generalized-ICP.” In Vol. 2 of Robotics: Science and systems, edited by S. Schaal and G. S. Sukhatme, 435. Cambridge, MA: MIT Press.
Stachniss, C., U. Frese, and G. Grisetti. 2007. “OpenSLAM.” Accessed June 1, 2018. http://www.openslam.org.
Thrun, S. 2003. “Robotic mapping: A survey.” Exploring artificial intelligence in the new millennium, edited by G. Lakemeyer. San Francisco: Morgan Kauffmann, 1–35.
Thrun, S., and M. Montemerlo. 2006. “The graph SLAM algorithm with applications to large-scale mapping of urban structures.” Int. J. Rob. Res. 25 (5–6): 403–429. https://doi.org/10.1177/0278364906065387.
Wulf, O., A. Nüchter, J. Hertzberg, and B. Wagner. 2008. “Benchmarking urban six-degree-of-freedom simultaneous localization and mapping.” J. Field Rob. 25 (3): 148–163. https://doi.org/10.1002/rob.20234.

Information & Authors

Information

Published In

Go to Journal of Bridge Engineering
Journal of Bridge Engineering
Volume 24Issue 8August 2019

History

Received: Sep 30, 2018
Accepted: Feb 18, 2019
Published online: May 17, 2019
Published in print: Aug 1, 2019
Discussion open until: Oct 17, 2019

Permissions

Request permissions for this article.

Authors

Affiliations

Stephen Phillips, S.M.ASCE
Ph.D. Candidate, Dept. of Civil and Environmental Engineering, Univ. of Waterloo, Waterloo, ON N2L 3G1, Canada.
Professor, Dept. of Civil and Environmental Engineering and Mechanical and Mechatronics Engineering, Univ. of Waterloo, Waterloo, ON N2L 3G1, Canada (corresponding author). ORCID: https://orcid.org/0000-0003-0412-6244. Email: [email protected]

Metrics & Citations

Metrics

Citations

Download citation

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

Cited by

View Options

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share