Impact Echo Data Visualization through Augmented Reality
Publication: Journal of Infrastructure Systems
Volume 28, Issue 3
Abstract
This study presents and discusses a comprehensive work of nondestructive evaluation of a concrete bridge deck using impact echo for delamination evaluation, including data collection, processing, and presentation. Among the typical process of most nondestructive evaluation methods, this paper focuses on data visualization through augmented reality (AR). The test was conducted on the concrete bridge deck constructed by the Korea Expressway Corporation Research Institute in South Korea. The tested bridge deck was made of latex modified concrete and presented several artificial defects. A two-dimensional delamination condition map was generated and displayed along with delamination depth on a smartphone screen through AR. The entire process of the developed system was run fully automated in real time. The developed system successfully demonstrated the potential of the AR visualization approach, which is an effective and intuitive aid for human inspection for infrastructure condition monitoring with respect to the delamination of a concrete bridge deck. The intuitive interaction with the outdoor road environment by AR-based nondestructive evaluation data visualization would contribute to efficient inspection and smooth communication between participated infrastructure maintenance teams.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Impact echo data used in this study are available from the corresponding author upon reasonable request.
Acknowledgments
This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (No. NRF-2018R1C1B5031504).
References
Abbas, A., J. Seo, and M. Kim. 2020. “Impact of mobile augmented reality system on cognitive behavior and performance during rebar inspection tasks.” J. Comput. Civ. Eng. 34 (6): 04020050. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000931.
Abdallah, A. M., R. A. Atadero, and M. E. Ozbek. 2022. “A state-of-the-art review of bridge inspection planning: Current situation and future needs.” J. Bridge Eng. 27 (2): 03121001. https://doi.org/10.1061/(ASCE)BE.1943-5592.0001812.
Ahn, S., S. Han, and M. Al-Hussein. 2019. “2D drawing visualization framework for applying projection-based augmented reality in a panelized construction manufacturing facility: Proof of concept.” J. Comput. Civ. Eng. 33 (5): 04019032. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000843.
Apple. n.d. “ARKit.” Accessed August 29, 2019. https://developer.apple.com/augmented-reality/.
Azari, H., N. Gucunski, J. Kim, and K. Dinh. 2016. “Performance of concrete bridge decks of similar construction and environment, but different traffic loads.” Transp. Res. Rec. 2550 (1): 22–30. https://doi.org/10.3141/2550-04.
Ballor, J. P., O. L. McClain, M. A. Mellor, A. Cattaneo, T. A. Harden, P. Shelton, E. Martinez, B. Narushof, F. Moreu, and D. D. Mascareñas. 2019. “Augmented reality for next generation infrastructure inspections.” In Vol. 3 of Model validation and uncertainty quantification, 185–192. New York: Springer.
Billinghurst, M., A. Clark, and G. Lee. 2015. “A survey of augmented reality.” Presence: Teleoperators Virtual Environ. 6 (4): 355–385.
Bishop, I. D. 2015. “Location based information to support understanding of landscape futures.” Landscape Urban Plann. 142 (Oct): 120–131. https://doi.org/10.1016/j.landurbplan.2014.06.001.
Cartz, L. 1995. Nondestructive testing. Boca Raton, FL: CRC Press.
Chen, J.-S., and C.-C. Huang. 2010. “Effect of surface characteristics on bonding properties of bituminous tack coat.” Transp. Res. Rec. 2180 (1): 142–149. https://doi.org/10.3141/2180-16.
Cheng, C., and M. Sansalone. 1993. “The impact-echo response of concrete plates containing delaminations: Numerical, experimental and field studies.” Mater. Struct. 26 (5): 274–285. https://doi.org/10.1007/BF02472949.
Cheng, J. C. P., K. Chen, and W. Chen. 2020. “State-of-the-art review on mixed reality applications in the AECO industry.” J. Constr. Eng. Manage. 146 (2): 03119009. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001749.
Correia, N., and A. Mugayar. 2021. “Effect of binder rates and geogrid characteristics on the shear bond strength of reinforced asphalt interfaces.” Constr. Build. Mater. 269 (Feb): 121292. https://doi.org/10.1016/j.conbuildmat.2020.121292.
de Souza Cardoso, L. F., F. C. M. Q. Mariano, and E. R. Zorzal. 2020. “A survey of industrial augmented reality.” Comput. Ind. Eng. 139 (Jan): 106159. https://doi.org/10.1016/j.cie.2019.106159.
Dinh, K., N. Gucunski, J. Kim, and T. H. Duong. 2017. “Method for attenuation assessment of GPR data from concrete bridge decks.” NDT & E Int. 92 (Dec): 50–58. https://doi.org/10.1016/j.ndteint.2017.07.016.
Eschmann, C., and T. Wundsam. 2017. “Web-based georeferenced 3D inspection and monitoring of bridges with unmanned aircraft systems.” J. Surv. Eng. 143 (3): 04017003. https://doi.org/10.1061/(ASCE)SU.1943-5428.0000221.
Gibson, A., and J. S. Popovics. 2005. “Lamb wave basis for impact-echo method analysis.” J. Eng. Mech. 131 (4): 438–443. https://doi.org/10.1061/(ASCE)0733-9399(2005)131:4(438).
Google. n.d. “ARCore.” Accessed August 31, 2019. https://developers.google.com/ar/.
Gucunski, N., B. Pailes, J. Kim, H. Azari, and K. Dinh. 2016. “Capture and quantification of deterioration progression in concrete bridge decks through periodical NDE surveys.” J. Infrastruct. Syst. 23 (1): B4016005. https://doi.org/10.1061/(ASCE)IS.1943-555X.0000321.
Gucunski, N., B. Pailes, J. Kim, H. Azari, and K. Dinh. 2017. “Capture and quantification of deterioration progression in concrete bridge decks through periodical NDE surveys.” J. Infrastruct. Syst. 23 (1): B4016005. https://doi.org/10.1061/(ASCE)IS.1943-555X.0000321.
Gucunski, N., G. Slabaugh, Z. Wang, T. Fang, and A. Maher. 2008. “Impact echo data from bridge deck testing: Visualization and interpretation.” Transp. Res. Rec. 2050 (1): 111–121. https://doi.org/10.3141/2050-11.
Gucunski, N., M. Yan, Z. Wang, T. Fang, and A. Maher. 2012. “Rapid bridge deck condition assessment using three-dimensional visualization of impact echo data.” J. Infrastruct. Syst. 18 (1): 12–24. https://doi.org/10.1061/(ASCE)IS.1943-555X.0000060.
Haynes, P., and E. Lange. 2016. “Mobile augmented reality for flood visualisation in urban riverside landscapes.” JoDLA—J. Digital Landscape Archit. 1 (May): 254–262.
Hu, D., F. Hou, J. Blakely, and S. Li. 2020. “Augmented reality based visualization for concrete bridge deck deterioration characterized by ground penetrating radar.” In Proc., Construction Research Congress 2020: Computer Applications, 1156–1164. Reston, VA: ASCE. https://doi.org/10.1061/9780784482865.122.
Karaaslan, E., U. Bagci, and F. N. Catbas. 2019. “Artificial intelligence assisted infrastructure assessment using mixed reality systems.” Transp. Res. Rec. 2673 (12): 413–424. https://doi.org/10.1177/0361198119839988.
Karaaslan, E., U. Bagci, and F. N. Catbas. 2021a. “A novel decision support system for long-term management of bridge networks.” Appl. Sci. 11 (13): 5928. https://doi.org/10.3390/app11135928.
Karaaslan, E., U. Bagci, and F. N. Catbas. 2021b. “Attention-guided analysis of infrastructure damage with semi-supervised deep learning.” Autom. Constr. 125 (May): 103634. https://doi.org/10.1016/j.autcon.2021.103634.
Kilic, G., and A. Caner. 2020. “Augmented reality for bridge condition assessment using advanced non-destructive techniques.” Struct. Infrastruct. Eng. 17 (7): 977–989. https://doi.org/10.1080/15732479.2020.1782947.
Kim, J., N. Gucunski, and K. Dinh. 2019. “Deterioration and predictive condition modeling of concrete bridge decks based on data from periodic NDE surveys.” J. Infrastruct. Syst. 25 (2): 04019010. https://doi.org/10.1061/(ASCE)IS.1943-555X.0000483.
Kim, J., N. Gucunski, T. H. Duong, and K. Dinh. 2016. “Three-dimensional visualization and presentation of bridge deck condition based on multiple NDE data.” J. Infrastruct. Syst. 23 (3): B4016012. https://doi.org/10.1061/(ASCE)IS.1943-555X.0000341.
Lin, J.-R., J. Cao, J.-P. Zhang, C. van Treeck, and J. Frisch. 2019. “Visualization of indoor thermal environment on mobile devices based on augmented reality and computational fluid dynamics.” Autom. Constr. 103 (Jul): 26–40. https://doi.org/10.1016/j.autcon.2019.02.007.
Maharjan, D., M. Agüero, D. Mascarenas, R. Fierro, and F. Moreu. 2021. “Enabling human–infrastructure interfaces for inspection using augmented reality.” Struct. Health Monit. 20 (4): 1980–1996. https://doi.org/10.1177/1475921720977017.
Meng, D., S. Lin, and H. Azari. 2019. “Nondestructive corrosion evaluation of reinforced concrete bridge decks with overlays: An experimental study.” J. Test. Eval. 48 (1): 516–537.
Montero, A., T. Zarraonandia, P. Diaz, and I. Aedo. 2017. “Designing and implementing interactive and realistic augmented reality experiences.” Universal Access Inf. Soc. 18 (1): 49–61. https://doi.org/10.1007/s10209-017-0584-2.
Motamedi, A., N. Yabuki, K. Yokoi, and T. Fukuda. 2019. “An indoor thermal environment design system for renovation using augmented reality.” J. Comput. Des. Eng. 6 (2): 179–188. https://doi.org/10.1016/j.jcde.2018.05.007.
Napolitano, R., Z. Liu, C. Sun, and B. Glisic. 2019. “Combination of image-based documentation and augmented reality for structural health monitoring and building pathology.” Front. Built Environ. 5 (Apr): 50. https://doi.org/10.3389/fbuil.2019.00050.
Nee, A. Y., S. Ong, G. Chryssolouris, and D. Mourtzis. 2012. “Augmented reality applications in design and manufacturing.” CIRP Ann. 61 (2): 657–679. https://doi.org/10.1016/j.cirp.2012.05.010.
Nguyen, T. V., S. Kamma, V. Adari, T. Lesthaeghe, T. Boehnlein, and V. Kramb. 2021. “Mixed reality system for nondestructive evaluation training.” Virtual Reality 25 (3): 709–718. https://doi.org/10.1007/s10055-020-00483-1.
PTC. 2019. “Vuforia.” Accessed August 31, 2019. http://www.ptc.com/en/products/augmented-reality.
Rankohi, S., and L. Waugh. 2013. “Review and analysis of augmented reality literature for construction industry.” Visualization Eng. 1 (1): 1–18. https://doi.org/10.1186/2213-7459-1-9.
Roberto, P., F. Emanuele, Z. Primo, M. Adriano, L. Jelena, and P. Marina. 2019. “Design, large-scale usage testing, and important metrics for augmented reality gaming applications.” ACM Trans. Multimedia Comput. Commun. Appl. 15 (2): 1–18. https://doi.org/10.1145/3311748.
Sahin, D., and R. M. Yilmaz. 2020. “The effect of augmented reality technology on middle school students’ achievements and attitudes towards science education.” Comput. Educ. 144 (Jan): 103710. https://doi.org/10.1016/j.compedu.2019.103710.
Sansalone, M., and N. J. Carino. 1986. Impact-echo: A method for flaw detection in concrete using transient stress waves. Washington, DC: US Dept. of Commerce.
Schickert, M., C. Koch, and F. Bonitz. 2018. “Prospects for integrating augmented reality visualization of nondestructive testing results into model-based infrastructure inspection.” In Proc., NDE/NDT for Highways & Bridges: SMT 2018, 214–223. Columbus, OH: American Society for Nondestructive Testing.
Sudarsanan, N., R. Karpurapu, and V. Amrithalingam. 2018. “An investigation on the interface bond strength of geosynthetic-reinforced asphalt concrete using Leutner shear test.” Constr. Build. Mater. 186 (Oct): 423–437. https://doi.org/10.1016/j.conbuildmat.2018.07.010.
Sun, H., S. Pashoutani, and J. Zhu. 2018. “Nondestructive evaluation of concrete bridge decks with automated acoustic scanning system and ground penetrating radar.” Sensors 18 (6): 1955. https://doi.org/10.3390/s18061955.
Tang, K. S., D. L. Cheng, E. Mi, and P. B. Greenberg. 2020. “Augmented reality in medical education: A systematic review.” Can. Med. Educ. J. 11 (1): e81.
Williams, G., M. Gheisari, P.-J. Chen, and J. Irizarry. 2015. “BIM2MAR: An efficient BIM translation to mobile augmented reality applications.” J. Manage. Eng. 31 (1): A4014009. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000315.
Yan, J., X. Du, A. Downey, A. Cancelli, S. Laflamme, L. Leifsson, A. Chen, and F. Ubertini. 2018. “Surrogate model for condition assessment of structures using a dense sensor network.” In Proc., SPIE Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring. Bellingham, WA: Society of Photo-Optical Instrumentation Engineers.
Zollmann, S., R. Grasset, T. Langlotz, W. H. Lo, S. Mori, and H. Regenbrecht. 2020. “Visualization techniques in augmented reality: A taxonomy, methods and patterns.” IEEE Trans Visual Comput. Graphics 27 (9): 3808–3825. https://doi.org/10.1109/TVCG.2020.2986247.
Information & Authors
Information
Published In
Journal of Infrastructure Systems
Volume 28 • Issue 3 • September 2022
Copyright
© 2022 American Society of Civil Engineers.
History
Received: Dec 2, 2021
Accepted: Mar 31, 2022
Published online: May 27, 2022
Published in print: Sep 1, 2022
Discussion open until: Oct 27, 2022
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.