Damage Detection and Finite-Element Model Updating of Structural Components through Point Cloud Analysis
Publication: Journal of Aerospace Engineering
Volume 31, Issue 5
Abstract
Accurate and rapid condition assessment of in-service structural components is critical to ensure safety and serviceability. One major assessment consideration is the detection and quantification of structural section loss due to deterioration, for instance, from corrosion. Modern three-dimensional (3D) imaging techniques, which generate high-resolution 3D point clouds, are capable of detecting and measuring these deteriorations. However, despite advancements in the fields of automated point cloud analysis for as-built modeling and structural inspection, the potential use of spatial 3D data for updating numerical finite-element (FE) models of structures is still an emergent topic. This paper presents a localized methodology for the automatic and systematic detection and quantification of damages in structural components using high-fidelity 3D point cloud data, followed by a corresponding local update to an FE model. In this study, 3D point cloud data of a targeted structure were first obtained by using dense structure from motion (DSfM) algorithms. Section loss damage was then identified and located through computer vision and 3D data processing techniques. In order to preserve data integrity and resolve localized high-fidelity details, direct 3D point cloud comparisons were performed. An experimental study validating the developed approach is presented as well. The results indicate that the presented methodology will enable engineers to use the updated structural model to determine the reserved capacity and remaining service life of structural elements, though further studies on methods to improve mesh generation and defect quantification are warranted.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
The authors would like to thank the National Science Foundation (NSF) (Grant No. CMMI-1433765), as well as the Thomas F. and Kate Miller Jeffress Memorial Trust, for their support of this study.
References
Ali, S., Z. Toony, and D. Laurendeau. 2015. “A 3D vision-based inspection method for pairwise comparison of locally deformable 3D models.” Mach. Vision Appl. 26 (7–8): 1061–1078. https://doi.org/10.1007/s00138-015-0711-0.
ASTM. 2016. Standard test methods for tension testing of metallic materials. ASTM E8/E8M-16a. West Conshohocken, PA: ASTM.
Barazzetti, L., F. Banfi, R. Brumana, G. Gusmeroli, M. Previtali, and G. Schiantarelli. 2015. “Cloud-to-BIM-to-FEM: Structural simulation with accurate historic BIM from laser scans.” Simul. Modell. Pract. Theory 57: 71–87. https://doi.org/10.1016/j.simpat.2015.06.004.
Berger, M., A. Tagliasacchi, L. M. Seversky, P. Alliez, G. Guennebaud, J. A. Levine, A. Sharf, and C. T. Silva. 2017. “A survey of surface reconstruction from point clouds.” Comput. Graphics Forum 36 (1): 301–329. https://doi.org/10.1111/cgf.12802.
Besl, P. J., and N. D. McKay. 1992. “Method for registration of 3-D shapes.” In Vol. 1611 of Proc., Sensor Fusion IV: Control Paradigms and Data Structures, 586–607. Boston: International Society for Optics and Photonics.
Conde-Carnero, B., B. Riveiro, P. Arias, and J. Caamaño. 2015. “Exploitation of geometric data provided by laser scanning to create FEM structural models of bridges.” J. Perform. Constr. Facil. 30 (3): 04015053. https://doi.org/10.1061/(ASCE)CF.1943-5509.0000807.
Dai, K., D. Boyajian, W. Liu, S.-E. Chen, J. Scott, and M. Schmieder. 2014. “Laser-based field measurement for a bridge finite-element model validation.” J. Perform. Constr. Facil. 28 (5): 04014024. https://doi.org/10.1061/(ASCE)CF.1943-5509.0000484.
Dyn, N., D. Levin, and S. Rippa. 1990. “Data dependent triangulations for piecewise linear interpolation.” IMA J. Numer. Anal. 10 (1): 137–154. https://doi.org/10.1093/imanum/10.1.137.
Erkal, B. G., and J. F. Hajjar. 2017. “Laser-based surface damage detection and quantification using predicted surface properties.” Autom. Constr. 83: 285–302. https://doi.org/10.1016/j.autcon.2017.08.004.
Fathi, H., F. Dai, and M. Lourakis. 2015. “Automated as-built 3D reconstruction of civil infrastructure using computer vision: Achievements, opportunities, and challenges.” Adv. Eng. Inf. 29 (2): 149–161. https://doi.org/10.1016/j.aei.2015.01.012.
Fernandez, I., J. M. Bairán, and A. R. Marí. 2016. “3D FEM model development from 3D optical measurement technique applied to corroded steel bars.” Constr. Build. Mater. 124: 519–532. https://doi.org/10.1016/j.conbuildmat.2016.07.133.
Friedman, J. H., J. L. Bentley, and R. A. Finkel. 1977. “An algorithm for finding best matches in logarithmic expected time.” ACM Trans. Math. Software 3 (3): 209–226. https://doi.org/10.1145/355744.355745.
Girardeau-Montaut, D., M. Roux, R. Marc, and G. Thibault. 2005. “Change detection on points cloud data acquired with a ground laser scanner.” In Proc., Int. Archives of Photogrammetry, Remote Sensing, and Spatial Information Series, 30–35. Enschede, Netherlands: ISPRS.
Gong, J., and A. Maher. 2014. “Use of mobile lidar data to assess hurricane damage and visualize community vulnerability.” Transp. Res. Rec. 2459: 119–126. https://doi.org/10.3141/2459-14.
Hartley, R., and A. Zisserman. 2004. Multiple view geometry in computer vision. New York: Cambridge University Press.
Hild, F., and S. Roux. 2006. “Digital image correlation: From displacement measurement to identification of elastic properties: A review.” Strain 42 (2): 69–80. https://doi.org/10.1111/j.1475-1305.2006.00258.x.
Hinks, T., H. Carr, L. Truong-Hong, and D. F. Laefer. 2013. “Point cloud data conversion into solid models via point-based voxelization.” J. Surv. Eng. 139 (2): 72–83. https://doi.org/10.1061/(ASCE)SU.1943-5428.0000097.
Hirschmüller, H., M. Buder, and I. Ernst. 2012. “Memory efficient semi-global matching.” ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci. I-3: 371–376. https://doi.org/10.5194/isprsannals-I-3-371-2012.
Hoffmann, C. M. 1989. Geometric and solid modeling: An introduction. Burlington, MA: Morgan Kaufmann.
Huttenlocher, D. P., G. A. Klanderman, and W. J. Rucklidge. 1993. “Comparing images using the Hausdorff distance.” IEEE Trans. Pattern Anal. Mach. Intell. 15 (9): 850–863. https://doi.org/10.1109/34.232073.
Jafari, B., A. Khaloo, and D. Lattanzi. 2017. “Deformation tracking in 3D point clouds via statistical sampling of direct cloud-to-cloud distances.” J. Nondestr. Eval. 36 (4): 65. https://doi.org/10.1007/s10921-017-0444-2.
Jahanshahi, M. R., J. S. Kelly, S. F. Masri, and G. S. Sukhatme. 2009. “A survey and evaluation of promising approaches for automatic image-based defect detection of bridge structures.” Struct. Infrastruct. Eng. 5 (6): 455–486. https://doi.org/10.1080/15732470801945930.
Kazhdan, M., M. Bolitho, and H. Hoppe. 2006. “Poisson surface reconstruction.” In Proc., 4th Eurographics Symp. on Geometry Processing, 61–70. Aire-la-Ville: Eurographics Association.
Kazhdan, M., and H. Hoppe. 2013. “Screened Poisson surface reconstruction.” ACM Trans. Graph. 32 (3): 29. https://doi.org/10.1145/2487228.2487237.
Khaloo, A., and D. Lattanzi. 2016. “Hierarchical dense structure-from-motion reconstructions for infrastructure condition assessment.” J. Comput. Civ. Eng. 31 (3): 04016047. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000616.
Khaloo, A., and D. Lattanzi. 2017. “Integrating 3D computer vision and robotic infrastructure inspection.” In Structural health monitoring 2017, 3202–3209. Stanford, CA: DEStech Publications.
Khaloo, A., D. Lattanzi, K. Cunningham, R. Dell’Andrea, and M. Riley. 2018. “Unmanned aerial vehicle inspection of the Placer river trail bridge through image-based 3D modelling.” Struct. Inf. Eng. 14 (1): 124–136. https://doi.org/10.1080/15732479.2017.1330891.
Koch, C., K. Georgieva, V. Kasireddy, B. Akinci, and P. Fieguth. 2015. “A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure.” Adv. Eng. Inf. 29 (2): 196–210. https://doi.org/10.1016/j.aei.2015.01.008.
Laefer, D., D. Hinks, H. Carr, and L. Truong-Hong. 2011. “New Advances in Automated Urban Modelling from Airborne Laser Scanning Data.” Recent Pat. Eng. 5 (3): 196–208.
Laefer, D. F., L. Truong-Hong, H. Carr, and M. Singh. 2014. “Crack detection limits in unit based masonry with terrestrial laser scanning.” NDT & E Int. 62: 66–76. https://doi.org/10.1016/j.ndteint.2013.11.001.
Lague, D., N. Brodu, and J. Leroux. 2013. “Accurate 3D comparison of complex topography with terrestrial laser scanner: Application to the Rangitikei canyon (N-Z).” ISPRS J. Photogramm. Remote Sens. 82: 10–26. https://doi.org/10.1016/j.isprsjprs.2013.04.009.
Lubowiecka, I., J. Armesto, P. Arias, and H. Lorenzo. 2009. “Historic bridge modelling using laser scanning, ground penetrating radar and finite element methods in the context of structural dynamics.” Eng. Struct. 31 (11): 2667–2676. https://doi.org/10.1016/j.engstruct.2009.06.018.
Ma, L., R. Sacks, R. Zeibak-Shini, A. Aryal, and S. Filin. 2016. “Preparation of synthetic as-damaged models for post-earthquake BIM reconstruction research.” J. Comput. Civ. Eng. 30 (3): 04015032. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000500.
Macneal, R. H., and R. L. Harder. 1985. “A proposed standard set of problems to test finite element accuracy.” Finite Elem. Anal. Des. 1 (1): 3–20. https://doi.org/10.1016/0168-874X(85)90003-4.
Mukupa, W., G. W. Roberts, C. M. Hancock, and K. Al-Manasir. 2017. “A review of the use of terrestrial laser scanning application for change detection and deformation monitoring of structures.” Surv. Rev. 49 (353): 99–116. https://doi.org/10.1080/00396265.2015.1133039.
Olsen, M. J., F. Kuester, B. J. Chang, and T. C. Hutchinson. 2009. “Terrestrial laser scanning-based structural damage assessment.” J. Comput. Civ. Eng. 24 (3): 264–272. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000028.
Puso, M. A., and J. Solberg. 2006. “A stabilized nodally integrated tetrahedral.” Int. J. Numer. Methods Eng. 67 (6): 841–867. https://doi.org/10.1002/nme.1651.
Qin, R., J. Tian, and P. Reinartz. 2016. “3D change detection: Approaches and applications.” ISPRS J. Photogramm. Remote Sens. 122: 41–56. https://doi.org/10.1016/j.isprsjprs.2016.09.013.
Riveiro, B., J. C. Caamaño, P. Arias, and E. Sanz. 2011. “Photogrammetric 3D modelling and mechanical analysis of masonry arches: An approach based on a discontinuous model of voussoirs.” Autom. Constr. 20 (4): 380–388. https://doi.org/10.1016/j.autcon.2010.11.008.
Rousseeuw, P. J., and S. Verboven. 2002. “Robust estimation in very small samples.” Comput. Stat. Data Anal. 40 (4): 741–758. https://doi.org/10.1016/S0167-9473(02)00078-6.
Rusinkiewicz, S., and M. Levoy. 2001. “Efficient variants of the ICP algorithm.” In Proc., 3rd Int. Conf. on 3-D Digital Imaging and Modeling, 145–152. New York: IEEE.
Rusu, R. B., Z. C. Marton, N. Blodow, M. Dolha, and M. Beetz. 2008. “Towards 3D point cloud based object maps for household environments.” Rob. Auton. Syst. 56 (11): 927–941. https://doi.org/10.1016/j.robot.2008.08.005.
Sánchez-Aparicio, L. J., B. Riveiro, D. Gonzalez-Aguilera, and L. F. Ramos. 2014. “The combination of geomatic approaches and operational modal analysis to improve calibration of finite element models: A case of study in Saint Torcato Church (Guimarães, Portugal).” Constr. Build. Mater. 70: 118–129. https://doi.org/10.1016/j.conbuildmat.2014.07.106.
Stavroulaki, M. E., B. Riveiro, G. A. Drosopoulos, M. Solla, P. Koutsianitis, and G. E. Stavroulakis. 2016. “Modelling and strength evaluation of masonry bridges using terrestrial photogrammetry and finite elements.” Adv. Eng. Software 101: 136–148. https://doi.org/10.1016/j.advengsoft.2015.12.007.
Truong-Hong, L., D. F. Laefer, T. Hinks, and H. Carr. 2013. “Combining an angle criterion with voxelization and the flying voxel method in reconstructing building models from LiDAR data.” Comput. Aided Civ. Infrastruct. Eng. 28 (2): 112–129. https://doi.org/10.1111/j.1467-8667.2012.00761.x.
Várady, T., R. R. Martin, and J. Cox. 1997. “Reverse engineering of geometric models: An introduction.” Comput. Aided Des. 29 (4): 255–268. https://doi.org/10.1016/S0010-4485(96)00054-1.
Zeibak-Shini, R., R. Sacks, L. Ma, and S. Filin. 2016. “Towards generation of as-damaged BIM models using laser-scanning and as-built BIM: First estimate of as-damaged locations of reinforced concrete frame members in masonry infill structures.” Adv. Eng. Inf. 30 (3): 312–326. https://doi.org/10.1016/j.aei.2016.04.001.
Zhu, Z., S. German, and I. Brilakis. 2010. “Detection of large-scale concrete columns for automated bridge inspection.” Autom. Constr. 19 (8): 1047–1055. https://doi.org/10.1016/j.autcon.2010.07.016.
Information & Authors
Information
Published In
Journal of Aerospace Engineering
Volume 31 • Issue 5 • September 2018
Copyright
©2018 American Society of Civil Engineers.
History
Received: Aug 3, 2017
Accepted: Mar 2, 2018
Published online: Jun 22, 2018
Published in print: Sep 1, 2018
Discussion open until: Nov 22, 2018
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.