Developing Novel Monocular-Vision-Based Standard Operational Procedures for Nondestructive Inspection on Constructed Concrete Cracks
Publication: Journal of Performance of Constructed Facilities
Volume 34, Issue 2
Abstract
To mitigate the limitations in traditional concrete crack-measuring methods such as low degree in automation and high cost, this study aims to develop a novel method with standard operational procedures (SOP) for nondestructive inspection and automeasure on bridge concrete cracks based on monocular vision and the Harris algorithm. Through experiments in four scenarios using commercially available software as the programming and imaging-processing interface, a novel method, named Mono-Harris, with high automation, high detection speed, and high precision for nondestructive inspection and automeasure of bridge concrete cracks based on monocular vision and the Harris algorithm was developed. There were three main criteria in the experiments, including the shooting angle (parallel and not parallel), shooting distance (far and near), and checkerboard target positioning. Results revealed positively that the combination of monocular vision and image processing technique could effectively measure bridge concrete cracks and the Mono-Harris method developed in this study was efficient and effective.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
All data, models, and code generated or used during the study appear in the published article.
Acknowledgments
Authors are grateful to the Tongjiang Scholar Special Funding for financial support through grant number (605-50X17234), Quanzhou science and technology bureau for financial support through grant number (2018Z010), and Huaqiao University through grant number (17BS201).
References
Chen, J. H., M. C. Su, R. J. Cao, S. H. Hsu, and J. C. Lu. 2017. “A self-organizing map optimization based image recognition and processing model for bridge crack inspection.” Autom. Constr. 73 (Jan): 58–66. https://doi.org/10.1016/j.autcon.2016.08.033.
Ellenberg, A., A. Kontsos, F. Moon, and I. Bartoli. 2016. “Bridge deck delamination identification from unmanned aerial vehicle infrared imagery.” Autom. Constr. 72 (Dec): 155–165. https://doi.org/10.1016/j.autcon.2016.08.024.
Gao, Y., J. R. Lin, F. Y. He, S. B. Yin, and J. G. Zhu. 2016. “A monocular vision and inclinometer combined system for 6DOF measurement of double shield TBM.” Sens. Actuators, A 249 (Oct): 155–162. https://doi.org/10.1016/j.sna.2016.08.021.
Ghani, A. S. A., and N. A. M. Isa. 2015. “Enhancement of low quality underwater image through integrated global and local contrast correction.” Appl. Soft Comput. 37 (Dec): 332–344. https://doi.org/10.1016/j.asoc.2015.08.033.
Huang, S. H., Y. H. Huang, C. A. Blazquezc, and G. Paredes-Belmar. 2018. “Application of the ant colony optimization in the resolution of the bridge inspection routing problem.” Appl. Soft Comput. 65 (Apr): 443–461. https://doi.org/10.1016/j.asoc.2018.01.034.
Ibanez, M. B., and C. Delgado-Kloos. 2018. “Augmented reality for STEM learning: A systematic review.” Comput. Educ. 123 (Aug): 109–123. https://doi.org/10.1016/j.compedu.2018.05.002.
Kim, M. K., C. P. Cheng, H. Sohn, and C. C. Chang. 2015. “A framework for dimensional and surface quality assessment of precast concrete elements using BIM and 3D laser scanning.” Autom. Constr. 49 (Jan): 225–238. https://doi.org/10.1016/j.autcon.2014.07.010.
Kim, M. K., Q. Wang, J. W. Park, C. C. Chang, H. Sohn, and C. C. Chang. 2016. “Automated dimensional quality assurance of full-scale precast concrete elements using laser scanning and BIM.” Autom. Constr. 72 (Dec): 102–114. https://doi.org/10.1016/j.autcon.2016.08.035.
Koch, C., M. Neges, M. König, and M. Abramovici. 2014. “Natural markers for augmented reality-based indoor navigation and facility maintenance.” Autom. Constr. 48 (Dec): 18–30. https://doi.org/10.1016/j.autcon.2014.08.009.
Kwon, O. H., C. S. Park, and C. R. Lim. 2014. “A defect management system for reinforced concrete work utilizing BIM, image-matching and augmented reality.” Autom. Constr. 46 (Oct): 74–81. https://doi.org/10.1016/j.autcon.2014.05.005.
Lee, Y. K., and H. Yoo. 2017. “Low-cost 3D motion capture system using passive optical markers and monocular vision.” Optik 130 (Feb): 1397–1407. https://doi.org/10.1016/j.ijleo.2016.11.174.
Li, G., S. H. He, Y. F. Ju, and K. Du. 2014. “Long-distance precision inspection method for bridge cracks with image processing.” Autom. Constr. 41 (May): 83–95. https://doi.org/10.1016/j.autcon.2013.10.021.
Liang, Z. M., H. M. Gao, and Z. J. Wang. 2006. “The detection algorithm of sub-pixel coordinates in camera calibration.” Trans. China Weld. Inst. 27 (2): 101–104.
Liao, K. W., and Y. T. Lee. 2016. “Detection of rust defects on steel bridge coatings via digital image recognition.” Autom. Constr. 71 (Nov): 294–306. https://doi.org/10.1016/j.autcon.2016.08.008.
Liu, Y. C., and F. Zhu. 2006. “A new algorithm for X-corner detection.” J. Images Graphics 11 (5): 656–660.
Liu, Z. P., G. Lu, X. L. Liu, X. L. Jiang, and G. Lodewijks. 2017. “Image processing algorithms for crack detection in welded structures via pulsed eddy current thermal imaging.” IEEE Instrum. Meas. Soc. 20 (4): 34–44. https://doi.org/10.1109/MIM.2017.8006392.
Miao, F., and M. Ghosn. 2016. “Reliability-based progressive collapse analysis of highway bridges.” Struct. Saf. 63 (Nov): 33–46. https://doi.org/10.1016/j.strusafe.2016.05.004.
Michel, T., P. Genevès, H. Fourati, and N. Layaïda. 2018. “Attitude estimation for indoor navigation and augmented reality with smartphones.” Pervasive Mob. Comput. 46 (Jun): 96–121. https://doi.org/10.1016/j.pmcj.2018.03.004.
Neges, M., C. Koch, M. König, and M. Abramovici. 2017. “Combining visual natural markers and IMU for improved AR based indoor navigation.” Adv. Eng. Inf. 31 (Jan): 18–31. https://doi.org/10.1016/j.aei.2015.10.005.
Qiao, T. Z., L. L. Chen, Y. S. Pang, G. W. Yan, and C. Y. Miao. 2017a. “Integrative binocular vision detection method based on infrared and visible light fusion for conveyor belts longitudinal tear.” Measurement 110 (Nov): 192–201. https://doi.org/10.1016/j.measurement.2017.06.032.
Qiao, X., J. H. Bao, H. Zhang, J. Y. Dong, and H. Yu. 2017b. “Underwater image quality enhancement of sea cucumbers based on improved histogram equalization and wavelet transform.” Inf. Process. Agric. 4 (3): 206–213. https://doi.org/10.1016/j.inpa.2017.06.001.
Sun, L., J. C. Xing, and X. Zhang. 2018. “An algorithm for concrete crack extraction and identification based on machine vision.” IEEE Access 6 (Jun): 28993–29002. https://doi.org/10.1109/ACCESS.2018.2844100.
Sutter, B., A. Lelevéb, M. T. Pham, O. Gouin, N. Jupille, M. Kuhn, P. Lulé, P. Michaud, and P. Rémy. 2018. “A semi-autonomous mobile robot for bridge inspection.” Autom. Constr. 91 (Jul): 111–119. https://doi.org/10.1016/j.autcon.2018.02.013.
Tang, P. B., B. Akinci, and D. Huber. 2009. “Quantification of edge loss of laser scanned data at spatial discontinuities.” Autom. Constr. 18 (8): 1070–1083. https://doi.org/10.1016/j.autcon.2009.07.001.
Tsai, R. Y. 1987. “A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses.” IEEE J. Rob. Autom. 3 (4): 323–344. https://doi.org/10.1109/JRA.1987.1087109.
Wang, Q., M. K. Kim, C. P. Cheng, and H. Sohn. 2016. “Automated quality assessment of precast concrete elements with geometry irregularities using terrestrial laser scanning.” Autom. Constr. 68 (Aug): 170–182. https://doi.org/10.1016/j.autcon.2016.03.014.
Wang, Q. B., Y. J. Yin, W. Zou, and D. Xu. 2017. “Measurement error analysis of binocular stereo vision: Effective guidelines for bionic eyes.” IET Sci. Meas. Technol. 11 (7): 829–838. https://doi.org/10.1049/iet-smt.2016.0359.
Xiang, R., W. H. He, X. N. Zhang, D. Wang, and Y. K. Shan. 2018. “Size measurement based on a two-camera machine vision system for the bayonets of automobile brake pads.” Measurement 122 (Jul): 106–116. https://doi.org/10.1016/j.measurement.2018.03.017.
Xie, R. P., J. Yao, K. Liu, X. H. Lu, Y. H. Liu, M. H. Xia, and Q. F. Zeng. 2018. “Automatic multi-image stitching for concrete bridge inspection by combining point and line features.” Autom. Constr. 90 (Jun): 265–280. https://doi.org/10.1016/j.autcon.2018.02.021.
Xu, X. J., and X. N. Zhang. 2013. “Crack detection of reinforced concrete bridge using video image.” J. Cent. South Univ. 20 (9): 2605–2613. https://doi.org/10.1007/s11771-013-1775-5.
Xu, X. J., and X. N. Zhang. 2015. “Highway slope displacement identification method based on binocular vision.” China J. Highway Transp. 28 (4): 27–34.
Yang, L., B. Q. Wang, R. H. Zhang, H. B. Zhou, and R. B. Wang. 2018. “Analysis on location accuracy for the binocular stereo vision system.” IEEE Photonics J. 10 (1): 1–2. https://doi.org/10.1109/JPHOT.2017.2784958.
Ye, Q., J. F. Dong, and Y. M. Zhang. 2015. “3D human behavior recognition based on binocular vision and face–hand feature.” Opt. Int. J. Light Electron Optics 126 (23): 4712–4717. https://doi.org/10.1016/j.ijleo.2015.08.103.
Yin, Y. J., D. Xu, Z. T. Zhang, X. T. Wang, and W. T. Qu. 2013. “Plane measurement based on monocular vision.” J. Electron. Meas. Instrum. 27 (4): 347–352. https://doi.org/10.3724/SP.J.1187.2013.00347.
Zhang, S., T. Wang, J. Y. Dong, and H. Yu. 2017. “Underwater image enhancement via extended multi-scale Retinex.” Neurocomputing 245 (Jul): 1–9. https://doi.org/10.1016/j.neucom.2017.03.029.
Zhang, Z. G., and W. B. Tao. 2016. “Pedestrian detection in binocular stereo sequence based on appearance consistency.” IEEE Trans. Circuits Syst. Video Technol. 26 (9): 1772–1785. https://doi.org/10.1109/TCSVT.2015.2475855.
Zhang, Z. Y. 2000. “A flexible new technique for camera calibration.” IEEE Trans. Pattern Anal. Mach. Intell. 22 (11): 1330–1334. https://doi.org/10.1109/34.888718.
Zhou, Y., H. B. Luo, and Y. H. Yang. 2017. “Implementation of augmented reality for segment displacement inspection during tunneling construction.” Autom. Constr. 82 (Oct): 112–121. https://doi.org/10.1016/j.autcon.2017.02.007.
Information & Authors
Information
Published In
Journal of Performance of Constructed Facilities
Volume 34 • Issue 2 • April 2020
Copyright
©2020 American Society of Civil Engineers.
History
Received: Apr 29, 2019
Accepted: Aug 28, 2019
Published online: Jan 28, 2020
Published in print: Apr 1, 2020
Discussion open until: Jun 28, 2020
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.