Entropy-Based Automated Method for Detection and Assessment of Spalling Severities in Reinforced Concrete Bridges
Publication: Journal of Performance of Constructed Facilities
Volume 35, Issue 1
Abstract
Existing bridges are aging and deteriorating rapidly, elevating concerns for public safety and preservation of these valuable assets. Large numbers of bridges exist in transportation networks, and the current budget limitations worsen the situation. This necessitates the development of an automated condition assessment and rating methods. Spalling is a common problem that majorly influences the health, safety, and structural integrity of bridges. The present study introduces a self-adaptive three-tier method for the automated detection and assessment of spalling using computer-vision technologies. The first model introduces a newly-developed segmentation model that adopts a multiobjective invasive weed optimization and information theory-based formalism of images for spalled concrete detection. In the second model, an integration of singular value decomposition and discrete wavelet transform are integrated for the efficient feature extraction of information in images. Additionally, the Elman neural network is coupled with the invasive weed optimization algorithm to enhance the accuracy of the evaluation of spalling severities by amplifying the exploration-exploitation trade-off mechanism of the Elman neural network. The third model is developed for the purpose of structuring a rating system of spalling severity based on its area and depth. A computerized platform is developed using C#.net language to facilitate the implementation of the developed method by the users. The results demonstrated that the developed multiobjective spalling segmentation model is capable of improving detection accuracy of spalling by 12.29% with respect to the region growing algorithm. It was also inferred that the developed quantification model outperformed other prediction models, such that it achieved a mean absolute percentage error, root mean-squared error, and root mean squared percentage error of 4.07%, 76.061, and 0.065, respectively, based on the original dataset. In this regard, it is expected that the developed computer-vision-based method can aid in establishing cost-effective bridge condition assessment models by transportation agencies.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or code that support the findings of this study are available from the corresponding author upon request.
References
Adhikari, R. S., O. Moselhi, and A. Bagchi. 2014. “Automation in construction image-based retrieval of concrete crack properties for bridge inspection.” Autom. Constr. 39 (1): 180–194. https://doi.org/10.1016/j.autcon.2013.06.011.
Al-Allaf, O. N. A. 2011. “Fast back propagation neural network algorithm for reducing convergence time of BPNN image compression.” In Proc., Int. Conf. on Information Technology and Multimedia, 1–6. New York: IEEE.
Alhamdoosh, M., and D. Wang. 2014. “Fast decorrelated neural network ensembles with random weights.” Inf. Sci. 264 (Apr): 104–117. https://doi.org/10.1016/j.ins.2013.12.016.
Al Najada, H., I. Mahgoub, and I. Mohammed. 2019. “Cyber intrusion prediction and taxonomy system using deep learning and distributed big data processing.” In Proc., IEEE Symp. Series on Computational Intelligence, 631–638. New York: IEEE.
Bhandari, A. K., A. Kumar, and G. K. Singh. 2015. “Tsallis entropy based multilevel thresholding for colored satellite image segmentation using evolutionary algorithms.” Expert Syst. Appl. 42 (22): 8707–8730. https://doi.org/10.1016/j.eswa.2015.07.025.
Bhattacharjee, P. S., A. K. M. Fujail, and S. A. Begum. 2017. “A comparison of intrusion detection by K-means and fuzzy C-means clustering algorithm over the NSL-KDD dataset.” In Proc., IEEE Int. Conf. on Computational Intelligence and Computing Research, 1–6. New York: IEEE.
Bianchi, F. M., E. Maiorino, M. C. Kampffmeyer, A. Rizzi, and R. Jenssen. 2017. “An overview and comparative analysis of recurrent neural networks for short term load forecasting.” Preprint, submitted May 11, 2017. https://arxiv.org/abs/1705.04378.
Chakraborty, S., S. Chatterjee, N. Dey, A. S. Ashour, A. S. Ashour, and F. Shi. 2017. “Modified cuckoo search algorithm in microscopic image segmentation of hippocampus.” Microsc. Res. Tech. 80 (10): 1051–1072. https://doi.org/10.1002/jemt.22900.
Chang, C. C., and S. H. Chen. 2019. “Developing a novel machine learning-based classification scheme for predicting SPCs in breast cancer survivors.” Front. Genet. 10 (Sep): 1–6. https://doi.org/10.3389/fgene.2019.00848.
Dawood, T., Z. Zhu, and T. Zayed. 2017. “Machine vision-based model for spalling detection and quantification in subway networks.” Autom. Constr. 81 (Sep): 149–160. https://doi.org/10.1016/j.autcon.2017.06.008.
Demertzis, K., and L. Iliadis. 2020. “GeoAI: A model-agnostic meta-ensemble zero-shot learning method for hyperspectral image analysis and classification.” Algorithms 13 (3): 61. https://doi.org/10.3390/a13030061.
Dhillon, A., and G. K. Verma. 2019. “Convolutional neural network: A review of models, methodologies and applications to object detection.” Prog. Artif. Intell. 9 (2): 85–112. https://doi.org/10.1007/s13748-019-00203-0.
Di Biasi, M. R., G. E. Valencia, and L. G. Obregon. 2020. “A new educational thermodynamic software to promote critical thinking in youth engineering students.” Sustainability 12 (1): 1–17. https://doi.org/10.3390/su12010110.
Dorafshan, S., R. J. Thomas, C. Coopmans, and M. Maguire. 2018. “Deep learning neural networks for sUAS-assisted structural inspections: Feasibility and application.” In Proc., Int. Conf. on Unmanned Aircraft Systems, 1–9. New York: IEEE.
Dundar, M., Q. Kou, B. Zhang, Y. He, and B. Rajwa. 2015. “Simplicity of k-means versus deepness of deep learning: A case of unsupervised feature learning with limited data.” In Proc., IEEE 14th Int. Conf. on Machine Learning and Applications, 883–888. New York: IEEE.
Dung, C. V., H. Sekiya, S. Hirano, T. Okatani, and C. Miki. 2019. “A vision-based method for crack detection in gusset plate welded joints of steel bridges using deep convolutional neural networks.” Autom. Constr. 102 (Jun): 217–229. https://doi.org/10.1016/j.autcon.2019.02.013.
Felio, G. 2016. “Canadian infrastructure report card.” Accessed May 6, 2016. www.canadainfrastructure.ca/downloads/Canadian_Infrastructure_Report_2016.pdf.
García-Alfonso, H., and D.-M. Córdova-Esparza. 2018. “Comparison of uncertainty analysis of the Monte Carlo and Latin hypercube algorithms in a camera calibration model.” In Proc., IEEE 2nd Colombian Conf. on Robotics and Automation, 1–5. New York: IEEE.
Gupta, A., and A. Kumar. 2016. “ATC calculation including wind: A probabilistic study and a comparison of MCS and LHS.” In Proc., IEEE 6th Int. Conf. on Power Systems, 1–6. New York: IEEE.
Hasan, M., and M. R. El-Sakka. 2015. “Structural similarity optimized wiener filter: A way to fight image noise.” In Proc., Int. Conf. Image Analysis and Recognition, 60–68. Berlin: Springer.
Hoang, N. 2018. “Detection of surface crack in building structures using image processing technique with an improved Otsu method for image thresholding.” Adv. Civ. Eng. 2018 (1): 10. https://doi.org/10.1155/2018/3924120.
Hooda, H., O. P. Verma, and T. Singhal. 2015. “Brain tumor segmentation: A performance analysis using k-means, fuzzy c-means and region growing algorithm.” In Proc., 2014 IEEE Int. Conf. on Advanced Communication, Control and Computing Technologies, 1621–1626. New York: IEEE.
Jain, S., E. Kotsampasakou, and G. F. Ecker. 2018. “Comparing the performance of meta-classifiers: A case study on selected imbalanced data sets relevant for prediction of liver toxicity.” J. Comput.-Aided Mol. Des. 32 (5): 583–590. https://doi.org/10.1007/s10822-018-0116-z.
Jáuregui, D. V., Y. Tian, and R. Jiang. 2006. “Photogrammetry applications in routine bridge inspection and historic bridge documentation.” Transp. Res. Rec. 1958 (1): 24–32. https://doi.org/10.1177/0361198106195800103.
Jha, R. K., and R. Chouhan. 2014. “Noise-induced contrast enhancement using stochastic resonance on singular values.” Signal Image Video Process. 8 (2): 339–347. https://doi.org/10.1007/s11760-012-0296-2.
Jia, Y., E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. 2014. “Caffe: Convolutional architecture for fast feature embedding.” In Proc., 22nd ACM Int. Conf. on Multimedia, 675–678, New York: Association for Computing Machinery.
Jiao, Y., and P. Du. 2016. “Performance measures in evaluating machine learning based bioinformatics predictors for classifications.” Quant. Biol. 4 (4): 320–330. https://doi.org/10.1007/s40484-016-0081-2.
Khairuzzaman, A. K., and S. Chaudhury. 2017. “Multilevel thresholding using grey wolf optimizer for image segmentation.” Expert Syst. Appl. 86 (Nov): 64–76. https://doi.org/10.1016/j.eswa.2017.04.029.
Kim, I.-H., H. Jeon, S.-C. Baek, W.-H. Hong, and H.-J. Jung. 2018. “Application of crack identification techniques for an unmanned aerial vehicle.” Sensors 18 (6): C1–C1. https://doi.org/10.1109/JSEN.2018.2792888.
Koch, C., K. Georgieva, V. Kasireddy, B. Akinci, and P. Fieguth. 2015. “A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure.” Adv. Eng. Inf. 29 (2): 196–210. https://doi.org/10.1016/j.aei.2015.01.008.
Köker, R. 2013. “A genetic algorithm approach to a neural-network-based inverse kinematics solution of robotic manipulators based on error minimization.” Inf. Control 222 (Feb): 528–543. https://doi.org/10.1016/j.ins.2012.07.051.
Krizhevsky, A., I. Sutskever, and G. E. Hinton. 2012. “ImageNet classification with deep convolutional neural networks.” In Proc., Advances in Neural Information Processing Systems, 1097–1105. Cambridge, MA: MIT Press.
Kumar, A., P. Rastogi, and P. Srivastava. 2015. “Design and FPGA implementation of DWT, image text extraction technique.” Procedia Comput. Sci. 57 (1): 1015–1025. https://doi.org/10.1016/j.procs.2015.07.512.
Kurach, K., and K. Pawlowski. 2016. “Predicting dangerous seismic activity with recurrent neural networks.” In Proc., Federated Conf. on Computer Science, 239–243. New York: IEEE.
Lee, J. H., S. S. Jin, I. H. Kim, and H. J. Jung. 2017. “Development of crack diagnosis and quantification algorithm based on the 2D images acquired by unmanned aerial vehicle (UAV).” In Proc., 2017 Congress on Advances in Structural Engineering and Mechanics. Daejeon, South Korea: International Association of Structural Engineering and Mechanics.
Lee, J. H., J. M. Lee, H. J. Kim, and Y. S. Moon. 2008. “Machine vision system for automatic inspection of bridges.” In Proc., Congress on Image and Signal Processing, 363–366. New York: IEEE.
Li, Y., X. Fan, and G. Li. 2006. “Image segmentation based on Tsallis-entropy and Renyi-entropy and their comparison.” In Proc., 4th IEEE Int. Conf. on Industrial Informatics, 943–948. New York: IEEE.
Lv, Z. Y., P. Zhang, J. A. Benediktsson, and W. Z. Shi. 2014. “Morphological profiles based on differently shaped structuring elements for classification of images with very high spatial resolution.” IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 7 (12): 4644–4652. https://doi.org/10.1109/JSTARS.2014.2328618.
Malonia, M., and S. Agarwal. 2016. “Digital image watermarking using discrete wavelet transform and arithmetic progression technique.” In Proc., IEEE Students’ Conf. on Electrical, Electronics and Computer Science Digital, 1–6. New York: IEEE.
Mehrabian, A. R., and C. Lucas. 2006. “A novel numerical optimization algorithm inspired from weed colonization.” Ecol. Inf. 1 (4): 355–366. https://doi.org/10.1016/j.ecoinf.2006.07.003.
Mishra, S., and M. Panda. 2018. “Bat algorithm for multilevel color image segmentation using entropy-based thresholding.” Arabian J. Sci. Eng. 43 (12): 7285–7314. https://doi.org/10.1007/s13369-017-3017-x.
Mohammed Abdelkader, E., O. Moselhi, M. Marzouk, and T. Zayed. 2019. “A multi-objective invasive weed optimization method for segmentation of distress images.” Intell. Autom. Soft Comput. 26 (4): 1–20. https://doi.org/10.32604/iasc.2020.010100.
Mohammed Abdelkader, E., O. Moselhi, M. Marzouk, and T. Zayed. 2020. “Hybrid Elman neural network and invasive weed optimization method for bridge defects recognition.” Transp. Res. Rec. 1–33. https://doi.org/10.1177/0361198120967943.
Nagarajan, B., and V. Devendran. 2012. “Singular value decomposition based features for vehicle classification under cluttered background and mild occlusion.” Procedia Eng. 30 (1): 529–534. https://doi.org/10.1016/j.proeng.2012.01.894.
National Research Council Canada. 2013. “Critical concrete infrastructure: Extending the life of Canada’s bridge network.” Accessed December 20, 2016. http://www.nrc-cnrc.gc.ca/ci-ic/article/v18n1-5.
Otsu, N. 1979. “A threshold selection method from gray-level histograms.” IEEE Trans. Syst. Man Cybern. 9 (1): 62–66.
Pal, S., and S. Chatterjee. 2018. “Mathematical morphology aided optic disk segmentation from retinal images.” In Proc., 3rd Int. Conf. on Condition Assessment Techniques in Electrical Systems, 380–385. New York: IEEE.
Razmjooy, N., and M. Khalilpour. 2015. “A new design for PID controller by considering the operating points changes in hydro-turbine connected to the equivalent network by using invasive weed optimization (IWO) algorithm.” Int. J. Inf. Secur. Syst. Manage. 4 (2): 468–475.
Reddy, B. S. K., and S. Wanjari. 2018. “Core strength of concrete using newly developed in situ compressive testing machine.” Mag. Concr. Res. 70 (22): 1149–1156. https://doi.org/10.1680/jmacr.17.00315.
Ryerkerk, M. L., R. C. Averill, K. Deb, and E. D. Goodman. 2016. “Solving metameric variable-length optimization problems using genetic algorithms.” Genet. Program. Evolvable Mach. 18 (2): 247–277. https://doi.org/10.1007/s10710-016-9282-8.
Samsuri, S., M. Surbakti, A. P. Tarigan, and R. Anas. 2019. “A study on the road conditions assessment obtained from international roughness index (IRI): Roughometer versus Hawkeye.” Simetrikal J. Eng. Technol. 1 (2): 103–113. https://doi.org/10.32734/jet.v1i2.756.
Sennah, K., B. Juette, C. Witt, and P. M. Combar. 2011. “Vehicle crash testing on a GFRP-reinforced PL-3 concrete bridge barrier.” In Proc., 4th Int. Conf. on Durability and Sustainability of Fibre Reinforced Polymer Composites for Construction and Rehabilitation, 1–8. Ottawa: Transportation Association of Canada.
Shanavaz, K. T., and P. Mythili. 2016. “A fingerprint-based hybrid gender classification system using genetic algorithm.” Int. J. Comput. Vision Rob. 6 (4): 399–413. https://doi.org/10.1504/IJCVR.2016.079400.
Shang, X., X. Li, A. Morales-esteban, and G. Chen. 2017. “Improving microseismic event and quarry blast classification using artificial neural networks based on principal component analysis.” Soil Dyn. Earthquake Eng. 99 (Aug): 142–149. https://doi.org/10.1016/j.soildyn.2017.05.008.
Simonyan, K., and A. Zisserman. 2015. “Very deep convolutional networks for large-scale image recognition.” In Proc., 3rd Int. Conf. on Learning Representations, 1–14. New York: IBM.
Stamate, C., G. D. Magoulas, and M. S. C. Thomas. 2015. “Transfer learning approach for financial applications.” Preprint, submitted September 9, 2015. https://arxiv.org/abs/1509.02807.
Su, T. 2013. “Application of computer vision to crack detection of concrete structure.” Int. J. Eng. Technol. 5 (4): 457–461. https://doi.org/10.7763/IJET.2014.V5.596.
Tao, W., D. Tao, Z. Xiaohong, and S. Yiming. 2014. “A research on detecting and recognizing bridge cracks in complex underwater conditions.” Frattura Integrità Strutturale 8 (30): 537–544. https://doi.org/10.3221/IGF-ESIS.30.64.
Uyar, K., and E. Ülker. 2017. “B-spline curve fitting with invasive weed optimization.” Appl. Math. Modell. 52 (Dec): 320–340. https://doi.org/10.1016/j.apm.2017.07.047.
Wang, J., W. Zhang, Y. Li, J. Wang, and Z. Dang. 2014. “Forecasting wind speed using empirical mode decomposition and Elman neural network.” Appl. Soft Comput. 23 (10): 452–459.
Xu, H., X. Su, Y. Wang, H. Cai, K. Cui, and X. Chen. 2019. “Automatic bridge crack detection using a convolutional neural network.” Appl. Sci. 9 (14): 1–14. https://doi.org/10.3390/app9142867.
Xue-jun, X. U., and Z. Xiao-ning. 2013. “Crack detection of reinforced concrete bridge using video image.” J. Central South Univ. 20 (9): 2605–2613. https://doi.org/10.1007/s11771-013-1775-5.
Yang, Q., W. Shi, J. Chen, and W. Lin. 2020. “Deep convolution neural network-based transfer learning method for civil infrastructure crack detection.” Autom. Constr. 116 (Aug): 103199. https://doi.org/10.1016/j.autcon.2020.103199.
Yu, F., and X. Xu. 2014. “A short-term load forecasting model of natural gas based on optimized genetic algorithm and improved BP neural network.” Appl. Energy 134 (Dec): 102–113. https://doi.org/10.1016/j.apenergy.2014.07.104.
Zhang, L., W. Luo, and Y. Xu. 2018. “Bridge crack image segmentation based on improved watershed algorithm.” In Proc., 2018 Chinese Control and Decision Conf., 3537–3541. New York: IEEE.
Information & Authors
Information
Published In
Journal of Performance of Constructed Facilities
Volume 35 • Issue 1 • February 2021
Copyright
© 2020 American Society of Civil Engineers.
History
Received: Nov 20, 2019
Accepted: Aug 26, 2020
Published online: Nov 9, 2020
Published in print: Feb 1, 2021
Discussion open until: Apr 9, 2021
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.