Continuous Health Assessment of Bridges under Sudden Environmental Variability by Local Unsupervised Learning
Publication: Journal of Performance of Constructed Facilities
Volume 38, Issue 5
Abstract
Continuous health monitoring of civil engineering structures is an important process for ensuring their safety. However, sudden environmental variability makes this process erroneous and unreliable. To address this challenge, we propose a novel unsupervised learning method based on double data clustering. The central core of this method is to perform a data segmentation/clustering process in two levels by using a new clustering technique called local density peak clustering under minimum spanning tree (LDPC-MST). The main goal is to extract the most relevant information insensitive to environmental variations. In the first level of the double clustering algorithm, the LDPC-MST divides all available data points into main clusters. Subsequently, this approach is implemented to find subclusters within each main cluster and attempt to select one of them as the representative set, which contains the most relevant features. Using the representative subclusters of all main clusters, a damage detection indicator based on the Mahalanobis-squared distance is defined to detect any abnormal change caused by damage. The main innovation of this research is to develop a novel locally unsupervised learning method by using the process of double clustering and LDPC-MST. To validate this method, the natural frequencies of a concrete box-girder bridge and a steel arch bridge under strong environmental variations are incorporated. Several comparative analyses are also performed to indicate the superiority of this method over some well-known techniques. Results show that the proposed method can effectively warn the occurrence of damage with smaller rates of false positive, false negative, and total errors in comparison with state-of-the-art techniques.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or code that support the findings of this study are available from the corresponding author upon reasonable request.
References
Avci, O., and O. Abdeljaber. 2016. “Self-organizing maps for structural damage detection: A novel unsupervised vibration-based algorithm.” J. Perform. Constr. Facil. 30 (3): 04015043. https://doi.org/10.1061/(ASCE)CF.1943-5509.0000801.
Avci, O., O. Abdeljaber, S. Kiranyaz, M. Hussein, M. Gabbouj, and D. J. Inman. 2021. “A review of vibration-based damage detection in civil structures: From traditional methods to machine learning and deep learning applications.” Mech. Syst. Signal Process. 147 (Jan): 107077. https://doi.org/10.1016/j.ymssp.2020.107077.
Bagchi, A., J. Humar, H. Xu, and A. S. Noman. 2010. “Model-based damage identification in a continuous bridge using vibration data.” J. Perform. Constr. Facil. 24 (2): 148–158. https://doi.org/10.1061/(ASCE)CF.1943-5509.0000071.
Chen, T.-T. 2017. “Factors in bridge failure, inspection, and maintenance.” J. Perform. Constr. Facil. 31 (5): 04017070. https://doi.org/10.1061/(ASCE)CF.1943-5509.0001042.
Chen, Z.-H., X.-W. Liu, G.-D. Zhou, H. Liu, and Y.-X. Fu. 2021. “Damage detection for expansion joints of a combined highway and railway bridge based on long-term monitoring data.” J. Perform. Constr. Facil. 35 (4): 04021037. https://doi.org/10.1061/(ASCE)CF.1943-5509.0001608.
Cheng, D., Q. Zhu, J. Huang, Q. Wu, and L. Yang. 2021. “Clustering with local density peaks-based minimum spanning tree.” IEEE Trans. Knowl. Data Eng. 33 (2): 374–387. https://doi.org/10.1109/TKDE.2019.2930056.
Daneshvar, M. H., and H. Sarmadi. 2022. “Unsupervised learning-based damage assessment of full-scale civil structures under long-term and short-term monitoring.” Eng. Struct. 256 (Apr): 114059. https://doi.org/10.1016/j.engstruct.2022.114059.
Daneshvar, M. H., H. Sarmadi, and K.-V. Yuen. 2023. “A locally unsupervised hybrid learning method for removing environmental effects under different measurement periods.” Measurement 208 (Feb): 112465. https://doi.org/10.1016/j.measurement.2023.112465.
Deng, L., W. Wang, and Y. Yu. 2016. “State-of-the-art review on the causes and mechanisms of bridge collapse.” J. Perform. Constr. Facil. 30 (2): 04015005. https://doi.org/10.1061/(ASCE)CF.1943-5509.0000731.
Deraemaeker, A., and K. Worden. 2018. “A comparison of linear approaches to filter out environmental effects in structural health monitoring.” Mech. Syst. Signal Process. 105 (May): 1–15. https://doi.org/10.1016/j.ymssp.2017.11.045.
Entezami, A., H. Sarmadi, and B. Behkamal. 2023a. “Long-term health monitoring of concrete and steel bridges under large and missing data by unsupervised meta learning.” Eng. Struct. 279 (Mar): 115616. https://doi.org/10.1016/j.engstruct.2023.115616.
Entezami, A., H. Sarmadi, and B. Behkamal. 2023b. “A novel double-hybrid learning method for modal frequency-based damage assessment of bridge structures under different environmental variation patterns.” Mech. Syst. Signal Process. 201 (Oct): 110676. https://doi.org/10.1016/j.ymssp.2023.110676.
Entezami, A., H. Sarmadi, and B. Behkamal. 2024. “Short-term damage alarming with limited vibration data in bridge structures: A fully non-parametric machine learning technique.” Measurement 235 (May): 114935. https://doi.org/10.1016/j.measurement.2024.114935.
Entezami, A., H. Sarmadi, B. Behkamal, and C. De Michele. 2023c. “On continuous health monitoring of bridges under serious environmental variability by an innovative multi-task unsupervised learning method.” Struct. Infrastruct. Eng. 1–19. https://doi.org/10.1080/15732479.2023.2166538.
Entezami, A., H. Shariatmadar, and C. De Michele. 2022. “Non-parametric empirical machine learning for short-term and long-term structural health monitoring.” Struct. Health Monit. 21 (6): 2700–2718. https://doi.org/10.1177/14759217211069842.
Huang, J.-Z., S.-J. Yuan, D.-S. Li, and H.-N. Li. 2023. “A kernel canonical correlation analysis approach for removing environmental and operational variations for structural damage identification.” J. Sound Vib. 548 (Mar): 117516. https://doi.org/10.1016/j.jsv.2022.117516.
Jin, C., S. Jang, X. Sun, J. Li, and R. Christenson. 2016. “Damage detection of a highway bridge under severe temperature changes using extended Kalman filter trained neural network.” J. Civ. Struct. Health Monit. 6 (3): 545–560. https://doi.org/10.1007/s13349-016-0173-8.
Jo, T. 2021. Machine learning foundations: Supervised, unsupervised, and advanced learning. Berlin: Springer.
Ma, K.-C., T.-H. Yi, D.-H. Yang, H.-N. Li, and H. Liu. 2021. “Nonlinear uncertainty modeling between bridge frequencies and multiple environmental factors based on monitoring data.” J. Perform. Constr. Facil. 35 (5): 04021056. https://doi.org/10.1061/(ASCE)CF.1943-5509.0001636.
Maes, K., L. Van Meerbeeck, E. P. B. Reynders, and G. Lombaert. 2022. “Validation of vibration-based structural health monitoring on retrofitted railway bridge KW51.” Mech. Syst. Signal Process. 165 (7): 108380. https://doi.org/10.1016/j.ymssp.2021.108380.
Mario Azzara, R., G. De Roeck, M. Girardi, C. Padovani, D. Pellegrini, and E. Reynders. 2018. “The influence of environmental parameters on the dynamic behaviour of the San Frediano bell tower in Lucca.” Eng. Struct. 156 (Feb): 175–187. https://doi.org/10.1016/j.engstruct.2017.10.045.
Noman, A. S., F. Deeba, and A. Bagchi. 2013. “Health monitoring of structures using statistical pattern recognition techniques.” J. Perform. Constr. Facil. 27 (5): 575–584. https://doi.org/10.1061/(ASCE)CF.1943-5509.0000346.
Peeters, B., and G. De Roeck. 2001. “One-year monitoring of the Z24-Bridge: Environmental effects versus damage events.” Earthquake Eng. Struct. Dyn. 30 (2): 149–171. https://doi.org/10.1002/1096-9845(200102)30:2%3C149::AID-EQE1%3E3.0.CO;2-Z.
Qiu, L., F. Fang, S. Yuan, C. Boller, and Y. Ren. 2019. “An enhanced dynamic Gaussian mixture model-based damage monitoring method of aircraft structures under environmental and operational conditions.” Struct. Health Monit. 18 (2): 524–545. https://doi.org/10.1177/1475921718759344.
Reynders, E., and G. De Roeck. 2009. “Encyclopedia of structural health monitoring.” In Continuous vibration monitoring and progressive damage testing on the Z24 bridge. Chichester, UK: Wiley.
Roberts, C., D. G. Cava, and L. D. Avendaño-Valencia. 2022. “Addressing practicalities in multivariate nonlinear regression for mitigating environmental and operational variations.” Struct. Health Monit. 22 (2): 1237–1255. https://doi.org/10.1177/14759217221091907.
Santos, A., E. Figueiredo, M. Silva, R. Santos, C. Sales, and J. C. W. A. Costa. 2017. “Genetic-based EM algorithm to improve the robustness of Gaussian mixture models for damage detection in bridges.” Struct. Control Health Monit. 24 (3): e1886. https://doi.org/10.1002/stc.1886.
Sarmadi, H. 2021. “Investigation of machine learning methods for structural safety assessment under variability in data: Comparative studies and new approaches.” J. Perform. Constr. Facil. 35 (6): 04021090. https://doi.org/10.1061/(ASCE)CF.1943-5509.0001664.
Sarmadi, H., and A. Entezami. 2021. “Application of supervised learning to validation of damage detection.” Arch. Appl. Mech. 91 (1): 393–410. https://doi.org/10.1007/s00419-020-01779-z.
Sarmadi, H., A. Entezami, B. Behkamal, and C. De Michele. 2022. “Partially online damage detection using long-term modal data under severe environmental effects by unsupervised feature selection and local metric learning.” J. Civ. Struct. Health Monit. 12 (5): 1043–1066. https://doi.org/10.1007/s13349-022-00596-y.
Sarmadi, H., A. Entezami, and C. De Michele. 2023a. “Probabilistic data self-clustering based on semi-parametric extreme value theory for structural health monitoring.” Mech. Syst. Signal Process. 187 (Mar): 109976. https://doi.org/10.1016/j.ymssp.2022.109976.
Sarmadi, H., A. Entezami, and F. Magalhães. 2023b. “Unsupervised data normalization for continuous dynamic monitoring by an innovative hybrid feature weighting-selection algorithm and natural nearest neighbor searching.” Struct. Health Monit. 22 (6): 4005–4026. https://doi.org/10.1177/14759217231166116.
Sarmadi, H., A. Entezami, B. Saeedi Razavi, and K.-V. Yuen. 2021. “Ensemble learning-based structural health monitoring by Mahalanobis distance metrics.” Struct. Control Health Monit. 28 (2): e2663. https://doi.org/10.1002/stc.2663.
Sarmadi, H., A. Entezami, K.-V. Yuen, and B. Behkamal. 2023c. “Review on smartphone sensing technology for structural health monitoring.” Measurement 223 (Dec): 113716. https://doi.org/10.1016/j.measurement.2023.113716.
Sarmadi, H., and K.-V. Yuen. 2021. “Early damage detection by an innovative unsupervised learning method based on kernel null space and peak-over-threshold.” Comput.-Aided Civ. Infrastruct. Eng. 36 (9): 1150–1167. https://doi.org/10.1111/mice.12635.
Sarmadi, H., and K.-V. Yuen. 2022. “Structural health monitoring by a novel probabilistic machine learning method based on extreme value theory and mixture quantile modeling.” Mech. Syst. Signal Process. 173 (Jul): 109049. https://doi.org/10.1016/j.ymssp.2022.109049.
Seo, J., J. W. Hu, and J. Lee. 2016. “Summary review of structural health monitoring applications for highway bridges.” J. Perform. Constr. Facil. 30 (4): 04015072. https://doi.org/10.1061/(ASCE)CF.1943-5509.0000824.
Soo Lon Wah, W., J. S. Owen, Y.-T. Chen, A. Elamin, and G. W. Roberts. 2019. “Removal of masking effect for damage detection of structures.” Eng. Struct. 183 (Mar): 646–661. https://doi.org/10.1016/j.engstruct.2019.01.005.
Sousa Tomé, E., M. Pimentel, and J. Figueiras. 2020. “Damage detection under environmental and operational effects using cointegration analysis—Application to experimental data from a cable-stayed bridge.” Mech. Syst. Signal Process. 135 (Jun): 106386. https://doi.org/10.1016/j.ymssp.2019.106386.
Tibshirani, R., G. Walther, and T. Hastie. 2001. “Estimating the number of clusters in a data set via the gap statistic.” J. R. Stat. Soc. Ser. B 63 (2): 411–423. https://doi.org/10.1111/1467-9868.00293.
Wang, M. L., J. P. Lynch, and H. Sohn. 2014. Sensor technologies for civil infrastructures: Applications in structural health monitoring. Cambridge, UK: Woodhead.
Wang, Z., D.-H. Yang, T.-H. Yi, G.-H. Zhang, and J.-G. Han. 2022. “Eliminating environmental and operational effects on structural modal frequency: A comprehensive review.” Struct. Control Health Monit. 29 (11): e3073. https://doi.org/10.1002/stc.3073.
Wang, Z., T.-H. Yi, D.-H. Yang, P. Zhou, and L. Sun. 2023. “Early warning method of structural damage using localized frequency cointegration under changing environments.” J. Struct. Eng. 149 (2): 04022230. https://doi.org/10.1061/(ASCE)ST.1943-541X.0003480.
Yan, A.-M., G. Kerschen, P. De Boe, and J.-C. Golinval. 2005. “Structural damage diagnosis under varying environmental conditions—Part II: Local PCA for non-linear cases.” Mech. Syst. Signal Process. 19 (4): 865–880. https://doi.org/10.1016/j.ymssp.2004.12.003.
Yang, L., and A. Shami. 2020. “On hyperparameter optimization of machine learning algorithms: Theory and practice.” Neurocomputing 415 (Aug): 295–316. https://doi.org/10.1016/j.neucom.2020.07.061.
Yang, X.-M., T.-H. Yi, C.-X. Qu, H.-N. Li, and H. Liu. 2021. “Performance assessment of a high-speed railway bridge through operational modal analysis.” J. Perform. Constr. Facil. 35 (6): 04021091. https://doi.org/10.1061/(ASCE)CF.1943-5509.0001669.
Zhang, Y.-M., H. Wang, Y. Bai, J.-X. Mao, X.-Y. Chang, and L.-B. Wang. 2021. “Switching Bayesian dynamic linear model for condition assessment of bridge expansion joints using structural health monitoring data.” Mech. Syst. Signal Process. 160 (Apr): 107879. https://doi.org/10.1016/j.ymssp.2021.107879.
Zhang, Y.-M., H. Wang, Y. Bai, J.-X. Mao, and Y.-C. Xu. 2022. “Bayesian dynamic regression for reconstructing missing data in structural health monitoring.” Struct. Health Monit. 21 (5): 2097–2115. https://doi.org/10.1177/14759217211053779.
Zhu, J., and Y. Wang. 2021. “Feature selection and deep learning for deterioration prediction of the bridges.” J. Perform. Constr. Facil. 35 (6): 04021078. https://doi.org/10.1061/(ASCE)CF.1943-5509.0001653.
Zhu, Q., J. Feng, and J. Huang. 2016. “Natural neighbor: A self-adaptive neighborhood method without parameter K.” Pattern Recognit. Lett. 80 (Sep): 30–36. https://doi.org/10.1016/j.patrec.2016.05.007.
Information & Authors
Information
Published In
Copyright
© 2024 American Society of Civil Engineers.
History
Received: Aug 21, 2022
Accepted: Apr 25, 2024
Published online: Jul 19, 2024
Published in print: Oct 1, 2024
Discussion open until: Dec 19, 2024
ASCE Technical Topics:
- Arch bridges
- Bridge engineering
- Bridges
- Bridges (by material)
- Bridges (by type)
- Comparative studies
- Concrete bridges
- Design (by type)
- Engineering fundamentals
- Girder bridges
- Methodology (by type)
- Research methods (by type)
- Steel bridges
- Structural design
- Structural engineering
- Structural health monitoring
- Structural safety
- Wood bridges
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.