Alternative Sequence Classification of Neural Networks for Bridge Deck Condition Rating
Publication: Journal of Performance of Constructed Facilities
Volume 37, Issue 4
Abstract
With the rapid deterioration of infrastructure, accurate predictions of bridge deck performance is critical in bridge management systems (BMS). The US Federal Highway Administration (FHWA) has developed the National Bridge Inventory (NBI) database, which has accumulated a vast repository of bridge performance data in the US. Although alternative methods have been used for harvesting such data, the use of machine learning (ML) has been explored to a lesser degree due to its modeling complexity. Objective of this study was to develop and assess alternative sequential models by employing long short-term memory (LSTM) and convolutional neural networks (CNN). The advantage of such modeling alternatives in relation to past ML studies is that consider (1) fixed or variable number of sequences of observations combined with (2) continuous or flexible sequences, producing better condition rating predictions. The results indicated that the models exceeded accuracy prediction from the mid 80% in past studies to levels of 95% for Maryland bridges, and all the way to 97% when Massachusetts data were added. Such results indicate that the proposed models are able to better capture the complex relationships between bridge-related features and condition rating. Transferability of the proposed approach was confirmed with the successful model response when data from the second state were used. It is expected that improved predictions of condition rating will promote more effective maintenance and rehabilitation strategies in BMS.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or code generated or used during the study are available in a repository online in accordance with funder data retention policies (https://www.fhwa.dot.gov/bridge/nbi/ascii.cfm).
Acknowledgments
This research was supported by the Maryland Transportation Institute (MTI).
References
ASCE. 2021. “2021 report card for America’s infrastructure.” Accessed January 30, 2021. https://www.infrastructurereportcard.org/wp-content/uploads/2020/12/2021-IRC-Executive-Summary.pdf.
Assaad, R., and I. H. El-adaway. 2020. “Bridge infrastructure asset management system: Comparative computational machine learning approach for evaluating and predicting deck deterioration conditions.” J. Infrastruct. Syst. 26 (3): 04020032. https://doi.org/10.1061/(ASCE)IS.1943-555X.0000572.
Bai, S., J. Z. Kolter, and V. Koltun. 2018. An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. Ithaca, NY: Cornell Univ.
Bishop, C. M. 2006. Pattern recognition and machine learning. New York: Springer.
Brownlee, J. 2021. “A gentle introduction to ensemble learning algorithms.” Accessed July 27, 2022. https://machinelearningmastery.com/category/ensemble-learning/.
Chou, J. S., C. F. Tsai, A. D. Pham, and Y. H. Lu. 2014. “Machine learning in concrete strength simulations: Multi-nation data analytics.” Constr. Build. Mater. 73 (9): 771–780. https://doi.org/10.1016/j.conbuildmat.2014.09.054.
Din, Z. U., and P. Tang. 2016. “Automatic logical inconsistency detection in the national bridge inventory.” Procedia Eng. 145 (4): 729–737. https://doi.org/10.1016/j.proeng.2016.04.093.
FHWA (Federal Highway Administration). 1995. Recording and coding guide for the structure inventory and appraisal of the nation’s bridges. Washington, DC: FHWA.
FHWA (Federal Highway Administration). 2020. “Datasets between 1983 and 2019, National bridge inventory.” Accessed March 30, 2021. https://www.fhwa.dot.gov/bridge/nbi/ascii.cfm.
FHWA (Federal Highway Administration). 2021. “Bipartisan infrastructure law.” Accessed January 30, 2022. https://www.fhwa.dot.gov/bipartisan-infrastructure-law/.
Fiocco, M. 1998. US freight economy in motion. Washington, DC: Federal Highway Administration.
Gagarin, N., D. Goulias, J. Mekemson, R. Cutts, and J. Andrews. 2020. “Development of a novel methodology for assessing bridge deck conditions using step frequency antenna array ground penetrating radar.” J. Perform. Constr. Facil. 34 (1): 04019113. https://doi.org/10.1061/(ASCE)CF.1943-5509.0001365.
Gagarin, N., J. R. Mekemson, and D. Goulias. 2017. “Second-generation analysis approach for condition assessment of transportation infrastructure using step-frequency (SF) ground-penetrating-radar (GPR) array system.” In Proc., 10th Int. Conf. on the Bearing Capacity of Roads, Railways and Airfields (BCRRA 2017). London: CRC Press.
Gao, C., and H. Elzarka. 2021. “The use of decision tree based predictive models for improving the culvert inspection process.” Adv. Eng. Inf. 47 (Jan): 101203. https://doi.org/10.1016/j.aei.2020.101203.
Gopalakrishnan, K., S. K. Khaitan, A. Choudhary, and A. Agrawal. 2017. “Deep convolutional neural networks with transfer learning for computer vision-based data-driven pavement distress detection.” Constr. Build. Mater. 157 (Sep): 322–330. https://doi.org/10.1016/j.conbuildmat.2017.09.110.
Goulias, D. 2020. Optimizing field data collection & developing advanced ground penetration radar (GPR) processing modules, Phase 3. Hanover, MD: Maryland State Highway Administration.
Goulias, D., S. Cafiso, A. Di Graziano, S. Saremi, and V. Currao. 2020. “Condition assessment of bridge decks through ground penetration radar in bridge management systems.” J. Perform. Constr. Facil. 34 (5): 04020100. https://doi.org/10.1061/(ASCE)CF.1943-5509.0001507.
Goulias, D., N. Gagarin, and J. Mekemson. 2016. “Deployment of step-frequency (SF) ground-penetrating-radar (GPR) array system for condition assessment of bridge decks.” In Proc., NDE/NDT for Highways and Bridges: Structural Materials Technology (SMT). Athens, Greece: Athens Institute for Education and Research.
Goulias, D., and S. Saremi. 2021. “Incorporating NDT in quality assurance of concrete and performance prediction of bridge decks with machine learning.” In Proc., ATINER 11th Annual Conf. on Civil Engineering. Athens, Greece: Athens Institute for Education and Research.
Guerdan, L. 2019. “Diving into temporal convolutional networks.” Accessed July 24, 2022. https://lukeguerdan.com/blog/2019/intro-to-tcns/#:∼:text=Temporal%20Convolutional%20Networks%20A%20TCN%20describes%20a%20general,1D%20convolutional%20layers%20are%20stacked%20on%20one%20another.
Hong, S., and H. S. Lynn. 2020. “Accuracy of random-forest-based imputation of missing data in the presence of non-normality, non-linearity, and interaction.” BMC Med. Res. Methodol. 20 (Apr): 199. https://doi.org/10.1186/s12874-020-01080-1.
Huang, Y. H. 2010. “Artificial neural network model of bridge deterioration.” J. Perform. Constr. Facil. 24 (6): 597–602. https://doi.org/10.1061/(ASCE)CF.1943-5509.0000124.
Hunt, L. A. 2017. “Missing data imputation and its effect on the accuracy of classification.” In Data science, 3–14. Berlin: Springer.
Jafari-Asl, J., M. Ben Seghier, S. Ohadi, Y. Dong, and V. A. Plevris. 2021. “Comparative study on the efficiency of reliability methods for the probabilistic analysis of local scour at a bridge pier in clay-sand-mixed sediments.” Modelling 2 (Jun): 63–77. https://doi.org/10.3390/modelling2010004.
Jurafsky, D., and J. H. Martin. 2009. Speech and language processing: An introduction to natural language processing, computational linguistics, and speech recognition. 2nd ed. Upper Saddle River, NJ: Prentice Hall.
Khalef, R., and I. H. El-adaway. 2021. “Automated identification of substantial changes in construction projects of airport improvement program: Machine learning and natural language processing comparative analysis.” J. Manage. Eng. 37 (6): 04021062. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000959.
Kingma, D. P., and J. Ba. 2014. ADAM: A method for stochastic optimization. Ithaca, NY: Cornell Univ. https://doi.org/10.48550/arXiv.1412.6980.
Li, S., and X. Zhao. 2019. “Image-based concrete crack detection using convolutional neural network and exhaustive search technique.” Adv. Civ. Eng. 2019 (Apr): 6520620. https://doi.org/10.1155/2019/6520620.
Li, X., L. Peng, X. Yao, S. Cui, Y. Hu, C. You, and T. Chi. 2017. “Long short-term memory neural network for air pollutant concentration predictions: Method development & evaluation.” Environ. Pollut. 231 (36): 997–1004. https://doi.org/10.1016/j.envpol.2017.08.114.
Liao, Y., R. Lin, R. Zhang, and G. Wu. 2022. “Attention-based LSTM (AttLSTM) neural network for seismic response modeling of bridges.” Comput. Struct. 275 (Jun): 106915. https://doi.org/10.1016/j.compstruc.2022.106915.
Liu, H., and Y. Zhang. 2020. “Bridge condition rating data modeling using deep learning algorithm.” Struct. Infrastruct. Eng., Maint. Manage. Life Cycle Des. Perform. 16 (10): 1447–1460. https://doi.org/10.1080/15732479.2020.1712610.
LTBP InfoBridge. 2021. “Bridge selection and data presentation.” Accessed December 14, 2021. https://infobridge.fhwa.dot.gov/.
Ma, X., Z. Tao, Y. Wang, H. Yu, and Y. Wang. 2015. “Long short-term memory neural network for traffic speed prediction using remote sensor data.” Transp. Res. Part C Emerging Technol. 54 (9): 187–197. https://doi.org/10.1016/j.trc.2015.03.014.
Mangalathu, S., and J. S. Jeon. 2019. “Machine learning–based failure mode recognition of circular reinforced concrete bridge columns: Comparative study.” J. Struct. Eng. 145 (10): 04019104. https://doi.org/10.1061/(ASCE)ST.1943-541X.0002402.
Mekemson, J., N. Gagarin, D. Goulias, R. Cutts, and J. Andrews. 2017. “Advances in analysis of ground penetrating radar antenna array for subsurface analysis of concrete bridge decks.” In Proc., 96th Transportation Research Board Annual Meeting. Washington, DC: National Academy of Science.
Nguyen, T., A. Kashani, T. Ngo, and S. Bordas. 2019. “Deep neural network with high-order neuron for the prediction of foamed concrete strength.” Comput.-Aided Civ. Infrastruct. Eng. 34 (4): 316–332. https://doi.org/10.1111/mice.12422.
Nguyen, T. T., and K. Dinh. 2019. “Prediction of bridge deck condition rating based on artificial neural networks.” J. Sci. Technol. Civ. Eng. 13 (3): 15–25. https://doi.org/10.31814/stce.nuce2019-13(3)-02.
NOAA (National Oceanic and Atmospheric Administration). 2020. “Data tools.” Accessed August 8, 2020. https://www.ncdc.noaa.gov/cdo-web/datatools/selectlocation.
Pu, Z., C. Liu, X. Shi, Z. Cui, and Y. Wang. 2020. “Road surface friction prediction using long short-term memory neural network based on historical data.” J. Intell. Transp. Syst. Technol. Plann. Oper. 26 (1): 34–45. https://doi.org/10.1080/15472450.2020.1780922.
Ruder, S. 2021. “An overview of gradient descent optimization algorithms.” Accessed April 14, 2021. https://ruder.io/optimizing-gradient-descent/index.html#momentum.
Sak, H., A. W. Senior, and F. Beaufays. 2014. Long short-term memory recurrent neural network architectures for large scale acoustic modeling, 338–342. Singapore: INTERSPEECH.
Scott, M., and D. Goulias. 2015. “Quantitative bridge deck evaluation using emerging ground penetrating radar data collection and analysis techniques.” In Proc., 16th European Bridge Conf. Boca Raton, FL: CRC Press.
Srivastava, N., G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov. 2014. “Dropout: A simple way to prevent neural networks from overfitting.” J. Mach. Learn. Res. 15 (Apr): 1929–1958.
Stekhoven, D. J., and P. Bühlmann. 2012. “MissForest—Non-parametric missing value imputation for mixed-type data.” Bioinformatics 28 (1): 112–118. https://doi.org/10.1093/bioinformatics/btr597.
Sutskever, I., O. Vinyals, and Q. V. Le. 2014. “Sequence to sequence learning with neural networks.” Adv. Neural Inf. Process. Syst. 2014 (1): 3104–3112. https://doi.org/10.48550/arXiv.1409.3215.
Tang, F., and H. Ishwaran. 2017. “Random forest missing data algorithms.” Stat. Anal. Data Mining: ASA Data Sci. J. 10 (6): 363–377. https://doi.org/10.1002/sam.11348.
Taylor, C. R. 1993. “Dynamic programming and the curses of dimensionality.” In Applications of dynamic programming to agricultural decision problems, 1–10. Boca Raton, FL: CRC Press.
Tian, Y., Y. Xu, D. Zhang, and H. Li. 2021. “Relationship modeling between vehicle-induced girder vertical deflection and cable tension by BiLSTM using field monitoring data of a cable-stayed bridge.” Struct. Control Health Monit. 28 (2): e2667. https://doi.org/10.1002/stc.2667.
Tompson, J., R. Goroshin, A. Jain, Y. LeCun, and C. Bregler. 2015. “Efficient object localization using convolutional networks.” In Proc., IEEE Conf. on Computer Vision and Pattern Recognition, 648–656. New York: IEEE.
Wang, J., G. Wen, S. Yang, and Y. Liu. 2018. “Remaining useful life estimation in prognostics using deep bidirectional LSTM neural network.” In Proc., Prognostics and System Health Management Conf. (PHM-Chongqing), 1037–1042. New York: IEEE. https://doi.org/10.1109/PHM-Chongqing.2018.00184.
Xiang, Z., A. Rashidi, and G. Ou. 2019. “An improved convolutional neural network system for automatically detecting rebar in GPR data.” In Computing in civil engineering 2019: Data, sensing, and analytics, 422–429. Reston, VA: ASCE.
Xu, Y., S. Wei, Y. Bao, and H. Li. 2019. “Automatic seismic damage identification of reinforced concrete columns from images by a region-based deep convolutional neural network.” Struct. Control Health Monit. 26 (3): e2313. https://doi.org/10.1002/stc.2313.
Yu, Y., W. Li, J. Li, and T. N. Nguyen. 2018. “A novel optimized self-learning method for compressive strength prediction of high performance concrete.” Constr. Build. Mater. 184 (15): 229–247. https://doi.org/10.1016/j.conbuildmat.2018.06.219.
Zhao, Y., and X. Jiang. 2019. Long short-term memory neural network for short-term high-speed rail passenger flow forecasting. Stockholm, Sweden: Li.U Press.
Information & Authors
Information
Published In
Journal of Performance of Constructed Facilities
Volume 37 • Issue 4 • August 2023
Copyright
© 2023 American Society of Civil Engineers.
History
Received: Oct 18, 2022
Accepted: Feb 27, 2023
Published online: May 3, 2023
Published in print: Aug 1, 2023
Discussion open until: Oct 3, 2023
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited by
- Hojat Behrooz, Mohammad Ilbeigi, Adaptive Bridge Condition Forecasting through a Cluster-Based Exploration, Journal of Performance of Constructed Facilities, 10.1061/JPCFEV.CFENG-4864, 38, 6, (2024).