Synthesizing Ontology and Graph Neural Network to Unveil the Implicit Rules for US Bridge Preservation Decisions
Publication: Journal of Management in Engineering
Volume 40, Issue 3
Abstract
Bridges are essential portions of a nation’s infrastructure systems. Although general rules and guidelines are available for bridge preservation activity prediction, due to the intricate interdependencies among bridge elements, defects, and preservation activities, departments of transportation (DOTs) rely heavily on bridge engineers’ experience to determine preservation needs. Hence, identifying and organizing the unwritten and experience-based domain knowledge is essential to automate bridge preservation planning. This research collected 13,994 defects for 442 bridges in North Carolina. A graph neural network (GNN) model was developed to predict preservation activities using a defect dependency graph. This research created a bridge preservation ontology to further leverage experience-based domain knowledge to derive 80 unwritten activity-triggering rules via ontology axioms. A heterogeneous graph was constructed considering the semantics related to bridge defects and elements from the axioms. Tests revealed that, with a domain ontology, the GNN model improved prediction accuracy, precision, recall, and score by 4.78%, 4.03%, 15.03%, and 11.62%, respectively. This research contributes to the body of knowledge by proposing a new graph theory–based bridge inspection database to enable GNN learning considering spatial and logical dependencies. Construction practitioners can instantly access and clearly comprehend bridge maintenance contextual information using the ontology database and machine learning models. The framework provides a systematic model for bridge preservation activity planning and enhances the robustness and reliability of bridge preservation decision-making. This research will assist DOT engineers and managers in improving knowledge sharing and automatic planning in bridge management.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or code that support the findings of this study are available from the corresponding author upon reasonable request.
Acknowledgments
This paper was derived from a study funded by the North Carolina Department of Transportation under Grant RP 2023-05. The contents do not necessarily reflect the official views or policies of the North Carolina Department of Transportation or the Federal Highway Administration.
References
AASHTO. 2019. Manual for bridge element inspection. Washington, DC: AASHTO.
Arpírez, J. C., O. Corcho, M. Fernández-López, and A. Gómez-Pérez. 2003. “WEBODE in a nutshell.” AI Mag. 24 (3): 37. https://doi.org/10.1609/aimag.v24i3.1717.
ARTBA (American Road and Transportation Builders Association). 2023. “Bridge report.” Accessed September 7, 2023. https://artbabridgereport.org/state/map.
Assaad, R., and I. H. El-adaway. 2020. “Bridge infrastructure asset management system: Comparative computational machine learning approach for evaluating and predicting deck deterioration conditions.” J. Infrastruct. Syst. 26 (3): 1–17. https://doi.org/10.1061/(ASCE)IS.1943-555X.0000572.
Barzdiņš, J., G. Barzdiņš, K. Čerans, R. Liepiņš, and A. Sproǵis. 2010. “UML style graphical notation and editor for OWL 2.” In Proc., Perspectives in Business Informatics Research: 9th Int. Conf., 102–114. Berlin: Springer.
Bonilla, M., W. Rasdorf, M. Liu, M. Al-Ghandour, and C. He. 2023. “Inequity reduction in road maintenance funding for municipalities.” Public Works Manage. Policy 28 (3): 339–362. https://doi.org/10.1177/1087724X221130047.
Borjigin, S. G., M. A. Austin, and E. J. Zontek-Carney. 2022. “Semiautomated development of textual requirements: Combined NLP and multidomain semantic modeling approach.” J. Manage. Eng. 38 (5): 1–17. https://doi.org/10.1061/(ASCE)ME.1943-5479.0001076.
Brody, S., U. Alon, and E. Yahav. 2021. “How attentive are graph attention networks?” In Proc., Ninth Int. Conf. on Learning Representations, 1–26. Appleton, WI: International Conference on Learning Representations.
Bush, S. J. W., A. Dean, C. White, and J. Lamrock. 2020. “Prioritization framework for asset management of New Brunswick’s covered bridges.” J. Perform. Constr. Facil. 34 (4): 1–8. https://doi.org/10.1061/(ASCE)CF.1943-5509.0001464.
Chen, G., M. Liu, Y. Zhang, Z. Wang, S. M. Hsiang, and C. He. 2023. “Using images to detect, plan, analyze, and coordinate a smart contract in construction.” J. Manage. Eng. 39 (2): 1–18. https://doi.org/10.1061/JMENEA.MEENG-5121.
Dey, K. C., M. Chowdhury, M. M. Wiecek, and A. Dunning. 2015. “Infrastructure damage-cost-recovery fee for overweight trucks: Tradeoff analysis framework.” J. Transp. Eng. 141 (7): 04015008. https://doi.org/10.1061/(ASCE)TE.1943-5436.0000769.
Diestel, R. 2017. “Graph theory.” In Graduate texts in mathematics. Berlin: Springer.
El-Diraby, T. E., and H. Osman. 2011. “A domain ontology for construction concepts in urban infrastructure products.” Autom. Constr. 20 (8): 1120–1132. https://doi.org/10.1016/j.autcon.2011.04.014.
El-Gohary, N. M., and T. E. El-Diraby. 2010. “Domain ontology for processes in infrastructure and construction.” J. Constr. Eng. Manage. 136 (7): 730–744. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000178.
Fang, W., L. Ma, P. E. D. Love, H. Luo, L. Ding, and A. Zhou. 2020. “Knowledge graph for identifying hazards on construction sites: Integrating computer vision with ontology.” Autom. Constr. 119 (Jul): 103310. https://doi.org/10.1016/j.autcon.2020.103310.
FHWA (Federal Highway Administration). 2011. FHWA bridge preservation guide. Washington, DC: FHWA.
FHWA (Federal Highway Administration). 2014. Specification for the national bridge inventory bridge elements. Washington, DC: FHWA.
FHWA (Federal Highway Administration). 2018. Bridge preservation guide: Maintaining a resilient infrastructure to preserve mobility. Washington, DC: FHWA.
FHWA (Federal Highway Administration). 2022a. Bridge condition by highway system 2022. Washington, DC: FHWA.
FHWA (Federal Highway Administration). 2022b. Specifications for the National Bridge Inventory. Washington, DC: FHWA.
FHWA (Federal Highway Administration). 2023. Bridge replacement unit costs 2021. Washington, DC: FHWA.
Gao, Y., R. Chen, W. Qin, L. Wei, and C. Zhou. 2023. “Learning from explainable data-driven tunneling graphs: A spatio-temporal graph convolutional network for clogging detection.” Autom. Constr. 147 (Jul): 104741. https://doi.org/10.1016/j.autcon.2023.104741.
Gruber, T. R. 1995. “Toward principles for the design of ontologies used for knowledge sharing?” Int. J. Hum. Comput. Stud. 43 (5–6): 907–928. https://doi.org/10.1006/ijhc.1995.1081.
Hamilton, W. L., R. Ying, and J. Leskovec. 2017. “Inductive representation learning on large graphs.” Adv. Neural Inf. Process. Syst. 2017 (Dec): 1025–1035.
Hassan, F. U., and T. Le. 2023. “Ontology-based approach to risk-factor identification to support the management of provisions in bridge design.” J. Leg. Aff. Dispute Resolut. Eng. Constr. 15 (1): 1–14. https://doi.org/10.1061/(ASCE)LA.1943-4170.0000574.
He, C., M. Liu, Z. Wang, G. Chen, Y. Zhang, and S. M. Hsiang. 2022. “Facilitating smart contract in project scheduling under uncertainty—A Choquet integral approach.” In Construction Research Congress 2022, 930–939. Reston, VA: ASCE.
He, C., M. Liu, Y. Zhang, Z. Wang, S. M. Hsiang, G. Chen, W. Li, and G. Dai. 2023. “Space–time–workforce visualization and conditional capacity synthesis in uncertainty.” J. Manage. Eng. 39 (2): 04022071. https://doi.org/10.1061/JMENEA.MEENG-4991.
Hu, X., and K. Liu. 2023. “Structural deterioration knowledge ontology towards physics-informed machine learning for enhanced bridge deterioration prediction.” J. Comput. Civ. Eng. 37 (1): 1–17. https://doi.org/10.1061/(ASCE)CP.1943-5487.0001066.
Hu, Y., C. Xia, J. Chen, and X. Gao. 2023. “Clash context representation and change component prediction based on graph convolutional network in MEP disciplines.” Adv. Eng. Inf. 55 (Jul): 101896. https://doi.org/10.1016/j.aei.2023.101896.
ITD (Idaho Transportation Department). 2019. Idaho Transportation Department operations manual. Boise, ID: Idaho DOT.
Javanmardi, A., C. He, S. M. Hsiang, S. A. Abbasian-Hosseini, and M. Liu. 2023. “Enhancing construction project workflow reliability through observe–plan–do–check–react cycle: A bridge project case study.” Buildings 13 (9): 2379. https://doi.org/10.3390/buildings13092379.
Jia, Y., J. Wang, W. Shou, M. R. Hosseini, and Y. Bai. 2023. “Graph neural networks for construction applications.” Autom. Constr. 154 (Jun): 104984. https://doi.org/10.1016/j.autcon.2023.104984.
Kim, T. W., and M. Fischer. 2014. “Ontology for representing building users’ activities in space-use analysis.” J. Constr. Eng. Manage. 140 (8): 1–9. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000881.
Kipf, T. N., and M. Welling. 2017. “Semi-supervised classification with graph convolutional networks.” In Proc., 5th Int. Conf. on Learning Representations, ICLR 2017–Conf. Track Proc., 1–14. Appleton, WI: International Conference on Learning Representations.
Labonne, M. 2023. Hands-on graph neural networks using Python. Birmingham, UK: Packt.
Li, R., T. Mo, J. Yang, S. Jiang, T. Li, and Y. Liu. 2021. “Ontologies-based domain knowledge modeling and heterogeneous sensor data integration for bridge health monitoring systems.” IEEE Trans. Ind. Inf. 17 (1): 321–332. https://doi.org/10.1109/TII.2020.2967561.
Liu, K., and N. El-Gohary. 2022. “Bridge deterioration knowledge ontology for supporting bridge document analytics.” J. Constr. Eng. Manage. 148 (6): 1–14. https://doi.org/10.1061/(ASCE)CO.1943-7862.0002210.
McLaughlin, E., N. Charron, and S. Narasimhan. 2020. “Automated defect quantification in concrete bridges using robotics and deep learning.” J. Comput. Civ. Eng. 34 (5): 1–12. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000915.
Muhaimin, A. M. M., L. Zhang, S. Dhakal, X. Lv, N. Pradhananga, V. S. Kalasapudi, and A. Azizinamini. 2021. “Identification and analysis of factors affecting the future of bridge design, construction, and operation.” J. Manage. Eng. 37 (5): 1–18. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000943.
Musen, M. A. 2015. “The Protégé project: A look back and a look forward.” Al Matters 1 (4): 4–12. https://doi.org/10.1145/2757001.2757003.
NCDOT (North Carolina Dept. of Transportation). 2019a. North Carolina Department of Transportation transportation asset management plan 2019 final report. Raleigh, NC: NCDOT.
NCDOT (North Carolina Dept. of Transportation). 2019b. Structures management unit inspection manual. Raleigh, NC: NCDOT.
ODOT (Ohio Dept. of Transportation). 2022. State of Ohio roadway infrastructure maintenance responsibility manual. Raleigh, NC: NCDOT.
Osman, H., and T. El-Diraby. 2006. “Ontological modeling of infrastructure products and related concepts.” Transp. Res. Rec. 1984 (1): 159–167. https://doi.org/10.1177/0361198106198400115.
Pan, X., B. Zhong, Y. Wang, and L. Shen. 2022. “Identification of accident-injury type and bodypart factors from construction accident reports: A graph-based deep learning framework.” Adv. Eng. Inf. 54 (Sep): 101752. https://doi.org/10.1016/j.aei.2022.101752.
Sayed, S. M., H. N. Sunna, and P. R. Moore. 2020. “Truck platooning impact on bridge preservation.” J. Perform. Constr. Facil. 34 (3): 1–12. https://doi.org/10.1061/(ASCE)CF.1943-5509.0001423.
Seedah, D. P. K., C. Choubassi, and F. Leite. 2016. “Ontology for querying heterogeneous data sources in freight transportation.” J. Comput. Civ. Eng. 30 (4): 04015069. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000548.
Semafora Systems. 2022. OntoStudio. Bensheim, Germany: Semafora Systems.
Veličković, P., A. Casanova, P. Liò, G. Cucurull, A. Romero, and Y. Bengio. 2018. “Graph attention networks.” In Proc., 6th Int. Conf. on Learning Representations, ICLR 2018–Conf. Track Proc., 1–12. Appleton, WI: International Conference on Learning Representations.
Voordijk, H., R. ter Huurne, and L. Olde Scholtenhuis. 2022. “Adoption and use of ontologies in the utility sector: A technological mediation perspective.” J. Manage. Eng. 38 (1): 1–12. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000989.
Wang, P., S. Zou, J. Liu, and W. Ke. 2022a. “Matching biomedical ontologies with GCN-based feature propagation.” Math. Biosci. Eng. 19 (8): 8479–8504. https://doi.org/10.3934/mbe.2022394.
Wang, Z., R. Sacks, and T. Yeung. 2022b. “Exploring graph neural networks for semantic enrichment: Room type classification.” Autom. Constr. 134 (Jun): 104039. https://doi.org/10.1016/j.autcon.2021.104039.
Yin, M., L. Tang, C. Webster, J. Li, H. Li, Z. Wu, and R. C. K. Cheng. 2023. “Two-stage Text-to-BIMQL semantic parsing for building information model extraction using graph neural networks.” Autom. Constr. 152 (Sep): 104902. https://doi.org/10.1016/j.autcon.2023.104902.
Yin, Y., K. Choi, H. D. Jeong, and A. Touran. 2022. “Integration of schedule, cost, traffic, and risk into the determination of construction contract times.” J. Manage. Eng. 38 (6): 1–16. https://doi.org/10.1061/(ASCE)ME.1943-5479.0001089.
Zhong, B., H. Li, H. Luo, J. Zhou, W. Fang, and X. Xing. 2020. “Ontology-based semantic modeling of knowledge in construction: Classification and identification of hazards implied in images.” J. Constr. Eng. Manage. 146 (4): 1–15. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001767.
Zhou, G., J. Wang, X. Zhang, and G. Yu. 2019. “DeepGOA: Predicting gene ontology annotations of proteins via graph convolutional network.” In Proc., 2019 IEEE Int. Conf. on Bioinformatics and Biomedicine, BIBM 2019, 1836–1841. New York: IEEE.
Information & Authors
Information
Published In
Journal of Management in Engineering
Volume 40 • Issue 3 • May 2024
Copyright
© 2024 American Society of Civil Engineers.
History
Received: Jul 17, 2023
Accepted: Oct 17, 2023
Published online: Jan 29, 2024
Published in print: May 1, 2024
Discussion open until: Jun 29, 2024
ASCE Technical Topics:
- Architectural engineering
- Artificial intelligence and machine learning
- Bridge engineering
- Bridge management
- Bridges
- Building management
- Computer programming
- Computing in civil engineering
- Defects and imperfections
- Engineering fundamentals
- Historic preservation
- Information management
- Maintenance and operation
- Materials characterization
- Materials engineering
- Neural networks
- Structural engineering
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited by
- Ashtad Javanmardi, Min Liu, Chuanni He, Simon M. Hsiang, Alireza Abbasian-Hosseini, Improving Construction Meeting Effectiveness: Trade-Offs between Reactive and Proactive Site-Level Planning Discussions, Journal of Management in Engineering, 10.1061/JMENEA.MEENG-6087, 40, 5, (2024).