Deep Learning-Based Relation Extraction from Construction Safety Regulations for Automated Field Compliance Checking
Publication: Construction Research Congress 2022
ABSTRACT
Information extraction provides an opportunity to automatically extract safety requirements from construction safety regulations to support automated safety compliance checking for detecting field non-compliances with these regulations. However, previous efforts on automating the safety compliance checking process fall short in their scalability and ability to automatically extract safety requirements, due to the complexity in unstructured text. Therefore, this paper proposes a deep learning-based information extraction method for extracting relations that link fall protection-related entities extracted from construction safety regulations for supporting automated field compliance checking. The proposed method uses an attention-based convolutional neural network model for recognizing and classifying relations. The proposed method was implemented and tested on two selected Occupational Safety and Health Administration (OSHA) sections related to fall protection. It has achieved a weighted precision, recall, and F-1 measure of 82.7%, 81.1%, and 81.3%, respectively, which indicates good relation extraction performance.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Bach, N., and Badaskar, S. (2007). “A review of relation extraction.” Language & Statistics II, 2, 1–15.
Bollacker, K., Evans, C., Paritosh, P., Sturge, T., and Taylor, J. (2008, June). “Freebase: a collaboratively created graph database for structuring human knowledge.” Proc., 2008 ACM SIGMOD international conference on Management of data, 1247–1250.
Fang, W., Ding, L., Luo, H., and Love, P. E. (2018). “Falls from heights: A computer vision-based approach for safety harness detection.” Automat. Constr., 91, 53–61.
Fang, W., Zhong, B., Zhao, N., Love, P. E., Luo, H., Xue, J., and Xu, S. (2019). “A deep learning-based approach for mitigating falls from height with computer vision: Convolutional neural network.” Adv. Eng. Inform., 39, 170–177.
Hendrickx, I., Kim, S. N., Kozareva, Z., Nakov, P., Séaghdha, D. O., Padó, S., Pennacchiotti, M., Romano, L., and Szpakowicz, S. (2019). “SemEval-2010 task 8: Multi-way classification of semantic relations between pairs of nominals.”.
Jiang, H., Bao, Q., Cheng, Q., Yang, D., Wang, L., and Xiao, Y. (2020). “Complex Relation Extraction: Challenges and Opportunities.”.
Liu, K., and El-Gohary, N. (2017). “Ontology-based semi-supervised conditional random fields for automated information extraction from bridge inspection reports.” Automat. Constr., 81, 313–327.
Lai, S., Leung, K. S., and Leung, Y. (2018). “SUNNYNLP at SemEval-2018 Task 10: A support-vector-machine-based method for detecting semantic difference using taxonomy and word embedding features.” Proc., 12th international workshop on semantic evaluation (pp. 741–746).
Liu, K., and El-Gohary, N. (2021). “Semantic neural network ensemble for automated dependency relation extraction from bridge inspection reports.” J. Comput. Civ. Eng., 35(4), 04021007.
Lu, Y., Li, Q., Zhou, Z., and Deng, Y. (2015). “Ontology-based knowledge modeling for automated construction safety checking.” Saf. Sci., 79, 11–18.
Manning, C. D., Surdeanu, M., Bauer, J., Finkel, J. R., Bethard, S., and McClosky, D. (2014). “The Stanford CoreNLP natural language processing toolkit.” Proc., Association for Computational Linguistics (ACL), 55–60.
Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013). “Efficient estimation of word representations in vector space.”.
Mintz, M., Bills, S., Snow, R., and Jurafsky, D. (2009). “Distant supervision for relation extraction without labeled data.” Proc., Joint Conference of Association for Computational Linguistics (ACL) and Natural Language Processing of the AFNLP, 1003–1011.
Nath, N. D., Behzadan, A. H., and Paal, S. G. (2020). “Deep learning for site safety: Real-time detection of personal protective equipment.” Automat. Constr., 112, 103085.
Nebhi, K. (2013). “A rule-based relation extraction system using DBpedia and syntactic parsing.” Proc., 12th International Semantic Web Conference.
Nguyen, T. H., and Grishman, R. (2015). “Relation extraction: Perspective from convolutional neural networks.” Proc., Workshop on Vector Space Modeling for Natural Language Processing, 39–48.
Park, M. W., and Brilakis, I. (2016). “Continuous localization of construction workers via integration of detection and tracking.” Automat. Constr., 72, 129–142.
Roberts, D., Torres Calderon, W., Tang, S., and Golparvar-Fard, M. (2020). “Vision-based construction worker activity analysis informed by body posture.” J. Comput. Civ. Eng., 34(4), 04020017.
Salama, D. A., and El-Gohary, N. M. (2013). “Automated compliance checking of construction operation plans using a deontology for the construction domain.” J. Comput. Civ. Eng, 27(6), 681–698.
Santus, E., Biemann, C., and Chersoni, E. (2018). “Bomji at semeval-2018 task 10: Combining vector-, pattern-and graph-based information to identify discriminative attributes.”.
Tang, S., Golparvar-Fard, M., Naphade, M., and Gopalakrishna, M. M. (2019). “Video-based activity forecasting for construction safety monitoring use cases.” J. Comput. Civ. Eng., ASCE, Reston, VA, 204–210.
Tang, S., Roberts, D., and Golparvar-Fard, M. (2020). “Human-object interaction recognition for automatic construction site safety inspection.” Automat. Constr., 120, 103356.
Teizer, J. (2015). “Status quo and open challenges in vision-based sensing and tracking of temporary resources on infrastructure construction sites.” Adv. Eng. Inform., 29(2), 225–238.
Zhang, J., and El-Gohary, N. M. (2013). “Semantic NLP-based information extraction from construction regulatory documents for automated compliance checking.” J. Comput. Civil Eng., 30(2), 04015014.
Zhang, R., and El-Gohary, N. (2019). “A machine learning-based approach for building code requirement hierarchy extraction.” Proc., 7th CSCE Int. Constr. Spec. Conf., CSCE, Montreal, Canada.
Zhang, S., Teizer, J., Pradhananga, N., and Eastman, C. M. (2015b). “Workforce location tracking to model, visualize and analyze workspace requirements in building information models for construction safety planning.” Automat. Constr., 60, 74–86.
Zhou, P., and El-Gohary, N. (2017). “Ontology-based automated information extraction from building energy conservation codes.” Automat. Constr., 74, 103–117.
Information & Authors
Information
Published In
History
Published online: Mar 7, 2022
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.