Deep Learning-Based Named Entity Recognition from Construction Safety Regulations for Automated Field Compliance Checking
Publication: Computing in Civil Engineering 2021
ABSTRACT
Automated safety compliance checking aims to detect field violations to construction safety regulations. Recent research and system development efforts have made good progress on automated tracking of labor and equipment towards improved violation detection and safety compliance. However, extracting and modeling safety requirements for supporting automated violation detection or safety alert systems remains highly manual. Towards addressing this gap, information extraction provides an opportunity to automatically extract safety requirements from regulatory documents for comparisons with field information to detect violations. However, existing information extraction methods fall short in their scalability and/or accuracy. To address this need, this paper proposes a deep learning-based information extraction method for extracting entities that describe fall protection requirements from construction safety regulations for supporting automated field compliance checking. The proposed method uses a hybrid bidirectional long short-term memory (BiLSTM) and convolutional neural network (CNN) model for recognizing the entities. The proposed method was implemented and tested on four selected Occupational Safety and Health Administration (OSHA) sections related to fall protection. It has achieved an average precision, recall, and F-1 measure of 81.5%, 80.3%, and 80.9%, respectively, which indicates good named entity recognition performance. The paper discusses the proposed method and experimental results, and outlines directions for further performance improvement.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Biggs, H. C., and Biggs, S. E. (2013). “Interlocked projects in safety competency and safety effectiveness indicators in the construction sector.” Saf. Sci., 52, 37–42.
Chi, C. F., and Lin, S. Z. (2018). “Classification scheme and prevention measures for caught-in-between occupational fatalities.” Appl. Ergon., 68, 338–348.
Chi, N. W., Lin, K. Y., and Hsieh, S. H. (2014). “Using ontology-based text classification to assist Job Hazard Analysis.” Adv. Eng. Inform., 28(4), 381–394.
Chiu, J. P., and Nichols, E. (2016). “Named entity recognition with bidirectional LSTM-CNNs.” Trans. Assoc. Comput. Linguist., 4, 357–370.
Ding, L. Y., Zhong, B. T., Wu, S., and Luo, H. B. (2016). “Construction risk knowledge management in BIM using ontology and semantic web technology.” Saf. Sci., 87, 202–213.
Dong, X. S., Largay, J. A., Choi, S. D., Wang, X., Cain, C. T., and Romano, N. (2017). “Fatal falls and PFAS use in the construction industry: Findings from the NIOSH FACE reports.” Accid. Anal. Prev., 102, 136–143.
Fang, W., Ding, L., Luo, H., and Love, P. E. (2018). “Falls from heights: A computer vision-based approach for safety harness detection.” Automat. Constr., 91, 53–61.
Fang, W., Zhong, B., Zhao, N., Love, P. E., Luo, H., Xue, J., and Xu, S. (2019). “A deep learning-based approach for mitigating falls from height with computer vision: Convolutional neural network.” Adv. Eng. Inform., 39, 170–177.
Huang, X., and Hinze, J. (2003). “Analysis of construction worker fall accidents.” J. Constr. Eng. Manag., 129(3), 262–271.
Jebelli, H., Ahn, C. R., and Stentz, T. L. (2016). “Fall risk analysis of construction workers using inertial measurement units: Validating the usefulness of the postural stability metrics in construction.” Saf. Sci., 84, 161–170.
Lu, Y., Li, Q., Zhou, Z., and Deng, Y. (2015). “Ontology-based knowledge modeling for automated construction safety checking.” Saf. Sci., 79, 11–18.
Nakayama, H., Kubo, T., Kamura, J., Taniguchi, Y., and Liang, X. (2018). “doccano: Text annotation tool for human.” Github, <github. com/chakkiworks/doccano>(June. 26, 2020).
Nath, N. D., Behzadan, A. H., and Paal, S. G. (2020). “Deep learning for site safety: Real-time detection of personal protective equipment.” Automat. Constr., 112, 103085.
Park, M. W., and Brilakis, I. (2016). “Continuous localization of construction workers via integration of detection and tracking.” Automat. Constr., 72, 129–142.
Pennington, J., Socher, R., and Manning, C. (2014). “Glove: Global vectors for word representation.” Proc., Empirical Methods in Natural Language Processing (EMNLP) Conf., 1532–1543.
Peters, M. E., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., and Zettlemoyer, L. (2018). “Deep contextualized word representations.”.
Roberts, D., Torres Calderon, W., Tang, S., and Golparvar-Fard, M. (2020). “Vision-based construction worker activity analysis informed by body posture.” J. Comput. Civil Eng., 34(4), 04020017.
Tang, S., Golparvar-Fard, M., Naphade, M., and Gopalakrishna, M. M. (2019). “Video-based activity forecasting for construction safety monitoring use cases.” J. Comput. Civil Eng., ASCE, Reston, VA, 204–210.
Tang, S., Roberts, D., and Golparvar-Fard, M. (2020). “Human-object interaction recognition for automatic construction site safety inspection.” Automat. Constr., 120, 103356.
Teizer, J. (2015). “Status quo and open challenges in vision-based sensing and tracking of temporary resources on infrastructure construction sites.” Adv. Eng. Inform., 29(2), 225–238.
Teo, E. A. L., Ling, F. Y. Y., and Chong, A. F. W. (2005). “Framework for project managers to manage construction safety.” Int. J. Constr. Proj. Manag., 23(4), 329–341.
Xing, X., Zhong, B., Luo, H., Li, H., and Wu, H. (2019). “Ontology for safety risk identification in metro construction.” Comput Ind, 109, 14–30.
Zhang, J., and El-Gohary, N. M. (2013). “Semantic NLP-based information extraction from construction regulatory documents for automated compliance checking.” J. Comput. Civil Eng., 30(2), 04015014.
Zhang, R., and El-Gohary, N. (2019). “A machine learning-based approach for building code requirement hierarchy extraction.” Proc., 7th CSCE Int. Constr. Spec. Conf., CSCE, Montreal, Canada.
Zhang, R., and El-Gohary, N. (2020). “A Machine-Learning Approach for Semantically-Enriched Building-Code Sentence Generation for Automatic Semantic Analysis.” Proc., Construction Research Congress (CRC) Conf., ASCE, Reston, VA, 1261–1270.
Zhang, S., Boukamp, F., and Teizer, J. (2015a). “Ontology-based semantic modeling of construction safety knowledge: Towards automated safety planning for job hazard analysis (JHA).” Automat. Constr., 52, 29–41.
Zhang, S., Teizer, J., Pradhananga, N., and Eastman, C. M. (2015b). “Workforce location tracking to model, visualize and analyze workspace requirements in building information models for construction safety planning.” Automat. Constr., 60, 74–86.
Zhong, B., Li, H., Luo, H., Zhou, J., Fang, W., and Xing, X. (2020). “Ontology-based semantic modeling of knowledge in construction: classification and identification of hazards implied in images.” J. Constr. Eng. Manag., 146(4), 04020013.
Zhou, P., and El-Gohary, N. (2017). “Ontology-based automated information extraction from building energy conservation codes.” Automat. Constr., 74, 103–117.
Information & Authors
Information
Published In
History
Published online: May 24, 2022
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.