Chapter
May 24, 2022

Deep Learning-Based Named Entity Recognition from Construction Safety Regulations for Automated Field Compliance Checking

Publication: Computing in Civil Engineering 2021

ABSTRACT

Automated safety compliance checking aims to detect field violations to construction safety regulations. Recent research and system development efforts have made good progress on automated tracking of labor and equipment towards improved violation detection and safety compliance. However, extracting and modeling safety requirements for supporting automated violation detection or safety alert systems remains highly manual. Towards addressing this gap, information extraction provides an opportunity to automatically extract safety requirements from regulatory documents for comparisons with field information to detect violations. However, existing information extraction methods fall short in their scalability and/or accuracy. To address this need, this paper proposes a deep learning-based information extraction method for extracting entities that describe fall protection requirements from construction safety regulations for supporting automated field compliance checking. The proposed method uses a hybrid bidirectional long short-term memory (BiLSTM) and convolutional neural network (CNN) model for recognizing the entities. The proposed method was implemented and tested on four selected Occupational Safety and Health Administration (OSHA) sections related to fall protection. It has achieved an average precision, recall, and F-1 measure of 81.5%, 80.3%, and 80.9%, respectively, which indicates good named entity recognition performance. The paper discusses the proposed method and experimental results, and outlines directions for further performance improvement.

Get full access to this article

View all available purchase options and get full access to this chapter.

REFERENCES

Biggs, H. C., and Biggs, S. E. (2013). “Interlocked projects in safety competency and safety effectiveness indicators in the construction sector.” Saf. Sci., 52, 37–42.
Chi, C. F., and Lin, S. Z. (2018). “Classification scheme and prevention measures for caught-in-between occupational fatalities.” Appl. Ergon., 68, 338–348.
Chi, N. W., Lin, K. Y., and Hsieh, S. H. (2014). “Using ontology-based text classification to assist Job Hazard Analysis.” Adv. Eng. Inform., 28(4), 381–394.
Chiu, J. P., and Nichols, E. (2016). “Named entity recognition with bidirectional LSTM-CNNs.” Trans. Assoc. Comput. Linguist., 4, 357–370.
Ding, L. Y., Zhong, B. T., Wu, S., and Luo, H. B. (2016). “Construction risk knowledge management in BIM using ontology and semantic web technology.” Saf. Sci., 87, 202–213.
Dong, X. S., Largay, J. A., Choi, S. D., Wang, X., Cain, C. T., and Romano, N. (2017). “Fatal falls and PFAS use in the construction industry: Findings from the NIOSH FACE reports.” Accid. Anal. Prev., 102, 136–143.
Fang, W., Ding, L., Luo, H., and Love, P. E. (2018). “Falls from heights: A computer vision-based approach for safety harness detection.” Automat. Constr., 91, 53–61.
Fang, W., Zhong, B., Zhao, N., Love, P. E., Luo, H., Xue, J., and Xu, S. (2019). “A deep learning-based approach for mitigating falls from height with computer vision: Convolutional neural network.” Adv. Eng. Inform., 39, 170–177.
Huang, X., and Hinze, J. (2003). “Analysis of construction worker fall accidents.” J. Constr. Eng. Manag., 129(3), 262–271.
Jebelli, H., Ahn, C. R., and Stentz, T. L. (2016). “Fall risk analysis of construction workers using inertial measurement units: Validating the usefulness of the postural stability metrics in construction.” Saf. Sci., 84, 161–170.
Lu, Y., Li, Q., Zhou, Z., and Deng, Y. (2015). “Ontology-based knowledge modeling for automated construction safety checking.” Saf. Sci., 79, 11–18.
Nakayama, H., Kubo, T., Kamura, J., Taniguchi, Y., and Liang, X. (2018). “doccano: Text annotation tool for human.” Github, <github. com/chakkiworks/doccano>(June. 26, 2020).
Nath, N. D., Behzadan, A. H., and Paal, S. G. (2020). “Deep learning for site safety: Real-time detection of personal protective equipment.” Automat. Constr., 112, 103085.
Park, M. W., and Brilakis, I. (2016). “Continuous localization of construction workers via integration of detection and tracking.” Automat. Constr., 72, 129–142.
Pennington, J., Socher, R., and Manning, C. (2014). “Glove: Global vectors for word representation.” Proc., Empirical Methods in Natural Language Processing (EMNLP) Conf., 1532–1543.
Peters, M. E., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., and Zettlemoyer, L. (2018). “Deep contextualized word representations.”.
Roberts, D., Torres Calderon, W., Tang, S., and Golparvar-Fard, M. (2020). “Vision-based construction worker activity analysis informed by body posture.” J. Comput. Civil Eng., 34(4), 04020017.
Tang, S., Golparvar-Fard, M., Naphade, M., and Gopalakrishna, M. M. (2019). “Video-based activity forecasting for construction safety monitoring use cases.” J. Comput. Civil Eng., ASCE, Reston, VA, 204–210.
Tang, S., Roberts, D., and Golparvar-Fard, M. (2020). “Human-object interaction recognition for automatic construction site safety inspection.” Automat. Constr., 120, 103356.
Teizer, J. (2015). “Status quo and open challenges in vision-based sensing and tracking of temporary resources on infrastructure construction sites.” Adv. Eng. Inform., 29(2), 225–238.
Teo, E. A. L., Ling, F. Y. Y., and Chong, A. F. W. (2005). “Framework for project managers to manage construction safety.” Int. J. Constr. Proj. Manag., 23(4), 329–341.
Xing, X., Zhong, B., Luo, H., Li, H., and Wu, H. (2019). “Ontology for safety risk identification in metro construction.” Comput Ind, 109, 14–30.
Zhang, J., and El-Gohary, N. M. (2013). “Semantic NLP-based information extraction from construction regulatory documents for automated compliance checking.” J. Comput. Civil Eng., 30(2), 04015014.
Zhang, R., and El-Gohary, N. (2019). “A machine learning-based approach for building code requirement hierarchy extraction.” Proc., 7th CSCE Int. Constr. Spec. Conf., CSCE, Montreal, Canada.
Zhang, R., and El-Gohary, N. (2020). “A Machine-Learning Approach for Semantically-Enriched Building-Code Sentence Generation for Automatic Semantic Analysis.” Proc., Construction Research Congress (CRC) Conf., ASCE, Reston, VA, 1261–1270.
Zhang, S., Boukamp, F., and Teizer, J. (2015a). “Ontology-based semantic modeling of construction safety knowledge: Towards automated safety planning for job hazard analysis (JHA).” Automat. Constr., 52, 29–41.
Zhang, S., Teizer, J., Pradhananga, N., and Eastman, C. M. (2015b). “Workforce location tracking to model, visualize and analyze workspace requirements in building information models for construction safety planning.” Automat. Constr., 60, 74–86.
Zhong, B., Li, H., Luo, H., Zhou, J., Fang, W., and Xing, X. (2020). “Ontology-based semantic modeling of knowledge in construction: classification and identification of hazards implied in images.” J. Constr. Eng. Manag., 146(4), 04020013.
Zhou, P., and El-Gohary, N. (2017). “Ontology-based automated information extraction from building energy conservation codes.” Automat. Constr., 74, 103–117.

Information & Authors

Information

Published In

Go to Computing in Civil Engineering 2021
Computing in Civil Engineering 2021
Pages: 164 - 171

History

Published online: May 24, 2022

Permissions

Request permissions for this article.

Authors

Affiliations

1Graduate Student, Dept. of Civil and Environmental Engineering, Univ. of Illinois at Urbana-Champaign, Urbana, IL. Email: [email protected]
Nora El-Gohary, A.M.ASCE [email protected]
2Associate Professor, Dept. of Civil and Environmental Engineering, Univ. of Illinois at Urbana-Champaign, Urbana, IL. Email: [email protected]

Metrics & Citations

Metrics

Citations

Download citation

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

View Options

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Paper
$35.00
Add to cart
Buy E-book
$358.00
Add to cart

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Paper
$35.00
Add to cart
Buy E-book
$358.00
Add to cart

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share