Kinesiology-Inspired Assessment of Intrusion Risk Based on Human Motion Features
Publication: Journal of Construction Engineering and Management
Volume 150, Issue 7
Abstract
Intrusion behavior in hazardous areas is one of the major causes of construction safety accidents including falls from height and strikes by objects. Implementing automatic and preassessment of intrusions to enhance safety performance is of great importance in construction areas. Traditional behavioral safety management mainly relies on manual observation, which makes it difficult to accurately identify detailed changes in behavioral posture, while the results of risk analysis are susceptible to bias due to subjective factors. The emergence of artificial intelligence techniques and computer vision has provided new solutions for human behavior detection in recent years. Accurate vision-based skeleton extraction helps capture detailed behavioral information. Current studies generally focus on intrusion after the occurrence and rarely select metrics considering complex human motion features. It is difficult to accurately assess the potential intrusion risk, resulting in inefficient ex-ante safety management outcomes. This paper presents a novel intrusion assessment approach by integrating human kinematics to extract risk indicators and apply objective assessment methods for risk quantification. An indoor experiment with control groups was conducted by employing skeleton detection technology with safety knowledge to demonstrate its feasibility and effectiveness. The risk levels of the different activities were compared through a control group experimental analysis. The results show that a satisfying accuracy of intrusion assessment can be achieved for different workers. Appropriate warning and intervention methods can be implemented to mitigate the occurrence or reduce the severity of intrusions, thus reducing safety incidents on construction sites.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or code that support the findings of this study are available from the corresponding author upon reasonable request.
Acknowledgments
This work was supported by the Science Research Plan of Shanghai Municipal Science and Technology Committee (Grant No. 20dz1201301), the Strategic Research Plan of Chinese Academy of Engineering (Grant No. 2023-XY-42), and the Science Research Plan of Shanghai Housing and Urban-Rural Development Management Committee (Grant No. 2021-002-049).
References
Antwi-Afari, M. F., H. Li, S. Anwer, S. K. Yevu, Z. Wu, P. Antwi-Afari, and I. Kim. 2020. “Quantifying workers’ gait patterns to identify safety hazards in construction using a wearable insole pressure system.” Saf. Sci. 129 (Sep): 104855. https://doi.org/10.1016/j.ssci.2020.104855.
Awolusi, I., E. Marks, and M. Hallowell. 2018. “Wearable technology for personalized construction safety monitoring and trending: Review of applicable devices.” Autom. Constr. 85 (Jan): 96–106. https://doi.org/10.1016/j.autcon.2017.10.010.
Boulgouris, N. V., D. Hatzinakos, and K. N. Plataniotis. 2005. “Gait recognition: A challenging signal processing technology for biometric identification.” IEEE Signal Process. Mag. 22 (6): 78–90. https://doi.org/10.1109/MSP.2005.1550191.
Casale, P., O. Pujol, and P. Radeva. 2012. “Personalization and user verification in wearable systems using biometric walking patterns.” Personal Ubiquitous Comput. 16 (5): 563–580. https://doi.org/10.1007/s00779-011-0415-z.
Chen, H., X. Luo, Z. Zheng, and J. Ke. 2019. “A proactive workers’ safety risk evaluation framework based on position and posture data fusion.” Autom. Constr. 98 (Feb): 275–288. https://doi.org/10.1016/j.autcon.2018.11.026.
Chen, R., J. Hu, M. W. Levin, and D. Rey. 2020. “Stability-based analysis of autonomous intersection management with pedestrians.” Transp. Res. Part C Emerging Technol. 114 (May): 463–483. https://doi.org/10.1016/j.trc.2020.01.016.
Chu, M., J. Matthews, and P. E. D. Love. 2018. “Integrating mobile building information modelling and augmented reality systems: An experimental study.” Autom. Constr. 85 (Jan): 305–316. https://doi.org/10.1016/j.autcon.2017.10.032.
Ding, L. Y., W. L. Fang, H. B. Luo, P. Love, B. T. Zhong, and X. Ouyang. 2018. “A deep hybrid learning model to detect unsafe behavior: Integrating convolution neural networks and long short-term memory.” Autom. Constr. 86 (Feb): 118–124. https://doi.org/10.1016/j.autcon.2017.11.002.
Dong, M., and C. Xu. 2022. “Skeleton-based human motion prediction with privileged supervision.” IEEE Trans. Neural Networks Learn. Syst. 34 (12): 10419–10432. https://doi.org/10.1109/TNNLS.2022.3166861.
Fang, Q., H. Li, X. Luo, L. Ding, H. Luo, and C. Li. 2018a. “Computer vision aided inspection on falling prevention measures for steeplejacks in an aerial environment.” Autom. Constr. 93 (Sep): 148–164. https://doi.org/10.1016/j.autcon.2018.05.022.
Fang, Q., H. Li, X. C. Luo, L. Y. Ding, H. B. Luo, T. M. Rose, and W. P. An. 2018b. “Detecting non-hardhat-use by a deep learning method from far -field surveillance videos.” Autom. Constr. 85 (Jan): 1–9. https://doi.org/10.1016/j.autcon.2017.09.018.
Golovina, O., J. Teizer, and N. Pradhananga. 2016. “Heat map generation for predictive safety planning: Preventing struck-by and near miss interactions between workers-on-foot and construction equipment.” Autom. Constr. 71 (Part 1): 99–115. https://doi.org/10.1016/j.autcon.2016.03.008.
Guo, H., Y. Yu, Q. Ding, and M. Skitmore. 2018. “Image-and-skeleton-based parameterized approach to real-time identification of construction workers’ unsafe behaviors.” J. Constr. Eng. Manage. 144 (6): 04018042. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001497.
Guo, H., Z. Zhang, R. Yu, Y. Sun, and H. Li. 2023. “Action recognition based on 3D skeleton and LSTM for the monitoring of construction workers’ safety harness usage.” J. Constr. Eng. Manage. 149 (4): 04023015. https://doi.org/10.1061/JCEMD4.COENG-12542.
Han, S., and S. Lee. 2013. “A vision-based motion capture and recognition framework for behavior-based safety management.” Autom. Constr. 35 (Nov): 131–141. https://doi.org/10.1016/j.autcon.2013.05.001.
He, K., G. Gkioxari, P. Dollár, and R. Girshick. 2017. “Mask R-CNN.” In Proc., 2017 IEEE Int. Conf. on Computer Vision, 2980–2988. New York: IEEE. https://doi.org/10.1109/ICCV.2017.322.
Heng, L., D. Shuang, M. Skitmore, H. Qinghua, and Y. Qin. 2016. “Intrusion warning and assessment method for site safety enhancement.” Saf. Sci. 84 (Apr): 97–107. https://doi.org/10.1016/j.ssci.2015.12.004.
Hu, Z., W. T. Chan, H. Hu, and F. Xu. 2023. “Cognitive factors underlying unsafe behaviors of construction workers as a tool in safety management: A review.” J. Constr. Eng. Manage. 149 (3): 03123001. https://doi.org/10.1061/JCEMD4.COENG-11820.
Huang, S., X. Liu, W. Chen, G. Song, Z. Zhang, L. Yang, and B. Zhang. 2022. “A detection method of individual fare evasion behaviours on metros based on skeleton sequence and time series.” Inf. Sci. 589 (Apr): 62–79. https://doi.org/10.1016/j.ins.2021.12.088.
Jebelli, H., C. R. Ahn, and T. L. Stentz. 2016. “Comprehensive fall-risk assessment of construction workers using inertial measurement units: Validation of the gait-stability metric to assess the fall risk of iron workers.” J. Comput. Civ. Eng. 30 (3): 04015034. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000511.
Jeon, J., and H. Cai. 2021. “Classification of construction hazard-related perceptions using: Wearable electroencephalogram and virtual reality.” Autom. Constr. 132 (Dec): 103975. https://doi.org/10.1016/j.autcon.2021.103975.
Jin, R., H. Zhang, D. Liu, and X. Yan. 2020. “IoT-based detecting, locating and alarming of unauthorized intrusion on construction sites.” Autom. Constr. 118 (Oct): 103278. https://doi.org/10.1016/j.autcon.2020.103278.
Kale, A., A. Sundaresan, A. N. Rajagopalan, N. P. Cuntoor, A. K. Roy-Chowdhury, V. Kruger, and R. Chellappa. 2004. “Identification of humans using gait.” IEEE Trans. Image Process. 13 (9): 1163–1173. https://doi.org/10.1109/TIP.2004.832865.
Khan, M., R. Khalid, S. Anjum, S. Tran, and C. Park. 2022. “Fall prevention from scaffolding using computer vision and IoT-based monitoring.” J. Constr. Eng. Manage. 148 (7): 04022051. https://doi.org/10.1061/(ASCE)CO.1943-7862.0002278.
Kim, D., M. Y. Liu, S. Lee, and V. R. Kamat. 2019. “Remote proximity monitoring between mobile construction resources using camera-mounted UAVs.” Autom. Constr. 99 (Mar): 168–182. https://doi.org/10.1016/j.autcon.2018.12.014.
Kim, H. 2020. “Wearable sensor data-driven walkability assessment for elderly people.” Sustainability 12 (10): 4041. https://doi.org/10.3390/su12104041.
Lee, B., S. Hwang, and H. Kim. 2021. “The feasibility of information-entropy-based behavioral analysis for detecting environmental barriers.” Int. J. Environ. Res. Public Health 18 (21): 11727. https://doi.org/10.3390/ijerph182111727.
Li, H., X. Li, X. Luo, and J. Siebert. 2017. “Investigation of the causality patterns of non-helmet use behavior of construction workers.” Autom. Constr. 80 (Aug): 95–103. https://doi.org/10.1016/j.autcon.2017.02.006.
Li, H., M. Lu, S. Hsu, M. Gray, and T. Huang. 2015. “Proactive behavior-based safety management for construction safety improvement.” Saf. Sci. 75 (Jun): 107–117. https://doi.org/10.1016/j.ssci.2015.01.013.
Li, W., Q. Li, Y. Liu, H. Li, and X. Pei. 2020. “Construction safety risk assessment for existing building renovation project based on entropy-unascertained measure theory.” Appl. Sci. 10 (8): 2893. https://doi.org/10.3390/app10082893.
Li, X., S. Han, M. Gül, M. Al-Hussein, and M. El-Rich. 2018. “3D visualization-based ergonomic risk assessment and work modification framework and its validation for a lifting task.” J. Constr. Eng. Manage. 144 (1): 04017093. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001412.
Liu, F., S. Zhao, M. Weng, and Y. Liu. 2017. “Fire risk assessment for large-scale commercial buildings based on structure entropy weight method.” Saf. Sci. 94 (Apr): 26–40. https://doi.org/10.1016/j.ssci.2016.12.009.
López, A., J. Alvarez, and D. Álvarez. 2019. “Walking turn prediction from upper body kinematics: A systematic review with implications for human-robot interaction.” Appl. Sci. 9 (3): 361. https://doi.org/10.3390/app9030361.
Mei, X., X. Zhou, F. Xu, and Z. Zhang. 2023. “Human intrusion detection in static hazardous areas at construction sites: Deep learning–based method.” J. Constr. Eng. Manage. 149 (1): 04022142. https://doi.org/10.1061/(ASCE)CO.1943-7862.0002409.
Pan, Y., and L. Zhang. 2021. “Roles of artificial intelligence in construction engineering and management: A critical review and future trends.” Autom. Constr. 122 (Feb): 103517. https://doi.org/10.1016/j.autcon.2020.103517.
Paneru, S., and I. Jeelani. 2021. “Computer vision applications in construction: Current state, opportunities & challenges.” Autom. Constr. 132 (Dec): 103940. https://doi.org/10.1016/j.autcon.2021.103940.
Park, J., E. Marks, Y. K. Cho, and W. Suryanto. 2016. “Performance test of wireless technologies for personnel and equipment proximity sensing in work zones.” J. Constr. Eng. Manage. 142 (1): 04015049. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001031.
Park, M. W., N. Elsafty, and Z. Zhu. 2015. “Hardhat-wearing detection for enhancing on-site safety of construction workers.” J. Constr. Eng. Manage. 141 (9): 04015024. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000974.
Paszke, A., et al. 2019. “Pytorch: An imperative style, high-performance deep learning library.” In Proc., 33rd Int. Conf. on Neural Information Processing Systems, 721. New York: Curran Associates. https://doi.org/10.5555/3454287.3455008.
Pavllo, D., C. Feichtenhofer, D. Grangier, and M. Auli. 2019. “3D human pose estimation in video with temporal convolutions and semi-supervised training.” In Proc., IEEE/CVF Conf. on Computer Vision and Pattern Recognition, 7753–7762. New York: IEEE. https://doi.org/10.1109/CVPR.2019.00794.
Sanni-Anibire, M. O., A. S. Mahmoud, M. A. Hassanain, and B. A. Salami. 2020. “A risk assessment approach for enhancing construction safety performance.” Saf. Sci. 121 (Jan): 15–29. https://doi.org/10.1016/j.ssci.2019.08.044.
Son, H., and C. Kim. 2021. “Integrated worker detection and tracking for the safe operation of construction machinery.” Autom. Constr. 126 (Jun): 103670. https://doi.org/10.1016/j.autcon.2021.103670.
Sun, C., S. Ahn, and C. R. Ahn. 2020. “Identifying workers’ safety behavior–related personality by sensing.” J. Constr. Eng. Manage. 146 (7): 04020078. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001863.
Sunindijo, R. Y., and P. X. W. Zou. 2012. “Political skill for developing construction safety climate.” J. Constr. Eng. Manage. 138 (5): 605–612. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000482.
Tanvi Newaz, M., M. Ershadi, L. Carothers, M. Jefferies, and P. Davis. 2022. “A review and assessment of technologies for addressing the risk of falling from height on construction sites.” Saf. Sci. 147 (Mar): 105618. https://doi.org/10.1016/j.ssci.2021.105618.
Van Aken, J. E. 2005. “Management research as a design science: Articulating the research products of mode 2 knowledge production in management.” Br. J. Manage. 16 (1): 19–36. https://doi.org/10.1111/j.1467-8551.2005.00437.x.
Wang, L., T. Tan, H. Z. Ning, and W. M. Hu. 2003. “Silhouette analysis-based gait recognition for human identification.” IEEE Trans. Pattern Anal. Mach. Intell. 25 (12): 1505–1518. https://doi.org/10.1109/TPAMI.2003.1251144.
Wei, R., P. E. D. Love, W. Fang, H. Luo, and S. Xu. 2019. “Recognizing people’s identity in construction sites with computer vision: A spatial and temporal attention pooling network.” Adv. Eng. Inf. 42 (Oct): 100981. https://doi.org/10.1016/j.aei.2019.100981.
Xia, X., T. Zhou, J. Du, and N. Li. 2022. “Human motion prediction for intelligent construction: A review.” Autom. Constr. 142 (Oct): 104497. https://doi.org/10.1016/j.autcon.2022.104497.
Xu, W., and T. K. Wang. 2023. “Construction worker safety prediction and active warning based on computer vision and the gray absolute decision analysis method.” J. Constr. Eng. Manage. 149 (4): 04023014. https://doi.org/10.1061/JCEMD4.COENG-12695.
Yan, H., C. Gao, H. Elzarka, K. Mostafa, and W. Tang. 2019. “Risk assessment for construction of urban rail transit projects.” Saf. Sci. 118: 583–594. https://doi.org/10.1016/j.ssci.2019.05.042.
Yan, X., H. Zhang, and H. Li. 2020. “Computer vision-based recognition of 3D relationship between construction entities for monitoring struck-by accidents.” Comput.-Aided Civ. Infrastruct. Eng. 35 (9): 1023–1038. https://doi.org/10.1111/mice.12536.
Yang, K., C. R. Ahn, and H. Kim. 2019. “Validating ambulatory gait assessment technique for hazard sensing in construction environments.” Autom. Constr. 98 (Feb): 302–309. https://doi.org/10.1016/j.autcon.2018.09.017.
Yang, K., C. R. Ahn, M. C. Vuran, and H. Kim. 2017. “Collective sensing of workers’ gait patterns to identify fall hazards in construction.” Autom. Constr. 82 (Oct): 166–178. https://doi.org/10.1016/j.autcon.2017.04.010.
Yu, Y., W. Umer, X. Yang, and M. F. Antwi-Afari. 2021. “Posture-related data collection methods for construction workers: A review.” Autom. Constr. 124 (Apr): 103538. https://doi.org/10.1016/j.autcon.2020.103538.
Zhang, H., X. Yan, H. Li, R. Jin, and H. Fu. 2019. “Real-time alarming, monitoring, and locating for non-hard-hat use in construction.” J. Constr. Eng. Manage. 145 (3): 04019006. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001629.
Zhang, M., and D. Fang. 2013. “A continuous behavior-based safety strategy for persistent safety improvement in construction industry.” Autom. Constr. 34 (Sep): 101–107. https://doi.org/10.1016/j.autcon.2012.10.019.
Zhang, X. G., Q. N. Yu, and Y. X. Wang. 2020. “Fuzzy evaluation of crowd safety based on pedestrians’ number and distribution entropy.” Entropy 22 (8): 832. https://doi.org/10.3390/e22080832.
Information & Authors
Information
Published In
Journal of Construction Engineering and Management
Volume 150 • Issue 7 • July 2024
Copyright
© 2024 American Society of Civil Engineers.
History
Received: Feb 8, 2023
Accepted: Jan 4, 2024
Published online: May 8, 2024
Published in print: Jul 1, 2024
Discussion open until: Oct 8, 2024
ASCE Technical Topics:
- Business management
- Construction engineering
- Construction management
- Continuum mechanics
- Disaster risk management
- Dynamics (solid mechanics)
- Engineering mechanics
- Human and behavioral factors
- Motion (dynamics)
- Occupational safety
- Practice and Profession
- Public administration
- Public health and safety
- Risk management
- Safety
- Solid mechanics
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.