Assessing Workers’ Operational Postures via Egocentric Camera Mapping
Publication: Computing in Civil Engineering 2023
ABSTRACT
Construction tasks involve extensive and repetitive physically demanding activities, which results in a higher risk of work-related musculoskeletal disorders (WMSDs) compared to other industries. Thus, assessing construction workers’ postural ergonomics during construction occupational tasks is critical to evaluating workers’ postural stresses and reducing the potential risk of WMSDs. Recent developments in machine learning-based computer vision methods have attracted an increasing attention of construction researchers as it is an effective tool for assessing postural ergonomics. However, existing computer vision-based ergonomic assessments in the construction research field are still mainly based on multiple-view motion tracking systems or fixed-position stand-alone cameras. These types of motion-tracking methods are limited by resource-expensive and serious occlusion issues. As an alternative approach, this paper proposes an economical and scalable machine learning enabled egocentric postural ergonomic assessment (EPEA) system that integrates the fisheye camera mounted to the hard hat to identify and assess workers’ postural ergonomics via a convolutional 3D pose estimation neural network. We tested the EPEA with multiple construction operational tasks. Results show that the EPEA can correctly identify users’ key joint parts and classify different postures. The results confirmed the usability and feasibility of the proposed system, and it has the potential to help construction workers to identify the potential WMSDs risks during repetitive and forceful construction works.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Ahuja, K., Shen, V., Fang, C. M., Riopelle, N., Kong, A., and Harrison, C. “ControllerPose: Inside-Out Body Capture with VR Controller Cameras.” Proc., CHI Conference on Human Factors in Computing Systems, 1–13.
Alwasel, A., Elrayes, K., Abdel-Rahman, E., and Haas, C. (2011). Sensing Construction Work-Related Musculoskeletal Disorders (WMSDs).
BLS. (2021). “32 percent of nonfatal injuries resulting in days away from work treated in emergency room in 2019.” <https://www.bls.gov/opub/ted/2021/32-percent-of-nonfatal-injuries-resulting-in-days-away-from-work-treated-in-emergency-room-in-2019.htm>. (March 13, 2023).
Chen, D., Cai, Y., Cui, J., Chen, J., Jiang, H., and Huang, M.-C. (2018). “Risk factors identification and visualization for work-related musculoskeletal disorders with wearable and connected gait analytics system and kinect skeleton models.” Smart Health, 7, 60–77.
Cho, Y. K., Kim, K., Ma, S., and Ueda, J. “A robotic wearable exoskeleton for construction worker’s safety and health.” Proc., ASCE construction research congress, 19–28.
Contributors, M. (2020). “Openmmlab pose estimation toolbox and benchmark.” URL: https://github.com/open-mmlab/mmpose.
Dong, S., and Kamat, V. R. (2013). “SMART: scalable and modular augmented reality template for rapid development of engineering visualization applications.” Visualization in Engineering, 1(1), 1–17.
Feamster, N., and Balakrishnan, H. “Packet loss recovery for streaming video.” Proc., 12th International Packet Video Workshop, PA: Pittsburgh, 9–16.
Flynn, N. (December 14, 2021). “The High Frequency of Musculoskeletal Disorders Among Construction Workers.” <https://mdanderson.libanswers.com/faq/26219>. (DEC 14, 2022).
Furini, M., and Ghini, V. “A video frame dropping mechanism based on audio perception.” Proc., IEEE Global Telecommunications Conference Workshops, 2004. GlobeCom Workshops 2004., IEEE, 211–216.
Han, S., and Lee, S. (2013). “A vision-based motion capture and recognition framework for behavior-based safety management.” Automat Constr, 35, 131–141.
Han, S., Lee, S., and Peña-Mora, F. (2013). “Vision-based detection of unsafe actions of a construction worker: Case study of ladder climbing.” Journal of Computing in Civil Engineering, 27(6), 635–644.
Jiang, H., and Grauman, K. “Seeing invisible poses: Estimating 3d body pose from egocentric video.” Proc., 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, 3501–3509.
Kwon, Y.-J., Kim, D.-H., Son, B.-C., Choi, K.-H., Kwak, S., and Kim, T. (2022). “A Work-Related Musculoskeletal Disorders (WMSDs) Risk-Assessment System Using a Single-View Pose Estimation Model.” International Journal of Environmental Research and Public Health, 19(16), 9803.
Lam, K.-Y., Yuen, J., Son, S. H., and Chan, E. “Scheduling video stream transmissions for distributed playback over mobile cellular networks.” Proc., Ninth International Conference on Parallel and Distributed Systems, 2002. Proceedings., IEEE, 363–368.
Li, C., and Kitani, K. M. “Model recommendation with virtual probes for egocentric hand detection.” Proc., Proceedings of the IEEE International Conference on Computer Vision, 2624–2631.
Li, G., and Buckle, P. (1999). “Current techniques for assessing physical exposure to work-related musculoskeletal risks, with emphasis on posture-based methods.” Ergonomics, 42(5), 674–695.
Ning, X., and Guo, G. (2012). “Assessing spinal loading using the Kinect depth sensor: A feasibility study.” IEEE Sensors journal, 13(4), 1139–1140.
Ray, S. J., and Teizer, J. (2012). “Real-time construction worker posture analysis for ergonomics training.” Advanced Engineering Informatics, 26(2), 439–455.
Reddy, G. M., Nisha, B., Prabhushankar, T. G., and Vishwambhar, V. (2016). “Musculoskeletal morbidity among construction workers: A cross-sectional community-based study.” Indian journal of occupational and environmental medicine, 20(3), 144.
Rhodin, H., Richardt, C., Casas, D., Insafutdinov, E., Shafiei, M., Seidel, H.-P., Schiele, B., and Theobalt, C. (2016). “Egocap: egocentric marker-less motion capture with two fisheye cameras.” ACM Transactions on Graphics (TOG), 35(6), 1–11.
Roetenberg, D., Luinge, H., and Slycke, P. (2009). “Xsens MVN: Full 6DOF human motion tracking using miniature inertial sensors.”, 1, 1-7.
Rogez, G., Supancic, J. S., and Ramanan, D. “First-person pose recognition using egocentric workspaces.” Proc., Proceedings of the IEEE conference on computer vision and pattern recognition, 4325–4333.
Wang, D., Dai, F., and Ning, X. (2015). “Risk Assessment of Work-Related Musculoskeletal Disorders in Construction: State-of-the-Art Review.” Journal of Construction Engineering and Management, 141(6), 04015008.
Wang, M., Wong, P., Luo, H., Kumar, S., Delhi, V., and Cheng, J. “Predicting safety hazards among construction workers and equipment using computer vision and deep learning techniques.” Proc., ISARC. Proceedings of the International Symposium on Automation and Robotics in Construction, IAARC Publications, 399–406.
Warren, J. (2017). “FisheyeGl.” <https://github.com/jywarren/fisheyegl>. (3/11/2023).
Xu, W., Chatterjee, A., Zollhoefer, M., Rhodin, H., Fua, P., Seidel, H.-P., and Theobalt, C. (2019). “Mo 2 cap 2: Real-time mobile 3d motion capture with a cap-mounted fisheye camera.” IEEE transactions on visualization and computer graphics, 25(5), 2093–2101.
Yan, X., Li, H., Wang, C., Seo, J., Zhang, H., and Wang, H. (2017). “Development of ergonomic posture recognition technique based on 2D ordinary camera for construction hazard prevention through view-invariant features in 2D skeleton motion.” Advanced Engineering Informatics, 34, 152–163.
Yu, Y., Li, H., Yang, X., and Umer, W. “Estimating construction workers’physical workload by fusing computer vision and smart insole technologies.” Proc., ISARC. Proceedings of the International Symposium on Automation and Robotics in Construction, IAARC Publications, 1–8.
Information & Authors
Information
Published In
Computing in Civil Engineering 2023
Pages: 17 - 24
History
Published online: Jan 25, 2024
ASCE Technical Topics:
- Artificial intelligence and machine learning
- Business management
- Cameras
- Computer programming
- Computer vision and image processing
- Computing in civil engineering
- Construction equipment
- Disaster risk management
- Employment
- Engineering fundamentals
- Equipment and machinery
- Labor
- Methodology (by type)
- Personnel management
- Practice and Profession
- Risk management
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.