Joint-Level Vision-Based Ergonomic Assessment Tool for Construction Workers
Publication: Journal of Construction Engineering and Management
Volume 145, Issue 5
Abstract
Construction workers are commonly subjected to ergonomic risks. Accurate ergonomic assessment is needed to reduce ergonomic risks. However, the diverse and dynamic nature of construction sites makes it difficult to collect workers posture data for ergonomic assessment without intrusiveness. Therefore, this paper proposed a joint-level vision-based ergonomic assessment tool for construction workers (JVEC) to provide automatic and detailed ergonomic assessments of construction workers based on construction videos. JVEC extracts construction workers’ skeleton data from videos with advanced deep learning methods, then Rapid Entire Body Assessment (REBA) is used to conduct the joint-level ergonomic assessment. This approach was demonstrated and tested with a laboratory experiment and an on-site experiment, which indicated the accuracy of the ergonomic risk scores (70%–96%) and its feasibility for use on construction sites. This research contributes to an accurate and nonintrusive ergonomic assessment method for construction workers. In addition, this research for the first time introduces two-dimensional (2D) video–based three-dimensional (3D) pose estimation algorithms to the construction industry, which may benefit research on construction health, safety, and productivity by providing long-term and accurate behavior data.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Data generated or analyzed during the study are available from the corresponding author by request. Information about the Journal’s data-sharing policy can be found here: http://ascelibrary.org/doi/10.1061/(ASCE)CO.1943-7862.0001263.
References
Åhsberg, E., and F. Gamberale. 1998. “Perceived fatigue during physical work: An experimental evaluation of a fatigue inventory.” Int. J. Ind. Ergon. 21 (2): 117–131. https://doi.org/10.1016/S0169-8141(96)00071-6.
Alavinia, S. M., C. van Duivenbooden, and A. Burdorf. 2007. “Influence of work-related factors and individual characteristics on work ability among Dutch construction workers.” Scand. J. Work Environ. Health 33 (5): 351–357. https://doi.org/10.5271/sjweh.1151.
Alwasel, A., E. M. Abdel-Rahman, C. T. Haas, and S. Lee. 2017. “Experience, productivity, and musculoskeletal injury among masonry workers.” J. Constr. Eng. Manage. 143 (6): 5017003. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001308.
Antwi-Afari, M. F., H. Li, D. J. Edwards, E. A. Pärn, J. Seo, and A. Y. L. Wong. 2017. “Biomechanical analysis of risk factors for work-related musculoskeletal disorders during repetitive lifting task in construction workers.” Autom. Constr. 83: 41–47. https://doi.org/10.1016/j.autcon.2017.07.007.
Borg, G. 1998. Borg’s perceived exertion and pain scales. Champaign, IL: Human Kinetics.
Cao, Z., T. Simon, S.-E. Wei, and Y. Sheikh. 2017. “Real-time multi-person 2D pose estimation using part affinity fields.” In Vol. 1 of Proc., IEEE Conf. on Computer Vision and Pattern Recognition, 7291–7299. New York: IEEE.
Cheng, T., J. Teizer, G. C. Migliaccio, and U. C. Gatti. 2013. “Automated task-level activity analysis through the fusion of real-time location sensors and worker’s thoracic posture data.” Autom. Constr. 29: 24–39. https://doi.org/10.1016/j.autcon.2012.08.003.
Chu, X., W. Yang, W. Ouyang, C. Ma, A. L. Yuille, and X. Wang. 2017. “Multi-context attention for human pose estimation.” Preprint, submitted on February 24, 2017. http://arxiv.org/abs/1702.07432.
Corlett, E. N., and R. P. Bishop. 1976. “A technique for assessing postural discomfort.” Ergonomics 19 (2): 175–182. https://doi.org/10.1080/00140137608931530.
Dutta, T. 2012. “Evaluation of the Kinect™ sensor for 3-D kinematic measurement in the workplace.” Appl. Ergon. 43 (4): 645–649. https://doi.org/10.1016/j.apergo.2011.09.011.
Entzel, P., J. Albers, and L. Welch. 2007. “Best practices for preventing musculoskeletal disorders in masonry: Stakeholder perspectives.” Appl. Ergon. 38 (5): 557–566. https://doi.org/10.1016/j.apergo.2006.08.004.
Golabchi, A., S. Han, and A. R. Fayek. 2016. “A fuzzy logic approach to posture-based ergonomic analysis for field observation and assessment of construction manual operations.” Can. J. Civ. Eng. 43 (4): 294–303. https://doi.org/10.1139/cjce-2015-0143.
Grinciunaite, A., A. Gudi, E. Tasli, and M. den Uyl. 2016. “Human pose estimation in space and time using 3D CNN.” In Proc., European Conf. on Computer Vision, 32–39. Cham, Switzerland: Springer.
Han, S. U., S. H. Lee, and F. Pena-Mora. 2012. “A machine-learning classification approach to automatic detection of workers’ actions for behavior-based safety analysis.” In Proc., 2012 ASCE Int. Conf. on Computing in Civil Engineering, edited by R. R. Issa and I. Flood. Reston, VA: ASCE.
Han, S., S. Lee, and F. Pena-Mora. 2013. “Vision-based detection of unsafe actions of a construction worker: A case study of ladder climbing.” J. Comput. Civ. Eng. 27 (6): 635–644. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000279.
Hignett, S., and L. McAtamney. 2000. “Rapid entire body assessment (REBA).” Appl. Ergon. 31 (2): 201–205. https://doi.org/10.1016/S0003-6870(99)00039-3.
Hwang, S., J. Seo, H. Jebelli, and S. Lee. 2016. “Feasibility analysis of heart rate monitoring of construction workers using a photoplethysmography (PPG) sensor embedded in a wristband-type activity tracker.” Autom. Constr. 71 (Part 2): 372–381. https://doi.org/10.1016/j.autcon.2016.08.029.
Karhu, O., R. Härkönen, P. Sorvali, and P. Vepsäläinen. 1981. “Observing working postures in industry: Examples of OWAS application.” Appl. Ergon. 12 (1): 13–17. https://doi.org/10.1016/0003-6870(81)90088-0.
Kim, I.-J. 2017. “The role of ergonomics for construction industry safety and health improvements.” J. Ergon. 7 (2): 1000e166. https://doi.org/10.4172/2165-7556.1000e166.
Kulkarni, V. S., and R. V. Devalkar. 2018. “Postural analysis of building construction workers using ergonomics.” Int. J. Constr. Manage. 18 (2): 1–8. https://doi.org/10.1080/15623599.2018.1452096.
Legnani, G., F. Casolo, P. Righettini, and B. Zappa. 1996. “A homogeneous matrix approach to 3D kinematics and dynamics—I. Theory.” Mech. Mach. Theory 31 (5): 573–587. https://doi.org/10.1016/0094-114X(95)00100-D.
Li, X., S. Han, M. Gül, M. Al-Hussein, and M. El-Rich. 2018. “3D visualization-based ergonomic risk assessment and work modification framework and its validation for a lifting task.” J. Constr. Eng. Manage. 144 (1): 4017093. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001412.
Lowe, B. D. 2004. “Accuracy and validity of observational estimates of wrist and forearm posture.” Ergonomics 47 (5): 527–554. https://doi.org/10.1080/00140130310001653057.
McAtamney, L., and E. Nigel Corlett. 1993. “RULA: A survey method for the investigation of work-related upper limb disorders.” Appl. Ergon. 24 (2): 91–99. https://doi.org/10.1016/0003-6870(93)90080-S.
Nath, N. D., R. Akhavian, and A. H. Behzadan. 2017. “Ergonomic analysis of construction worker’s body postures using wearable mobile sensors.” Appl. Ergon. 62: 107–117. https://doi.org/10.1016/j.apergo.2017.02.007.
Newell, A., K. Yang, and J. Deng. 2016. “Stacked hourglass networks for human pose estimation.” In Proc., European Conf. on Computer Vision, 483–499. Cham, Switzerland: Springer.
Ning, X., and G. Guo. 2013. “Assessing spinal loading using the Kinect depth sensor: A feasibility study.” IEEE Sens. J. 13 (4): 1139–1140. https://doi.org/10.1109/JSEN.2012.2230252.
Nunes, J. F., P. M. Moreira, and J. M. R. S. Tavares. 2011. “Human motion analysis and simulation tools.” In Handbook of research on computational simulation and modeling in engineering, edited by O. T. Institute, 359–388. Washington, DC: Occupational Safety and Health Administration Training Institute.
Punnett, L., and D. H. Wegman. 2004. “Work-related musculoskeletal disorders: The epidemiologic evidence and the debate.” J. Electromyography Kinesiology 14 (1): 13–23. https://doi.org/10.1016/j.jelekin.2003.09.015.
Ray, S. J., and J. Teizer. 2012. “Real-time construction worker posture analysis for ergonomics training.” Adv. Eng. Inf. 26 (2): 439–455. https://doi.org/10.1016/j.aei.2012.02.011.
Sedighi Maman, Z., M. A. Alamdar Yazdi, L. A. Cavuoto, and F. M. Megahed. 2017. “A data-driven approach to modeling physical fatigue in the workplace using wearable sensors.” Appl. Ergon. 65: 515–529. https://doi.org/10.1016/j.apergo.2017.02.001.
Seo, J., S. Han, S. Lee, and H. Kim. 2015. “Computer vision techniques for construction safety and health monitoring.” Adv. Eng. Inf. 29 (2): 239–251. https://doi.org/10.1016/j.aei.2015.02.001.
Seo, J., S. Lee, and J. Seo. 2016a. “Simulation-based assessment of workers’ muscle fatigue and its impact on construction operations.” J. Constr. Eng. Manage. 142 (11): 04016063. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001182.
Seo, J., K. Yin, and S. Lee. 2016b. “Automated postural ergonomic assessment using a computer vision-based posture classification.” In Construction Research Congress 2016, 809–818. Reston, VA: ASCE.
Umer, W., H. Li, G. P. Y. Szeto, and A. Y. L. Wong. 2017. “Identification of biomechanical risk factors for the development of lower-back disorders during manual rebar tying.” J. Constr. Eng. Manage. 143 (1): 04016080. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001208.
US Bureau of Labor Statistics. 2016. “Nonfatal occupational injuries and illnesses resulting in days away from work in 2016.” Accessed April 27, 2018. https://www.bls.gov/opub/ted/2017/nonfatal-occupational-injuries-and-illnesses-resulting-in-days-away-from-work-in-2016.htm?view_full.
Valero, E., A. Sivanathan, F. Bosché, and M. Abdel-Wahab. 2016. “Musculoskeletal disorders in construction: A review and a novel system for activity tracking with body area network.” Appl. Ergon. 54: 120–130. https://doi.org/10.1016/j.apergo.2015.11.020.
Wang, D., F. Dai, and X. Ning. 2015. “Risk assessment of work-related musculoskeletal disorders in construction: State-of-the-art review.” J. Constr. Eng. Manage. 141 (6): 04015008. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000979.
Wiktorin, C., L. Karlqvist, and J. Winkel. 1993. “Validity of self-reported exposures to work postures and manual materials handling. Stockholm MUSIC I Study Group.” Scand. J. Work Environ. Health 19 (3): 208–214. https://doi.org/10.5271/sjweh.1481.
Yan, X., H. Li, C. Wang, J. Seo, H. Zhang, and H. Wang. 2017. “Development of ergonomic posture recognition technique based on 2D ordinary camera for construction hazard prevention through view-invariant features in 2D skeleton motion.” Adv. Eng. Inf. 34: 152–163. https://doi.org/10.1016/j.aei.2017.11.001.
Yoo, J. H. 2017. “Large-scale video classification guided by batch normalized LSTM translator.” Preprint, submitted July 13, 2017. http://arxiv.org/abs/1707.04045.
Yost Labs. 2017. “3-space™ sensors.” Accessed April 19, 2018. https://yostlabs.com/3-space-sensors/.
Yu, Y., H. Guo, Q. Ding, H. Li, and M. Skitmore. 2017. “An experimental study of real-time identification of construction workers’ unsafe behaviors.” Autom. Constr. 82: 193–206. https://doi.org/10.1016/j.autcon.2017.05.002.
Zhou, X., Q. Huang, X. Sun, X. Xue, and Y. Wei. 2017. “Towards 3D human pose estimation in the wild: A weakly-supervised approach.” In Proc., IEEE Int. Conf. on Computer Vision. New York: IEEE.
Zhu, G., and L. Cao. 2014. “Human motion recognition based on skeletal information of Kinect sensor.” Comput. Simul. 31 (12): 329–333.
Information & Authors
Information
Published In
Journal of Construction Engineering and Management
Volume 145 • Issue 5 • May 2019
Copyright
©2019 American Society of Civil Engineers.
History
Received: Feb 2, 2018
Accepted: Oct 17, 2018
Published online: Feb 22, 2019
Published in print: May 1, 2019
Discussion open until: Jul 22, 2019
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.