Proximity Activity Intensity Identification System in Hot and Humid Weather Conditions: Development and Implementation
Publication: Journal of Construction Engineering and Management
Volume 149, Issue 12
Abstract
Construction workers are exposed to heat stress risks due to the combined effects of hot and humid weather conditions (HHWCs) and physically demanding work. A real-time activity intensity identification (AII) is required to measure the impact of HHWCs using a nonintrusive approach. This research developed a real-time AII system based on computer vision analysis (CVA). It then combined the CVA system with real-time video recordings to approximate workers’ activity intensity (AI) levels alongside HHWC records. A fundamental activities matrix was developed to build a list of measurable and identifiable features of site activities. These features were used to identify and link different postures to a crew’s AI and safety status within a given context. In real-site conditions, the AII system instantly and unobtrusively approximated workers’ AI and safety status under HHWCs. The system showed high detection performance with competitive deployment time, cost, and effort, outperforming previous related models. The results showed that formwork and steelwork are mostly moderate activities; however, moderate AI and HHWCs can create heat stress and fatigue and significantly affect workers’ safety, resulting in heat-related injuries and accidents. This research gives researchers and practitioners insight into the challenges associated with measurement methods and solving practical site measurement issues. This research promotes innovative methods for real-site measurements and contributes to knowledge in the field of safety and productivity in the construction industry by employing new, innovative CVA technology. This technology has applications in the industry by deploying a practical tool that could support aligned improvement in the safety and productivity of construction workers working under HHWCs.
Practical Applications
The challenges of automated and real-time measurements have always been of great interest to construction safety and productivity practitioners, particularly measurements of nonintrusive systems and competitive deployment time, cost, and effort. Such problems have also resulted in a substantial delay in making safety- and productivity-related decisions, which are major reasons for the increasing number of hot and humid weather–related injuries and incidents, particularly with the growing threat of global warming. Furthermore, under HHWCs, construction companies have also incurred significant productivity losses. This study offers an automated, nonintrusive, real-time measuring system with competitive deployment time, cost, and effort to monitor activity intensity and weather-related risks. Hence, site decision makers can make timely safety- and productivity-related decisions to improve work safety and productivity.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or codes that support the findings of this study are available from the corresponding author upon reasonable request. Site information that could lead to the disclosure of the identity of the construction projects, companies, and workers has been restricted according to human ethics approval for this research.
Acknowledgments
The authors would like to acknowledge the Queensland University of Technology (QUT) for providing a Ph.D. scholarship to facilitate this research. They also acknowledge the QUT’s High-Performance Centre (HPC) for providing access to ample data storage and computational resources. The authors are very thankful to Dr. Miljenka Perovic and Mr. Nathan Sianidis for their support in data collection.
References
Abadi, M., A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, G. S. Corrado, A. Davis, J. Dean, and M. Devin. 2016. “Tensorflow: Large-scale machine learning on heterogeneous distributed systems.” Preprint, submitted August 13, 2018. http://arxiv.org/abs/1603.04467.
ABC News. 2017. “Brisbane’s UV index today.” Accessed January 18, 2017. https://www.abc.net.au/news/2017-01-18/uv-rating-180117/8192094.
Al-Ashaik, R. A., M. Z. Ramadan, K. S. Al-Saleh, and T. M. Khalaf. 2015. “Effect of safety shoes type, lifting frequency, and ambient temperature on subject’s MAWL and physiological responses.” Int. J. Ind. Ergon. 50 (Nov): 43–51. https://doi.org/10.1016/j.ergon.2015.09.002.
Al-Bouwarthan, M., M. M. Quinn, D. Kriebel, and D. H. Wegman. 2019. “Assessment of heat stress exposure among construction workers in the hot desert climate of Saudi Arabia.” Ann. Work Exposures Health 63 (5): 505–520. https://doi.org/10.1093/annweh/wxz033.
Awolusi, I., E. Marks, and M. Hallowell. 2018. “Wearable technology for personalized construction safety monitoring and trending: Review of applicable devices.” Autom. Constr. 85 (Jan): 96–106. https://doi.org/10.1016/j.autcon.2017.10.010.
Bates, G. P., and J. Schneider. 2008. “Hydration status and physiological workload of UAE construction workers: A prospective longitudinal observational study.” J. Occup. Med. Toxicol. 3 (1): 21. https://doi.org/10.1186/1745-6673-3-21.
BSI (British Standards Institution). 2017. Ergonomics of the thermal environment. Assessment of heat stress using the WBGT (wet bulb globe temperature) index. BS EN ISO 7243:2017. London: BSI.
Carter, S., E. Field, E. Oppermann, and M. Brearley. 2020. “The impact of perceived heat stress symptoms on work-related tasks and social factors: A cross-sectional survey of Australia’s Monsoonal North.” Appl. Ergon. 82 (Jan): 102918. https://doi.org/10.1016/j.apergo.2019.102918.
Chan, A. P. C., M. C. H. Yam, J. W. Y. Chung, and W. Yi. 2012. “Developing a heat stress model for construction workers.” J. Facil. Manage. 10 (1): 59–74. https://doi.org/10.1108/14725961211200405.
Chan, A. P. C., and Y. Yang. 2016. “Practical on-site measurement of heat strain with the use of a perceptual strain index.” Int. Arch. Occup. Environ. Health 89 (2): 299–306. https://doi.org/10.1007/s00420-015-1073-7.
Chan, A. P. C., Y. Yang, W.-F. Song, and D. P. Wong. 2017. “Hybrid cooling vest for cooling between exercise bouts in the heat: Effects and practical considerations.” J. Therm. Biol. 63 (Jan): 1–9. https://doi.org/10.1016/j.jtherbio.2016.11.002.
Chen, L., and Y. Wang. 2017. “Automatic key frame extraction in continuous videos from construction monitoring by using color, texture, and gradient features.” Autom. Constr. 81 (Sep): 355–368. https://doi.org/10.1016/j.autcon.2017.04.004.
Chi, S., and C. H. Caldas. 2011. “Automated object identification using optical video cameras on construction sites.” Comput.-Aided Civ. Infrastruct. Eng. 26 (5): 368–380. https://doi.org/10.1111/j.1467-8667.2010.00690.x.
Dimitrov, A., and M. Golparvar-Fard. 2014. “Vision-based material recognition for automated monitoring of construction progress and generating building information modeling from unordered site image collections.” Adv. Eng. Inf. 28 (1): 37–49. https://doi.org/10.1016/j.aei.2013.11.002.
Fang, Q., H. Li, X. Luo, L. Ding, H. Luo, T. M. Rose, and W. An. 2018. “Detecting non-hardhat-use by a deep learning method from far-field surveillance videos.” Autom. Constr. 85 (Jan): 1–9. https://doi.org/10.1016/j.autcon.2017.09.018.
Gay, J. L., D. M. Buchner, J. Smith, and C. He. 2017. “An examination of compensation effects in accelerometer-measured occupational and non-occupational physical activity.” Prev. Med. Rep. 8 (Dec): 55–59. https://doi.org/10.1016/j.pmedr.2017.07.013.
Goldsborough, P. 2016. “A tour of tensorflow.” Preprint, submitted October 1, 2016. http://arxiv.org/abs/1610.01178.
Guo, H., Y. Yu, and M. Skitmore. 2017. “Visualization technology-based construction safety management: A review.” Autom. Constr. 73 (Jan): 135–144. https://doi.org/10.1016/j.autcon.2016.10.004.
Han, S., and S. Lee. 2013. “A vision-based motion capture and recognition framework for behavior-based safety management.” Autom. Constr. 35 (Nov): 131–141. https://doi.org/10.1016/j.autcon.2013.05.001.
He, M., Z. Li, Y. Wei, J. Ge, P. Ling, C. Li, T. Lei, and B. Luo. 2019. Evaluation system for reasoning description of judgment documents based on tensorflow CNN. Singapore: Springer Singapore.
Hills, A. P., N. Mokhtar, and N. M. Byrne. 2014. “Assessment of physical activity and energy expenditure: An overview of objective measures.” Front. Nutr. 1 (Jun): 5.
Hsie, M., W.-T. Hsiao, T.-M. Cheng, and H.-C. Chen. 2009. “A model used in creating a work-rest schedule for laborers.” Autom. Constr. 18 (6): 762–769. https://doi.org/10.1016/j.autcon.2009.02.010.
Huang, J., et al. 2017. “Speed/accuracy trade-offs for modern convolutional object detectors.” In Proc., 2017 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). New York: IEEE.
Jia, A. Y., S. Rowlinson, M. Loosemore, M. Xu, B. Li, and A. Gibb. 2017. “Institutions and institutional logics in construction safety management: The case of climatic heat stress.” Construct. Manage. Econ. 35 (6): 338–367. https://doi.org/10.1080/01446193.2017.1296171.
Jia, Y. A., S. Rowlinson, and M. Ciccarelli. 2016. “Climatic and psychosocial risks of heat illness incidents on construction site.” Appl. Ergon. 53 (Mar): 25–35. https://doi.org/10.1016/j.apergo.2015.08.008.
Joshua, L., and K. Varghese. 2014. “Automated recognition of construction labour activity using accelerometers in field situations.” Int. J. Prod. Perform. Manage. 63 (7): 841–862. https://doi.org/10.1108/IJPPM-05-2013-0099.
Khosrowpour, A., I. Fedorov, A. Holynski, J. C. Niebles, and M. Golparvar-Fard. 2014. “Automated worker activity analysis in indoor environments for direct-work rate improvement from long sequences of RGB-D images.” In Proc., Construction Research Congress 2014: Construction in a Global Network, 729–738. Atlanta, GA: Construction Research Congress 2014. https://doi.org/10.1061/9780784413517.075.
Konstantinou, E., and I. Brilakis. 2018. “Matching construction workers across views for automated 3D vision tracking on-site.” J. Constr. Eng. Manage. 144 (7): 04018061. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001508.
Lee, W., K.-Y. Lin, E. Seto, and G. C. Migliaccio. 2017. “Wearable sensors for monitoring on-duty and off-duty worker physiological status and activities in construction.” Autom. Constr. 83 (Nov): 341–353. https://doi.org/10.1016/j.autcon.2017.06.012.
Lee, W., and G. C. Migliaccio. 2016. “Physiological cost of concrete construction activities.” Constr. Innovation 16 (3): 281–306. https://doi.org/10.1108/CI-10-2015-0051.
Lee, W., G. C. Migliaccio, K.-Y. Lin, and E. Y. W. Seto. 2020. “Workforce development: Understanding task-level job demands-resources, burnout, and performance in unskilled construction workers.” Saf. Sci. 123 (Mar): 104577. https://doi.org/10.1016/j.ssci.2019.104577.
Li, X., K. H. Chow, Y. Zhu, and Y. Lin. 2016. “Evaluating the impacts of high-temperature outdoor working environments on construction labor productivity in China: A case study of rebar workers.” Build. Environ. 95 (Jan): 42–52. https://doi.org/10.1016/j.buildenv.2015.09.005.
Liu, X., Y. Song, W. Yi, X. Wang, and J. Zhu. 2018. “Comparing the random forest with the generalized additive model to evaluate the impacts of outdoor ambient environmental factors on scaffolding construction productivity.” J. Constr. Eng. Manage. 144 (6): 04018037. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001495.
Luo, X., H. Li, D. Cao, F. Dai, J. Seo, and S. Lee. 2018. “Recognizing diverse construction activities in site images via relevance networks of construction-related objects detected by convolutional neural networks.” J. Comput. Civ. Eng. 32 (3): 04018012. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000756.
Luo, X., H. Li, X. Yang, Y. Yu, and D. Cao. 2019. “Capturing and understanding workers’ activities in far-field surveillance videos with deep action recognition and Bayesian nonparametric learning.” Comput.-Aided Civ. Infrastruct. Eng. 34 (4): 333–351. https://doi.org/10.1111/mice.12419.
Mark, A. E., and I. Janssen. 2011. “Influence of movement intensity and physical activity on adiposity in youth.” J. Phys. Act. Health 8 (2): 164. https://doi.org/10.1123/jpah.8.2.164.
Memarzadeh, M., M. Golparvar-Fard, and J. C. Niebles. 2013. “Automated 2D detection of construction equipment and workers from site video streams using histograms of oriented gradients and colors.” Autom. Constr. 32 (Jul): 24–37. https://doi.org/10.1016/j.autcon.2012.12.002.
Miller, V. S., and G. P. Bates. 2011. “The thermal work limit is a simple reliable heat index for the protection of workers in thermally stressful environments.” Ann. Occup. Hyg. 51 (6): 553–561. https://doi.org/10.1093/annhyg/mem035.
Mohamed, S. 1999. “Empirical investigation of construction safety management activities and performance in Australia.” Saf. Sci. 33 (3): 129–142. https://doi.org/10.1016/S0925-7535(99)00028-4.
Mohamed, S., and K. Srinavin. 2005. “Forecasting labor productivity changes in construction using the PMV index.” Int. J. Ind. Ergon. 35 (4): 345–351. https://doi.org/10.1016/j.ergon.2004.09.008.
Nadhim, E. A., C. Hon, B. Xia, I. Stewart, and D. Fang. 2016. “Falls from height in the construction industry: A critical review of the scientific literature.” Int. J. Environ. Res. Public Health 13 (7): 638. https://doi.org/10.3390/ijerph13070638.
Oved, D. 2018. “Pose estimation.” Accessed January 20, 2020. https://www.tensorflow.org/lite/models/pose_estimation/overview#read_more_about_pose_estimation.
Park, H. 2019. Implementation of lane detection algorithm for self-driving vehicles using tensor flow. Cham, Switzerland: Springer.
Park, M.-W., and I. Brilakis. 2012. “Construction worker detection in video frames for initializing vision trackers.” Autom. Constr. 28 (Dec): 15–25. https://doi.org/10.1016/j.autcon.2012.06.001.
Park, M.-W., and I. Brilakis. 2016. “Continuous localization of construction workers via integration of detection and tracking.” Autom. Constr. 72 (Dec): 129–142. https://doi.org/10.1016/j.autcon.2016.08.039.
Parsons, K. 2006. “Heat stress standard ISO 7243 and its global application.” Ind. Health 44 (3): 368–379. https://doi.org/10.2486/indhealth.44.368.
Paul, R., D. Cherezov, M. Schabath, R. Gillies, L. Hall, and D. Goldgof. 2019. Towards deep radiomics: Nodule malignancy prediction using CNNs on feature images. Bellingham, WA: SPIE.
Rowlinson, S., A. YunyanJia, B. Li, and C. ChuanjingJu. 2014. “Management of climatic heat stress risk in construction: A review of practices, methodologies, and future research.” Accid. Anal. Prev. 66 (May): 187–198. https://doi.org/10.1016/j.aap.2013.08.011.
Seo, J., S. Han, S. Lee, and H. Kim. 2015. “Computer vision techniques for construction safety and health monitoring.” Adv. Eng. Inf. 29 (2): 239–251. https://doi.org/10.1016/j.aei.2015.02.001.
Shrestha, K., P. P. Shrestha, D. Bajracharya, and E. A. Yfantis. 2015. “Hard-hat detection for construction safety visualization.” J. Constr. Eng. 2015 (1): 1–8. https://doi.org/10.1155/2015/721380.
Son, H., H. Choi, H. Seong, and C. Kim. 2019. “Detection of construction workers under varying poses and changing background in image sequences via very deep residual networks.” Autom. Constr. 99 (Mar): 27–38. https://doi.org/10.1016/j.autcon.2018.11.033.
Sonmez, R., and J. E. Rowings. 1998. “Construction labor productivity modeling with neural networks.” J. Constr. Eng. Manage. 124 (6): 498–504. https://doi.org/10.1061/(ASCE)0733-9364(1998)124:6(498).
Teizer, J., and T. Cheng. 2015. “Proximity hazard indicator for workers-on-foot near miss interactions with construction equipment and geo-referenced hazard areas.” Autom. Constr. 60 (Dec): 58–73. https://doi.org/10.1016/j.autcon.2015.09.003.
Treuth, M. S., K. Schmitz, D. J. Catellier, R. G. McMurray, D. M. Murray, M. J. Almeida, S. Going, J. E. Norman, and R. Pate. 2004. “Defining accelerometer thresholds for activity intensities in adolescent girls.” Med. Sci. Sports Exercise 36 (7): 1259–1266.
Troiano, R. P., D. Berrigan, K. W. Dodd, L. C. Masse, T. Tilert, and M. McDowell. 2008. “Physical activity in the United States measured by accelerometer.” Med. Sci. Sports Exercise 40 (1): 181–188. https://doi.org/10.1249/mss.0b013e31815a51b3.
Wong, D. P. L., J. W. Y. Chung, A. P. C. Chan, F. K. W. Wong, and W. Yi. 2014. “Comparing the physiological and perceptual responses of construction workers (bar benders and bar fixers) in a hot environment.” Appl. Ergon. 45 (6): 1705–1711. https://doi.org/10.1016/j.apergo.2014.06.002.
Wongsuphasawat, K., D. Smilkov, J. Wexler, J. Wilson, D. Mané, D. Fritz, D. Krishnan, F. B. Viégas, and M. Wattenberg. 2018. “Visualizing dataflow graphs of deep learning models in tensorflow.” IEEE Trans. Visualization Comput. Graphics 24 (1): 1–12. https://doi.org/10.1109/TVCG.2017.2744878.
Xiang, J., A. Hansen, D. Pisaniello, and P. Bi. 2015. “Perceptions of workplace heat exposure and controls among occupational hygienists and relevant specialists in Australia.” PLoS One 10 (8): e0135040. https://doi.org/10.1371/journal.pone.0135040.
Yang, J., M.-W. Park, P. A. Vela, and M. Golparvar-Fard. 2015. “Construction performance monitoring via still images, time-lapse photos, and video streams: Now, tomorrow, and the future.” Adv. Eng. Inf. 29 (2): 211–224. https://doi.org/10.1016/j.aei.2015.01.011.
Yang, J., Z. Shi, and Z. Wu. 2016. “Vision-based action recognition of construction workers using dense trajectories.” Adv. Eng. Inf. 30 (3): 327–336. https://doi.org/10.1016/j.aei.2016.04.009.
Yang, Y., and A. P. C. Chan. 2015. “Perceptual strain index for heat strain assessment in an experimental study: An application to construction workers.” J. Therm. Biol. 48 (Feb): 21–27. https://doi.org/10.1016/j.jtherbio.2014.12.007.
Yang, Y., and A. P.-C. Chan. 2017. “Heat stress intervention research in construction: Gaps and recommendations.” Ind. Health 55 (3): 201–209. https://doi.org/10.2486/indhealth.2016-0047.
Yi, W., and A. P. C. Chan. 2013. “Optimizing work–rest schedule for construction rebar workers in hot and humid environment.” Build. Environ. 61 (Mar): 104–113. https://doi.org/10.1016/j.buildenv.2012.12.012.
Yi, W., and A. P. C. Chan. 2015a. “Which environmental indicator is better able to predict the effects of heat stress on construction workers?” J. Manage. Eng. 31 (4): 04014063. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000284.
Yi, W., and A. P. C. Chan. 2015b. “Optimal work pattern for construction workers in hot weather: A case study in Hong Kong.” J. Comput. Civ. Eng. 29 (5): 05014009. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000419.
Yi, W., A. P. C. Chan, X. Wang, and J. Wang. 2016. “Development of an early-warning system for site work in hot and humid environments: A case study.” Autom. Constr. 62 (Feb): 101–113. https://doi.org/10.1016/j.autcon.2015.11.003.
Yu, Y., H. Li, W. Umer, C. Dong, X. Yang, M. Skitmore, and A. Y. L. Wong. 2019. “Automatic biomechanical workload estimation for construction workers by computer vision and smart insoles.” J. Comput. Civ. Eng. 33 (3): 04019010. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000827.
Zhao, Y., W. Yi, A. P. C. Chan, and D. P. Wong. 2018. “Impacts of cooling intervention on the heat strain attenuation of construction workers.” Int. J. Biometeorol. 62 (9): 1625–1634. https://doi.org/10.1007/s00484-018-1562-y.
Zhou, Z., Y. M. Goh, and Q. Li. 2015. “Overview and analysis of safety management studies in the construction industry.” Saf. Sci. 72 (Feb): 337–350. https://doi.org/10.1016/j.ssci.2014.10.006.
Zhu, Z., X. Ren, and Z. Chen. 2017. “Integrated detection and tracking of workforce and equipment from construction jobsite videos.” Autom. Constr. 81 (Feb): 161–171. https://doi.org/10.1016/j.autcon.2017.05.005.
Information & Authors
Information
Published In
Journal of Construction Engineering and Management
Volume 149 • Issue 12 • December 2023
Copyright
© 2023 American Society of Civil Engineers.
History
Received: Nov 13, 2022
Accepted: Jul 10, 2023
Published online: Sep 25, 2023
Published in print: Dec 1, 2023
Discussion open until: Feb 25, 2024
ASCE Technical Topics:
- Analysis (by type)
- Business management
- Climates
- Computer analysis
- Computer vision and image processing
- Construction engineering
- Construction methods
- Employment
- Engineering fundamentals
- Environmental engineering
- Humidity
- Innovation
- Labor
- Meteorology
- Methodology (by type)
- Occupational safety
- Personnel management
- Practice and Profession
- Public administration
- Public health and safety
- Safety
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.