Impact of Heat Stress on Individual Cognitive States: Utilizing EEG Metrics in Immersive VR–Based Construction Safety Training
Publication: Journal of Management in Engineering
Volume 40, Issue 6
Abstract
As global warming continues, safeguarding the health and safety of construction workers in extremely hot environments becomes imperative. Real-time and quantitative assessment of workers’ cognitive states affected by heat stress is essential. Previous studies, which relied mainly on cognitive performance tests and subjective questionnaires, lacked the capability for real-time tracking of individual cognitive states. The analysis of physiological responses also faced challenges in quantitative evaluation of individual cognitive states. To address these issues, this study proposed a reliable and quantitative approach to explore the negative impact of heat stress on cognitive states such as attention, mental fatigue, and emotion, using electroencephalogram (EEG) metrics in immersive virtual reality (VR)–based construction safety training. This study recruited 20 volunteers, divided evenly between an experimental group exposed to extreme heat (36°C/70%) and a control group in moderate heat (26°C/45%). All participants experienced simulated hazardous working conditions across four distinct VR training scenarios. The findings revealed significant differences in attention control, fatigue, and arousal between the two groups, demonstrating that extreme heat impairs workers’ attention, increases fatigue, and heightens arousal. These conditions could potentially increase unsafe actions and accident rates, posing risks to construction worker safety. The identified EEG metrics provide a strategy for the real-time and quantitative evaluation of workers’ cognitive states under heat stress. Furthermore, it is expected to develop a heat stress monitoring and diagnostics framework integrating VR and augmented reality (AR) technologies to enhance worker safety in extremely hot environments.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or code that support the findings of this study are available from the corresponding author upon reasonable request. This includes ethical approval from the Incheon National University (IRB approval number: 7007971-202104-011A), raw EEG data, EEG metrics for cognitive states, and VR-based construction safety training contents.
Acknowledgments
This work was supported by an Incheon National University Research Grant in 2020 (No. 2020-0020).
References
Abbas, A., J. Seo, S. Ahn, Y. Luo, M. J. Wyllie, G. Lee, and M. Billinghurst. 2023. “How immersive virtual reality safety training system features impact learning outcomes: An experimental study of forklift training.” J. Manage. Eng. 39 (1): 04022068. https://doi.org/10.1061/(ASCE)ME.1943-5479.0001101.
Acharya, P., B. Boggess, and K. Zhang. 2018. “Assessing heat stress and health among construction workers in a changing climate: A review.” Int. J. Environ. Res. Public Health 15 (2): 247. https://doi.org/10.3390/ijerph15020247.
Al-Nafjan, A., M. Hosny, A. Al-Wabil, and Y. Al-Ohali. 2017. “Classification of human emotions from electroencephalogram (EEG) signal using deep neural network.” Int. J. Adv. Comput. Sci. Appl. 8 (9): 419–425. https://doi.org/10.14569/IJACSA.2017.080955.
Amoadu, M., E. W. Ansah, J. O. Sarfo, and T. Hormenu. 2023. “Impact of climate change and heat stress on workers’ health and productivity: A scoping review.” J. Clim. Change Health 12 (12): 100249. https://doi.org/10.1016/j.joclim.2023.100249.
Aryal, A., A. Ghahramani, and B. Becerik-Gerber. 2017. “Monitoring fatigue in construction workers using physiological measurements.” Autom. Constr. 82 (Jun): 154–165. https://doi.org/10.1016/j.autcon.2017.03.003.
Chen, Y., M. Tao, and W. Liu. 2020. “High temperature impairs cognitive performance during a moderate intensity activity.” Build. Environ. 186 (Mar): 107372. https://doi.org/10.1016/j.buildenv.2020.107372.
Cheng, B., C. Fan, H. Fu, J. Huang, H. Chen, and X. Luo. 2022. “Measuring and computing cognitive states of construction workers based on electroencephalogram: A critical review.” IEEE Trans. Comput. Social Syst. 9 (6): 1644–1659. https://doi.org/10.1109/TCSS.2022.3158585.
Cheng, S. Y., and H. T. Hsu. 2011. “Mental fatigue measurement using EEG.” In Risk management trends. London: IntechOpen.
Choi, D., and C. Koo. 2023. “Impact of personal characteristics on learning performance in virtual reality-based construction safety training–Using machine learning and SHAP.” Korean J. Constr. Eng. Manage. 24 (6): 3–11. https://doi.org/10.6106/KJCEM.2023.24.6.003.
Choi, D., S. Seo, H. Park, T. Hong, and C. Koo. 2023. “Forecasting personal learning performance in virtual reality-based construction safety training using biometric responses.” Autom. Constr. 156 (Mar): 105115. https://doi.org/10.1016/j.autcon.2023.105115.
Choi, Y., S. Seo, T. Hong, and C. Koo. 2024a. “A classification model using personal biometric characteristics to identify individuals vulnerable to an extremely hot environment.” J. Manage. Eng. 40 (2): 04024001. https://doi.org/10.1061/JMENEA.MEENG-5495.
Choi, Y., S. Seo, J. Lee, T. W. Kim, and C. Koo. 2024b. “A machine learning-based forecasting model for personal maximum allowable exposure time under extremely hot environments.” Sustainable Cities Soc. 101 (Mar): 105140. https://doi.org/10.1016/j.scs.2023.105140.
Delorme, A., T. Sejnowski, and S. Makeig. 2007. “Enhanced detection of artifacts in EEG data using higher-order statistics and independent component analysis.” Neuroimage 34 (4): 1443–1449. https://doi.org/10.1016/j.neuroimage.2006.11.004.
Fang, Q., D. Castro-Lacouture, and C. Li. 2024. “Smart safety: Big data–enabled system for analysis and management of unsafe behavior by construction workers.” J. Manage. Eng. 40 (1): 04023053. https://doi.org/10.1061/JMENEA.MEENG-5498.
Farkas, A., A. Bluschke, V. Roessner, and C. Beste. 2015. “Neurofeedback and its possible relevance for the treatment of Tourette syndrome.” Neurosci. Biobehav. Rev. 51 (Mar): 87–99. https://doi.org/10.1016/j.neubiorev.2015.01.012.
Han, Y. J., and C. H. Hong. 2017. “The effects of neurofeedback on the attention in college students with ADHD.” J. Korea Acad.-Ind. Cooperation Soc. 18 (1): 245–255. https://doi.org/10.5762/KAIS.2017.18.1.245.
Huang, K. C., C. H. Chuang, Y. K. Wang, C. Y. Hsieh, J. T. King, and C. T. Lin. 2019. “The effects of different fatigue levels on brain–behavior relationships in driving.” Brain Behav. 9 (12): e01379. https://doi.org/10.1002/brb3.1379.
Hwang, S., H. Jebelli, B. Choi, M. Choi, and S. Lee. 2018. “Measuring workers’ emotional state during construction tasks using wearable EEG.” J. Constr. Eng. Manage. 144 (7): 04018050. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001506.
ISO. 2004. Ergonomics of the thermal environment—Analytical determination and interpretation of heat stress using calculation of the predicted heat strain. ISO 7933:2004. Geneva: ISO.
Jap, B. T., S. Lal, P. Fischer, and E. Bekiaris. 2009. “Using EEG spectral components to assess algorithms for detecting fatigue.” Expert Syst. Appl. 36 (2): 2352–2359. https://doi.org/10.1016/j.eswa.2007.12.043.
Jeelani, I., K. Han, and A. Albert. 2017. “Development of immersive personalized training environment for construction workers.” In Vol. 2017 of Computing in civil engineering, 407–415. Reston, VA: ASCE.
Karthick, S., S. Kermanshachi, and A. Pamidimukkala. 2022. “Analysis of the health and safety challenges faced by construction workers in extreme hot weather conditions.” J. Leg. Aff. Disput. Resolut. Eng. Constr. 15 (1): 04522048. https://doi.org/10.1061/JLADAH.LADR-882.
Ke, J., J. Du, and X. Luo. 2021. “The effect of noise content and level on cognitive performance measured by electroencephalography (EEG).” Autom. Constr. 130 (May): 103836. https://doi.org/10.1016/j.autcon.2021.103836.
Kim, D. Y., J. H. Lee, M. H. Park, Y. H. Choi, and Y. O. Park. 2017. “Trends in brain wave signal and application technology.” Electron. Telecommun. Trends 32 (2): 19–28. https://doi.org/10.34297/AJBSR.2022.16.002258.
Kirke, A., and E. R. Miranda. 2011. Combining EEG frontal asymmetry studies with affective algorithmic composition and expressive performance models, 1–4. Ann Arbor, MI: Univ. of Michigan Library.
KMA (Korea Meteorological Administration). 2020. “Korean climate change assessment report 2020.” Accessed May 29, 2024. https://www.kma.go.kr/kma/news/press.jsp.
KOSHA (Korea Occupational Safety and Health Agency). 2019. Guide to safety of scaffolding at construction site. Ulsan, South Korea: KOSHA.
KOSHA (Korea Occupational Safety and Health Agency). 2022. “Monthly health and safety.” KOSHA Monthly Magazine. Accessed May 29, 2024. https://www.kosha.or.kr/kosha/ebook/monthly.do.
KOSHA (Korea Occupational Safety and Health Agency). 2023. “Safety and health compass for the construction industry.” Accessed May 29, 2024. https://www.kosha.or.kr/kosha/data/mediaBank_c.do.
Leder, J., T. Horlitz, P. Puschmann, V. Wittstock, and A. Schütz. 2019. “Comparing immersive virtual reality and PowerPoint as methods for delivering safety training: Impacts on risk perception, learning, and decision making.” Saf. Sci. 111 (Jan): 271–286. https://doi.org/10.1016/j.ssci.2018.07.021.
Lee, J., J. Lee, T. W. Kim, and C. Koo. 2022a. “EEG-based circumplex model of affect for identifying interindividual differences in thermal comfort.” J. Manage. Eng. 38 (4): 04022034. https://doi.org/10.1061/(ASCE)ME.1943-5479.0001061.
Lee, J., T. Wan Kim, C. Lee, and C. Koo. 2022b. “Integrated approach to evaluating the effect of indoor concentration on human cognitive performance and neural responses in office environment.” J. Manage. Eng. 38 (1): 04021085. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000993.
Li, J., Y. Ouyang, and X. Luo. 2024. “Impact of age on construction workers’ preattentive and attentive visual processing for hazard detection.” J. Manage. Eng. 40 (3): 04024008. https://doi.org/10.1061/JMENEA.MEENG-5760.
Lin, J., Y. Cai, and Q. Li. 2023. “Development of safety training in construction: Literature review, scientometric analysis, and meta-analysis.” J. Manage. Eng. 39 (6): 03123002. https://doi.org/10.1061/JMENEA.MEENG-5445.
Luo, Y., Q. Yang, J. Seo, and S. Ahn. 2024. “Theoretical framework for utilizing eye-tracking data to understand the cognitive mechanism of situational awareness in construction hazard recognition.” J. Manage. Eng. 40 (4): 04024027. https://doi.org/10.1061/JMENEA.MEENG-5905.
Mazloumi, A., F. Golbabaei, S. M. Khani, Z. Kazemi, M. Hosseini, M. Abbasinia, and S. F. Dehghan. 2014. “Evaluating effects of heat stress on cognitive function among workers in a hot industry.” Health Promot. Perspect. 4 (2): 240. https://doi.org/10.5681/hpp.2014.031.
Meyer, O. A., M. K. Omdahl, and G. Makransky. 2019. “Investigating the effect of pre-training when learning through immersive virtual reality and video: A media and methods experiment.” Comput. Educ. 140 (Oct): 103603. https://doi.org/10.1016/j.compedu.2019.103603.
Mirelman, A., I. Maidan, S. S. Shiratzky, and J. M. Hausdorff. 2020. “Virtual reality training as an intervention to reduce falls.” In Falls and cognition in older persons: Fundamentals, assessment and therapeutic options, 309–321. Cham, Switzerland: Springer.
MOEL (Ministry of Employment and Labor). 2023. “Regulations on occupational safety and health standards.” Accessed May 29, 2024. https://url.kr/62feha.
Park, H., and C. Koo. 2022. “Effect of virtual reality-based construction safety education on the learning performance of construction workers—Using CAMIL theory.” Korean J. Constr. Eng. Manage. 23 (3): 104–115. https://doi.org/10.6106/KJCEM.2022.23.3.104.
Putman, P., B. Verkuil, E. Arias-Garcia, I. Pantazi, and C. Van Schie. 2014. “EEG theta/beta ratio as a potential biomarker for attentional control and resilience against deleterious effects of stress on attention.” Cognit. Affective Behav. Neurosci. 14 (2): 782–791. https://doi.org/10.3758/s13415-013-0238-7.
Radakovic, S. S., J. Maric, M. Surbatovic, S. Radjen, E. Stefanova, N. Stankovic, and N. Filipovic. 2007. “Effects of acclimation on cognitive performance in soldiers during exertional heat stress.” Mil. Med. 172 (2): 133–136. https://doi.org/10.7205/MILMED.172.2.133.
Rastegar, Z., M. R. G. Ravandi, S. Zare, N. Khanjani, and R. Esmaeili. 2022. “Evaluating the effect of heat stress on cognitive performance of petrochemical workers: A field study.” Heliyon 8 (1): e08698. https://doi.org/10.1016/j.heliyon.2021.e08698.
Schubring, D., and H. T. Schupp. 2021. “Emotion and brain oscillations: High arousal is associated with decreases in alpha-and lower beta-band power.” Cereb. Cortex 31 (3): 1597–1608. https://doi.org/10.1093/cercor/bhaa312.
Seo, S., H. Park, and C. Koo. 2024. “Impact of interactive learning elements on personal learning performance in immersive virtual reality for construction safety training.” Expert Syst. Appl. 251 (May): 124099. https://doi.org/10.1016/j.eswa.2024.124099.
Shen, X., X. Hu, S. Liu, S. Song, and D. Zhang. 2020. “Exploring EEG microstates for affective computing: Decoding valence and arousal experiences during video watching.” In Proc., 2020 42nd Annual Int. Conf. of the IEEE Engineering in Medicine & Biology Society (EMBC), 841–846. New York: IEEE.
Shi, Y., J. Du, C. R. Ahn, and E. Ragan. 2019. “Impact assessment of reinforced learning methods on construction workers’ fall risk behavior using virtual reality.” Autom. Constr. 104 (Aug): 197–214. https://doi.org/10.1016/j.autcon.2019.04.015.
Song, C., R. Helikar, W. Smith, and T. Helikar. 2022. “DBERlibR: Automated data analysis for discipline-based education research.” In bioRxiv, 2022. Cold Spring Harbor, NY: Cold Spring Harbor Laboratory. https://doi.org/10.1101/2022.08.24.504993.
Srinivasan, K., C. G. Boulton, M. Bhattacharjee, A. Sinha, S. Loganathan, A. Seethy, S. M. Alam, and B. Hanse. 2024. “Impact of heat stress on thermal balance, hydration and cortical response among outdoor workers in hot environment—An exploratory report from north east India.” J. Basic. Clin. Physiol. Pharmacol. 35 (1–2): 79–84. https://doi.org/10.1515/jbcpp-2024-0003.
Sullivan, L. 2017. “Nonparametric tests.” Boston University School of Public Health. Accessed May 29, 2024. https://sphweb.bumc.bu.edu/otlt/mph-modules/bs/bs704_nonparametric/BS704_Nonparametric_print.html.
Sun, C., Y. Han, L. Luo, and H. Sun. 2020. “Effects of air temperature on cognitive work performance of acclimatized people in severely cold region in China.” Indoor Built Environ. 30 (6): 816–837. https://doi.org/10.1177/1420326X20913617.
Tehrani, B. M., J. Wang, and D. Truax. 2022. “Assessment of mental fatigue using electroencephalography (EEG) and virtual reality (VR) for construction fall hazard prevention.” Eng. Constr. Archit. Manage. 29 (9): 3593–3616. https://doi.org/10.1108/ECAM-01-2021-0017.
Van Doren, J., et al. 2017. “Theta/beta neurofeedback in children with ADHD: Feasibility of a short-term setting and plasticity effects.” Int. J. Psychophysiol. 112 (Jun): 80–88. https://doi.org/10.1016/j.ijpsycho.2016.11.004.
Van Son, D., F. M. De Blasio, J. S. Fogarty, A. Angelidis, R. J. Barry, and P. Putman. 2019. “Frontal EEG theta/beta ratio during mind wandering episodes.” Biol. Psychol. 140 (Jan): 19–27. https://doi.org/10.1016/j.biopsycho.2018.11.003.
Wilkins, J. R. 2011. “Construction workers’ perceptions of health and safety training programmes.” Construct. Manage. Econ. 29 (10): 1017–1026. https://doi.org/10.1080/01446193.2011.633538.
WMO (World Meteorological Organization). 2022. “State of the global climate 2021: WMO Provisional report.” Accessed May 29, 2024. https://library.wmo.int/records/item/56300-state-of-the-global-climate-2021.
Wojcik, G. M., J. Masiak, A. Kawiak, L. Kwasniewicz, P. Schneider, N. Polak, and A. Gajos-Balinska. 2018. “Mapping the human brain in frequency band analysis of brain cortex electroencephalographic activity for selected psychiatric disorders.” Front. Neuroinform. 12 (Oct): 73. https://doi.org/10.3389/fninf.2018.00073.
Wong, D. P., J. W. Chung, A. P. Chan, F. K. Wong, and W. Yi. 2014. “Comparing the physiological and perceptual responses of construction workers (bar benders and bar fixers) in a hot environment.” Appl. Ergon. 45 (6): 1705–1711. https://doi.org/10.1016/j.apergo.2014.06.002.
Yan, X., T. Li, and Y. Zhou. 2022. “Virtual reality’s influence on construction workers’ willingness to participate in safety education and training in China.” J. Manage. Eng. 38 (2): 04021095. https://doi.org/10.1061/(ASCE)ME.1943-5479.0001002.
Yasmeen, S., H. Liu, Y. Wu, and B. Li. 2020. “Physiological responses of acclimatized construction workers during different work patterns in a hot and humid subtropical area of China.” J. Build. Eng. 30 (Mar): 101281. https://doi.org/10.1016/j.jobe.2020.101281.
Yu, W. D., K. C. Wang, and H. T. Wu. 2022. “Empirical comparison of learning effectiveness of immersive virtual reality–based safety training for novice and experienced construction workers.” J. Constr. Eng. Manage. 148 (9): 04022078. https://doi.org/10.1061/(ASCE)CO.1943-7862.0002337.
Zhang, Y., M. Zhang, and Q. Fang. 2019. “Scoping review of EEG studies in construction safety.” Int. J. Environ. Res. Public Health 16 (21): 4146. https://doi.org/10.3390/ijerph16214146.
Zhu, H., M. Hu, S. Hu, H. Wang, and J. Guan. 2023a. “Effects of hot-humid exposure on human cognitive performance under sustained multi-tasks.” Energy Build. 279 (15): 112704. https://doi.org/10.1016/j.enbuild.2022.112704.
Zhu, P., J. Hu, X. Li, and Q. Zhu. 2023b. “Using blockchain technology to enhance the traceability of original achievements.” IEEE Trans. Eng. Manage. 70 (5): 1693–1707. https://doi.org/10.1109/TEM.2021.3066090.
Zhu, P., J. Hu, Y. Zhang, and X. Li. 2021. “Enhancing traceability of infectious diseases: A blockchain-based approach.” Inf. Process. Manage. 58 (4): 102570. https://doi.org/10.1016/j.ipm.2021.102570.
Information & Authors
Information
Published In
Journal of Management in Engineering
Volume 40 • Issue 6 • November 2024
Copyright
© 2024 American Society of Civil Engineers.
History
Received: Dec 7, 2023
Accepted: Jun 11, 2024
Published online: Sep 3, 2024
Published in print: Nov 1, 2024
Discussion open until: Feb 3, 2025
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.