Assessing Hazard Anticipation in Dynamic Construction Environments Using Multimodal 360-Degree Panorama Videos
Publication: Journal of Management in Engineering
Volume 38, Issue 5
Abstract
Given the dynamic and complex nature of a construction site, the ability to recognize hazards in a surrounding environment is highly associated with worker safety. While many studies have examined the hazard identification skills of workers, researchers have not yet explored how the dynamic nature of hazards impacts workers’ hazard anticipation, hazard identification, and cognitive perception of hazards within dynamic construction scenarios. This study investigates (1) whether hazard characteristics (i.e., static versus dynamic) impact workers’ hazard identification performance; and (2) how two cognitive steps (i.e., attention and perception) influence hazard identification performance for these dynamic hazards. Employing state-of-the-art 360° video panoramas, this study performed an empirical investigation experiment to assess 30 construction workers’ hazard identification skills and corresponding attention and perception behaviors. The results of this study indicate that worker’s hazard identification abilities are affected by the static and/or dynamic nature of hazards: Generally, workers better anticipate dynamic hazards thanks to target and context anticipatory cues. In addition, a major discriminator between workers with higher hazard identification skills and those with lower hazard identification skills for dynamic hazards manifested in their continuous awareness of hazardous situations and proper prediction of emerging or potential hazards. Beyond identifying these factors, this study discusses multiple reasons underpinning attentional failures and misperception. The study highlights the importance of applying an integrated personalized training program to address cognitive failures and hazard anticipation skills to improve occupational safety in the construction industry.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
All data, models, or code generated or used during the study are available from the corresponding author by request.
Acknowledgments
The National Science Foundation is thanked for supporting the research reported in this paper (1824238 and 2049711). Any opinions, findings, and conclusions, or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation and supporting construction company. The authors also would like to thank the workers and professional safety managers who participated in and supported this study.
References
Agrawal, R., M. Knodler, D. L. Fisher, and S. Samuel. 2018. “Virtual reality headset training: Can it be used to improve young drivers’ latent hazard anticipation and mitigation skills.” Transp. Res. Rec. J. Transp. Res. Board 2672 (33): 20–30. https://doi.org/10.1177/0361198118758311.
Albert, A., M. R. Hallowell, and B. M. Kleiner. 2014. “Experimental field testing of a real-time construction hazard identification and transmission technique.” Construct. Manage. Econ. 32 (10): 1000–1016. https://doi.org/10.1080/01446193.2014.929721.
Aroke, O., B. Esmaeili, S. Hasanzadeh, M. D. Dodd, and R. Brock. 2020. “The role of work experience on hazard identification: Assessing the mediating effect of inattention under fall-hazard conditions.” In Construction research congress 2020, 509–519. Reston, VA: ASCE.
Awolusi, I., E. Marks, and M. Hallowell. 2018. “Wearable technology for personalized construction safety monitoring and trending: Review of applicable devices.” Autom. Constr. 85 (Jan): 96–106. https://doi.org/10.1016/j.autcon.2017.10.010.
Baumann, M., and J. F. Krems. 2007. “Situation awareness and driving: A cognitive model.” In Modelling driver behaviour in automotive environments, 253–265. Berlin: Springer.
Bhandari, S., M. R. Hallowell, and J. Correll. 2019. “Making construction safety training interesting: A field-based quasi-experiment to test the relationship between emotional arousal and situational interest among adult learners.” Saf. Sci. 117 (Mar): 58–70. https://doi.org/10.1016/j.ssci.2019.03.028.
Bhandari, S., M. R. Hallowell, L. Van Boven, J. Gruber, and K. M. Welker. 2016. “Emotional States and Their Impact on Hazard Identification Skills.” In Construction research congress 2016, 2831–2840. Reston, VA: ASCE.
Bohm, J., and D. Harris. 2010. “Risk perception and risk-taking behavior of construction site dumper drivers.” Int. J. Occup. Saf. Ergon. 16 (1): 55–67. https://doi.org/10.1080/10803548.2010.11076829.
Bükrü, S., M. Wolf, O. Golovina, and J. Teizer. 2020. “Using field of view and eye tracking for feedback generation in an augmented virtuality safety training.” In Construction research congress 2020, 625–632. Reston, VA: ASCE.
Carlsson, K., P. Petrovic, S. Skare, K. M. Petersson, and M. Ingvar. 2000. “Tickling expectations: Neural processing in anticipation of a sensory stimulus.” J. Cognit. Neurosci. 12 (4): 691–703. http://doi.or/10.1162/089892900562318.
Casey, T., N. Turner, X. Hu, and K. Bancroft. 2021. “Making safety training stickier: A richer model of safety training engagement and transfer.” J. Saf. Res. 78 (Sep): 303–313. https://doi.org/10.1016/j.jsr.2021.06.004.
Choi, K., Y.-J. Yoon, O.-Y. Song, and S.-M. Choi. 2018. “Interactive and immersive learning using 360° virtual reality contents on mobile platforms.” Mobile Inf. Syst. 2018: 1–12. https://doi.org/10.1155/2018/2306031.
Choudhry, R. M., D. Fang, and S. Mohamed. 2007a. “Developing a model of construction safety culture.” J. Manage. Eng. 23 (4): 207–212. https://doi.org/10.1061/(ASCE)0742-597X(2007)23:4(207).
Choudhry, R. M., D. Fang, and S. Mohamed. 2007b. “The nature of safety culture: A survey of the state-of-the-art.” Saf. Sci. 45 (10): 993–1012. https://doi.org/10.1016/j.ssci.2006.09.003.
Chu, B., K. Jung, M.-T. Lim, and D. Hong. 2013. “Robot-based construction automation: An application to steel beam assembly (Part I).” Autom. Constr. 32 (12): 46–61. https://doi.org/10.1016/j.autcon.2012.12.016.
Demirkesen, S., and D. Arditi. 2015. “Construction safety personnel’s perceptions of safety training practices.” Int. J. Project Manage. 33 (5): 1160–1169. https://doi.org/10.1016/j.ijproman.2015.01.007.
Duchowski, A. 2007. Eye tracking methodology: Theory and practice. Berlin: Springer.
Eiris, R., M. Gheisari, and B. Esmaeili. 2018. “PARS: Using augmented 360-degree panoramas of reality for construction safety training.” Int. J. Environ. Res. Public Health 15 (11): 2452. https://doi.org/10.3390/ijerph15112452.
Eiris, R., M. Gheisari, and B. Esmaeili. 2020. “Desktop-based safety training using 360-degree panorama and static virtual reality techniques: A comparative experimental study.” Autom. Constr. 109 (Jan): 102969. https://doi.org/10.1016/j.autcon.2019.102969.
Eiris, R., E. Jain, M. Gheisari, and A. Wehle. 2021. “Online Hazard Recognition Training: Comparative case study of static images, cinemagraphs, and videos.” J. Constr. Eng. Manage. 147 (8): 04021082. https://doi.org/10.1061/(ASCE)CO.1943-7862.0002090.
Endsley, M. R. 1988. “Design and evaluation for situation awareness enhancement.” In Proc., Human Factors Society annual meeting. Los Angeles, CA: SAGE.
Endsley, M. R. 1995. Toward a theory of situation awareness in dynamic systems. Los Angeles, CA: SAGE.
Felli, F., C. Liu, F. Ullah, and S. Sepasgozar. 2018. “Implementation of 360 videos and mobile laser measurement technologies for immersive visualisation of real estate & properties.” In Proc., 42nd AUBEA Conf., Perth, Australia: Curtin Univ.
Guo, Z., Y. Pan, G. Zhao, J. Zhang, and N. Dong. 2020. “Recognizing hazard perception in a visual blind area based on EEG features.” In IEEE access. New York: IEEE.
Hasanzadeh, S., B. Dao, B. Esmaeili, and M. D. Dodd. 2019. “Role of personality in construction safety: Investigating the relationships between personality, attentional failure, and hazard identification under fall-hazard conditions.” J. Constr. Eng. Manage. 145 (9): 4019052. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001673.
Hasanzadeh, S., B. Esmaeili, and M. D. Dodd. 2016. “Measuring construction workers’ real-time situation awareness using mobile eye-tracking.” In Construction research congress 2016, 2894–2904. Reston, VA: ASCE.
Hasanzadeh, S., B. Esmaeili, and M. D. Dodd. 2017a. “Measuring the impacts of safety knowledge on construction workers’ attentional allocation and hazard detection using remote eye-tracking technology.” J. Manage. Eng. 33 (5): 04017024. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000526.
Hasanzadeh, S., B. Esmaeili, and M. D. Dodd. 2017b. “Impact of construction workers’ hazard identification skills on their visual attention.” J. Constr. Eng. Manage. 143 (10): 4017070. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001373.
Hasanzadeh, S., B. Esmaeili, and M. D. Dodd. 2018. “Examining the relationship between construction workers’ visual attention and situation awareness under fall and tripping hazard conditions: Using mobile eye tracking.” J. Constr. Eng. Manage. 144 (7): 04018060. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001516.
He, D., and B. Donmez. 2022. “The influence of visual-manual distractions on anticipatory driving.” Hum. Factors 64 (2): 401–417. https://doi.org/10.1177/0018720820938893.
Holleman, G. A., I. T. Hooge, C. Kemner, and R. S. Hessels. 2020. “The ‘real-world approach’ and its problems: A critique of the term ecological validity.” Front. Psychol. 11 (Apr): 721. https://doi.org/10.3389/fpsyg.2020.00721.
Imaoka, Y., A. Flury, and E. D. de Bruin. 2020. “Assessing saccadic eye movements with head-mounted display virtual reality technology.” Front. Psychiatry 11 (Sep): 922. https://doi.org/10.3389/fpsyt.2020.572938.
Jeelani, I., A. Albert, and J. A. Gambatese. 2017. “Why do construction hazards remain unrecognized at the work interface?” J. Constr. Eng. Manage. 143 (5): 04016128. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001274.
Jeelani, I., K. Han, and A. Albert. 2020. Development of virtual reality and stereo-panoramic environments for construction safety training.” Eng. Constr. Archit. Manage. 27 (8): 1853–1876. https://doi.org/10.1108/ECAM-07-2019-0391.
Jeon, J., and H. Cai. 2021. “Classification of construction hazard-related perceptions using: Wearable electroencephalogram and virtual reality.” Autom. Constr. 132 (Dec): 103975. https://doi.org/10.1016/j.autcon.2021.103975.
Jeon, J., H. Cai, D. Yu, and X. Xu. 2020. “Identification of safety hazards using wearable EEG.” In Proc., Construction Research Congress 2020: Safety, Workforce, and Education, 185–194. Reston, VA: ASCE.
Jiang, S., W. Chen, Y. Kang, J. Liu, and W. Kuang. 2021. “Identifying cognitive mechanism underlying situation awareness of pilots’ unsafe behaviors using quantitative modeling.” Int. J. Environ. Res. Public Health 18 (6): 3052. https://doi.org/10.3390/ijerph18063052.
Katrahmani, A., N. Ahmadi, and M. Romoser. 2017. “Using situation awareness as a measure of driver hazard perception ability.” In Proc., 9th Int. Driving Symp. on Human Factors in Driver Assessment, Training, and Vehicle Design: Driving Assessment 2017, 256–262. Iowa City, IA: Univ. of Iowa.
Kim, H., C. R. Ahn, and K. Yang. 2017. “Identifying safety hazards using collective bodily responses of workers.” J. Constr. Eng. Manage. 143 (2): 4016090. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001220.
Liao, P. C., X. Sun, and D. Zhang. 2021. “A multimodal study to measure the cognitive demands of hazard recognition in construction workplaces.” In Safety science. New York: Elsevier.
McDonald, C. C., A. H. Goodwin, A. K. Pradhan, M. R. Romoser, and A. F. Williams. 2015. “A review of hazard anticipation training programs for young drivers.” J. Adolesc. Health 57 (1): 15–23. https://doi.org/10.1016/j.jadohealth.2015.02.013.
Mitropoulos, P., T. S. Abdelhamid, and G. A. Howell. 2005. “Systems model of construction accident causation.” J. Constr. Eng. Manage. 131 (7): 816–825. https://doi.org/10.1061/(ASCE)0733-9364(2005)131:7(816).
Mo, Y., D. Zhao, J. Du, W. Liu, and A. Dhara. 2018. “Data-driven approach to scenario determination for VR-based construction safety training.” In Proc., Construction Research Congress 2018: Safety and Disaster Management—Selected Papers from the Construction Research Congress, 116–125. Reston, VA: ASCE.
Moore, H. F., R. Eiris, M. Gheisari, and B. Esmaeili. 2019. “Hazard identification training using 360-degree panorama vs. virtual reality techniques: A pilot study.” In Computing in civil engineering 2019: Visualization, information modeling, and simulation, 55–62. Reston, VA: ASCE.
Mühl, K., and M. Baumann. 2018. “The role of cognitive distraction and characteristics of situation elements on anticipation while driving.” In Proc., 6th Int. Conf. on Driver Distraction and Inattention Conf.: Driver Engagement during Assisted Driving, 6–9. Göteborg, Sweden: Sweden MEETX.
Norman, D. A., and T. Shallice. 1986. “Attention to action.” In Consciousness and self-regulation, 1–18. Berlin: Springer.
Orús, C., S. Ibáñez-Sánchez, and C. Flavián. 2021. “Enhancing the customer experience with virtual and augmented reality: The impact of content and device type.” Int. J. Hosp. Manage. 98 (Jun): 103019. https://doi.org/10.1016/j.ijhm.2021.103019.
Park, S. J., C. Y. Park, C. Lee, S. H. Han, S. Yun, and D. E. Lee. 2022. “Exploring inattentional blindness in failure of safety risk perception: Focusing on safety knowledge in construction industry.” In Safety science. New York: Elsevier.
Pereira, R. E., and M. Gheisari. 2019. “360-degree panoramas as a reality capturing technique in construction domain: Applications and limitations.” In Proc., ASC Annual Int. Conf. Cheyenne, WY: Associated Schools of Construction.
Pham, H. C., N. N. Dao, S. Cho, P. T. Nguyen, and A. T. Pham-Hang. 2019. “Construction hazard investigation leveraging object anatomization on an augmented photoreality platform.” Appl. Sci. 9 (21): 4477. https://doi.org/10.3390/app9214477.
Pham, H. C., N.-N. Dao, J.-U. Kim, S. Cho, and C.-S. Park. 2018. “Energy-efficient learning system using web-based panoramic virtual photoreality for interactive construction safety education.” Sustainability 10 (7): 2262. https://doi.org/10.3390/su10072262.
Pinto, A., I. L. Nunes, and R. A. Ribeiro. 2011. “Occupational risk assessment in construction industry–Overview and reflection.” Saf. Sci. 49 (5): 616–624. https://doi.org/10.1016/j.ssci.2011.01.003.
Reeves, R., A. Elliott, D. Curran, K. Dyer, and D. Hanna. 2021. “360 Video virtual reality exposure therapy for public speaking anxiety: A randomized controlled trial.” J. Anxiety Disorders 83 (Dec): 102451. https://doi.org/10.1016/j.janxdis.2021.102451.
Sacks, R., O. Rozenfeld, and Y. Rosenfeld. 2009. “Spatial and temporal exposure to safety hazards in construction.” J. Constr. Eng. Manage. 135 (8): 726–736. https://doi.org/10.1061/(ASCE)0733-9364(2009)135:8(726).
Shojaei, A., S. Rokooei, L. Carson, G. Ford, and A. Mahdavian. 2020. “Immersive video capture technology for construction management education.” In Proc., 20th Int. Conf. on Construction Applications of Virtual Reality (CONVR 2020), 163–172. Middlesbrough, North Yorkshire, UK: Teesside Univ.
Sipatchin, A., S. Wahl, and K. Rifai. 2020. “Eye-tracking for low vision with virtual reality (VR): Testing status quo usability of the HTCVive Pro Eye.” bioRxiv. https://doi.org/10.1101/2020.07.29.220889.
Sipatchin, A., S. Wahl, and K. Rifai. 2021. “Eye-tracking for clinical ophthalmology with virtual reality (VR): A case study of the HTC Vive pro eye’s usability.” In Vol. 9 of Healthcare, 180. Basel, Switzerland: Multidisciplinary Digital Publishing Institute. https://doi.org/10.3390/healthcare9020180.
Solomon, T., and B. Esmaeili. 2020. “Exploring the relationship between mindfulness and personality to improve construction safety and work performance.” In Construction research congress 2020, 472–480. Reston, VA: ASCE.
Solomon, T., S. Hasanzadeh, B. Esmaeili, and M. D. Dodd. 2021. “Impact of change blindness on worker hazard identification at jobsites.” J. Manage. Eng. 37 (4): 04021021. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000908.
Stahl, P., B. Donmez, and G. A. Jamieson. 2019. “Eye glances towards conflict-relevant cues: The roles of anticipatory competence and driver experience.” Accid. Anal. Prev. 132 (May): 105255. https://doi.org/10.1016/j.aap.2019.07.031.
Sun, Y., R. Fisher, F. Wang, and H. M. Gomes. 2008. ““A computer vision model for visual-object-based attention and eye movements.” Comput. Vision Image Understanding 112 (2): 126–142. https://doi.org/10.1016/j.cviu.2008.01.005.
Unverricht, J., S. Samuel, and Y. Yamani. 2018. “Latent hazard anticipation in young drivers: Review and meta-analysis of training studies.” Transp. Res. Rec. J. Transp. Res. Board 2672 (33): 11–19. https://doi.org/10.1177/0361198118768530.
US Bureau of Labor Statistics. 2020. “Census of fatal occupational injuries (CFOI).” Accessed July 3, 2021. https://www.bls.gov/iif/oshcfoi1.htm#2019.
Ventura, S., G. Cardenas, M. Miragall, G. Riva, and R. Baños. 2021. “How does it feel to be a woman victim of sexual harassment? The effect of 360°-video-based virtual reality on empathy and related variables.” Cyberpsychol. Behav. Social Networking 24 (4): 258–266. https://doi.org/10.1089/cyber.2020.0209.
Wickens, C. D., W. S. Helton, J. G. Hollands, and S. Banbury. 2021. Engineering psychology and human performance. England, UK: Routledge.
Xu, Q., H. Y. Chong, and P. Liao. 2019a. “Exploring eye-tracking searching strategies for construction hazard recognition in a laboratory scene.” Saf. Sci. 120 (Aug): 824–832. https://doi.org/10.1016/j.ssci.2019.08.012.
Xu, S., Q. Q. Ni, M. Zhang, and M. Li. 2019b. “A personalized safety training system for construction workers.” In Proc., Int. Conf. on Smart Infrastructure and Construction 2019, ICSIC 2019: Driving Data-Informed Decision-Making, 321–326. London: ICE Publishing.
Xu, S., M. Zhang, and L. Hou. 2019c. “Formulating a learner model for evaluating construction workers’ learning ability during safety training.” In Safety science, 97–107. New York: Elsevier.
Yahoodik, S., and Y. Yamani. 2020. “Attentional control in young drivers: Does training impact hazard anticipation in dynamic environments?” Proc. Hum. Factors Ergon. Soc. 64 (1): 1986–1990. https://doi.org/10.1177/1071181320641478.
Yamani, Y., S. Samuel, S. Yahoodik, and D. L. Fisher. 2021. “Identifying and remedying failures of hazard anticipation in novice drivers.” Theor. Issues Ergon. Sci. 10 (Feb): 1–14. https://doi.org/10.1080/1463922X.2021.1971323.
Yarbus, A. L. 1967. Eye movements and vision. New York: Plenum.
Zhang, Q., D. Zhang, P. C. Liao, and Y. Hu. 2021. “Investigation of interaction among factors underlying construction hazard dentification.” Can. J. Civ. Eng. 48 (7): 838–847. https://doi.org/10.1139/cjce-2020-0170.
Information & Authors
Information
Published In
Journal of Management in Engineering
Volume 38 • Issue 5 • September 2022
Copyright
© 2022 American Society of Civil Engineers.
History
Received: Dec 13, 2021
Accepted: Apr 8, 2022
Published online: Jun 20, 2022
Published in print: Sep 1, 2022
Discussion open until: Nov 20, 2022
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited by
- Yanfang Luo, Qiang Yang, JoonOh Seo, Seungjun Ahn, Theoretical Framework for Utilizing Eye-Tracking Data to Understand the Cognitive Mechanism of Situational Awareness in Construction Hazard Recognition, Journal of Management in Engineering, 10.1061/JMENEA.MEENG-5905, 40, 4, (2024).
- Qingting Xiang, Yang Liu, Yang Miang Goh, Gui Ye, Sufiana Safiena, Investigating the Impact of Hazard Perception Failure on Construction Workers’ Unsafe Behavior: An Eye-Tracking and Thinking-Aloud Approach, Journal of Construction Engineering and Management, 10.1061/JCEMD4.COENG-14338, 150, 7, (2024).
- Kyeongsuk Lee, Sogand Hasanzadeh, Understanding Cognitive Anticipatory Process in Dynamic Hazard Anticipation Using Multimodal Psychophysiological Responses, Journal of Construction Engineering and Management, 10.1061/JCEMD4.COENG-13896, 150, 4, (2024).
- Kyeongsuk Lee, Shiva Pooladvand, Behzad Esmaeili, Sogand Hasanzadeh, Understanding Construction Workers’ Risk Perception Using Neurophysiological Responses, Journal of Computing in Civil Engineering, 10.1061/JCCEE5.CPENG-5906, 38, 6, (2024).
- Shiva Pooladvand, Sogand Hasanzadeh, Effects of Heat Stress on Workers’ Physical Fatigue and Attentiveness: Multimodal Roofing XR Simulation, Construction Research Congress 2024, 10.1061/9780784485293.081, (812-821), (2024).
- Josiane Isingizwe, Ricardo Eiris, Ahmed Jalil Al-Bayati, Immersive Storytelling Safety Training to Enhance Trainee Engagement: Pilot Study for Fall Hazards in the Residential Construction Sector, Construction Research Congress 2024, 10.1061/9780784485293.046, (455-465), (2024).
- Woei-Chyi Chang, Joshua Ismael Becerra, Sarah L. Karalunas, Behzad Esmaeili, Lap-Fai Yu, Sogand Hasanzadeh, Pioneering Research on a Neurodiverse ADHD Workforce in the Future Construction Industry, Construction Research Congress 2024, 10.1061/9780784485293.029, (283-292), (2024).
- Shiva Pooladvand, Sogand Hasanzadeh, Impacts of Stress on Workers’ Risk-Taking Behaviors: Cognitive Tunneling and Impaired Selective Attention, Journal of Construction Engineering and Management, 10.1061/JCEMD4.COENG-13339, 149, 8, (2023).