Examining the Relationship between Construction Workers’ Visual Attention and Situation Awareness under Fall and Tripping Hazard Conditions: Using Mobile Eye Tracking
Publication: Journal of Construction Engineering and Management
Volume 144, Issue 7
Abstract
The risk of major occupational accidents involving tripping hazards is commonly underestimated with a large number of studies having been conducted to better understand variables that affect situation awareness: the ability to detect, perceive, and comprehend constantly evolving surroundings. An important property that affects situation awareness is the limited capacity of the attentional system. To maintain situation awareness while exposed to tripping hazards, a worker needs to obtain feedforward information about hazards, detect immediate tripping hazards, and visually scan surroundings for any potential environmental hazards. Despite the importance of situation awareness, its relationship with attention remains unknown in the construction industry. To fill this theoretical knowledge gap, this study examines differences in attentional allocation between workers with low and high situation awareness levels while exposed to tripping hazards in a real construction site. Participants were exposed to tripping hazards on a real jobsite while walking along a path in the presence of other workers. Situation awareness was measured using the situation awareness rating technique, and subjects’ eye movements were tracked as direct measures of attention via a wearable mobile eye tracker. Investigating the attentional distribution of subjects by examining fixation-count heat maps and scan paths revealed that as workers with higher situation awareness walked, they periodically looked down and scanned ahead to remain fully aware of the environment and its associated hazards. Furthermore, this study quantitatively compared the differences between the eye-tracking metrics of worker with different situation awareness levels (low versus high) using permutation simulation. The results of the statistical analysis indicate that subjects did not allocate their attention equally to all hazardous areas of interest, and these differences in attentional distribution were modulated by the workers’ level of situation awareness. This study advances theory by presenting one of the first attempts to use mobile eye-tracking technology to examine the role of cognitive processes (i.e., attention) in human error (i.e., failure to identify a hazard) and occupational accidents.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Data generated or analyzed during the study are available from the corresponding author by request. Information about the Journal’s data sharing policy can be found here: http://ascelibrary.org/doi/10.1061/(ASCE)CO.1943-7862.0001263.
Acknowledgments
The research team thanks the University of Nebraska–Lincoln for supporting the research reported in this paper through a Research Council Faculty Seed Grant. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the writers and do not necessarily reflect the views of the University of Nebraska–Lincoln.
References
Ayres, T. J., and R. Kelkar. 2006. “Sidewalk potential trip points: A method for characterizing walkways.” Int. J. Ind. Ergon. 36 (12): 1031–1035. https://doi.org/10.1016/j.ergon.2006.09.004.
Banbury, S., H. Dudfield, H. J. Hoermann, and H. Soll. 2007. “FASA: Development and validation of a novel measure to assess the effectiveness of commercial airline pilot situation awareness training.” Int. J. Aviat. Psychol. 17 (2): 131–152. https://doi.org/10.1080/10508410701328557.
Bell, J. L., et al. 2008. “Evaluation of a comprehensive slip, trip and fall prevention programme for hospital employees.” Ergonomics 51 (12): 1906–1925. https://doi.org/10.1080/00140130802248092.
Bentley, T. 2009. “The role of latent and active failures in workplace slips, trips and falls: An information processing approach.” Appl. Ergon. 40 (2): 175–180. https://doi.org/10.1016/j.apergo.2008.04.009.
Bentley, T., D. Moore, D. Tappin, R. Parker, L. Ashby, and S. Hide. 2003. Slips, trips and falls in the New Zealand dairy farming sector. Albany, Auckland: Massey Univ.
Bentley, T. A., and R. A. Haslam. 2001. “Identification of risk factors and countermeasures for slip, trip and fall accidents during the delivery of mail.” Appl. Ergon. 32 (2): 127–134. https://doi.org/10.1016/S0003-6870(00)00048-X.
Bhoir, S. A., S. Hasanzadeh, B. Esmaeili, M. D. Dodd, and M. S. Fardhosseini. 2015. “Measuring construction workers’ attention using eyetracking technology.” In Proc., ICSC15: The Canadian Society for Civil Engineering 5th Int./11th Construction Specialty Conf. edited by T. M. Froese, L. Newton, F. Sadeghpour, and D. J. Vanier, Vancouver, Canada: Univ. of British Columbia.
BLS (Bureau of Labor Statistics). 2017. “National census of fatal occupational injuries in 2016.” Accessed April 23, 2018. https://www.bls.gov/news.release/pdf/cfoi.pdf.
Bojko, A. A. 2009. “Informative or misleading? Heat maps deconstructed.” In Human-computer interaction. New trends, edited by J. A. Jacko, 30–39. Berlin, Germany: Springer.
Brⓞne, G., B. Oben, and T. Goedemé. 2011. “Towards a more effective method for analyzing mobile eye-tracking data: Integrating gaze data with object recognition algorithms.” In Proc., 1st Int. Workshop on Pervasive Eye Tracking and Mobile Eye-Based Interaction, 53–56. New York, NY: Association for Computing Machinery.
Buckley, J. G., M. A. Timmis, A. J. Scally, and D. B. Elliott. 2011. “When is visual information used to control locomotion when descending a kerb?” PLoS One 6 (4): e19079. https://doi.org/10.1371/journal.pone.0019079.
Buscher, G., E. Cutrell, and M. R. Morris. 2009. “What do you see when you're surfing?: Using eye tracking to predict salient regions of web pages.” In Proc., SIGCHI Conf. on Human Factors in Computing Systems. 21–30. New York, NY: Association for Computing Machinery.
Cayless, S. M. 2001. “Slip, trip and fall accidents: Relationship to building features and use of coroners’ reports in ascribing cause.” Appl. Ergon. 32 (2): 155–162.
Cutrell, E., and Z. Guan. 2007. “What are you looking for? An eye-tracking study of information usage in web search.” In Proc., SIGCHI Conf. on Human Factors in Computing Systems, 407–416. New York, NY: Association for Computing Machinery.
Damos, D. L., and C. D. Wickens. 1980. “The identification and transfer of timesharing skills.” Acta Psychol. 46 (1): 15–39. https://doi.org/10.1016/0001-6918(80)90057-8.
Davis, P. R. 2007. “Human factors contributing to slips, trips and falls.” Ergonomics 26 (1): 51–59. https://doi.org/10.1080/00140138308963312.
Duchowski, A. 2007. Eye tracking methodology: Theory and practice. Berlin, Germany: Springer Science & Business Media.
Durso, F. T., M. K. Bleckley, and A. R. Dattel. 2006. “Does situation awareness add to the validity of cognitive tests?” J. Hum. Factors Ergon. Soc., 48 (4), 721–733.
Endsley, M. R. 1988. “Design and evaluation for situation awareness enhancement.” In Vol. 32 of Proc., Human Factors and Ergonomics Society Annual Meeting, 97–101. Los Angeles, CA: SAGE Publications.
Endsley, M. R. 1990. Situation awareness global assessment technique (SAGAT): Airto-air tactical version user guide (NOR DOC 89-58, rev A). Hawthorne, CA: Northrop Corp.
Endsley, M. R. 1995. “Toward a theory of situation awareness in dynamic systems.” J. Hum. Factors Ergon. Soc. 37 (1): 32–64. https://doi.org/10.1518/001872095779049543.
Gauchard, G., N. Chau, J. M. Mur, and P. Perrin. 2001. “Falls and working individuals: Role of extrinsic and intrinsic factors.” Ergonomics 44 (14): 1330–1339. https://doi.org/10.1080/00140130110084791.
Gidlöf, K., A. Wallin, R. Dewhurst, and K. Holmqvist. 2013. “Using eye tracking to trace a cognitive process: Gaze behaviour during decision making in a natural environment.” J. Eye Mov. Res. 6 (1): 1–14. https://doi.org/10.16910/jemr.6.1.3.
Gleason, J. 2013. Comparative power of the ANOVA, randomization ANOVA, and Kruskal-Wallis test. Ph.D. dissertation, Wayne State Univ.
Goldberg, J. H., M. J. Stimson, M. Lewenstein, N. Scott, and A. M. Wichansky. 2002. “Eye tracking in web search tasks: Design implications.” In Proc., 2002 Symp. on Eye Tracking Research and Applications, 51–58. New York, NY: Association for Computing Machinery.
Grönqvist, R., J. Abeysekera, G. Gard, S. M. Hsiang, T. B. Leamon, D. J. Newman, K. Gielo-Perczak, T. E. Lockhart, and C. C. Pai. 2001. “Human-centred approaches in slipperiness measurement.” Ergonomics 44 (13): 1167–1199. https://doi.org/10.1080/00140130110085556.
Hasanzadeh, S., B. Esmaeili, and M. Dodd. 2016. “Measuring construction workers’ real-time situation awareness using mobile eye-tracking.” In Construction Research Congress 2016, 2894–2904. Reston, VA: ASCE.
Hasanzadeh, S., B. Esmaeili, and M. Dodd. 2017a. “Impact of construction workers’ hazard identification skilld on their visual attention.” J. Constr. Eng. Manage. 143 (10): 04017070. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001373.
Hasanzadeh, S., B. Esmaeili, and M. Dodd. 2017b. “Measuring impacts of safety knowledge on construction workers’ attentional allocation and hazard detection: Using remote eye-tracking technology.” J. Manage. Eng. 33 (5): 04017024. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000526.
Hasanzadeh, S., B. Esmaeili, and M. Dodd. 2017c. “Measuring the impact of working memory load on the safety performance of construction workers.” In Computing in Civil Engineering 2017, 158–166. Seattle, WA.
Hasanzadeh, S., B. Esmaeili, M. Dodd, and E. Pellicer. 2017d. Using eye movements to identify hazards missed by at-risk workers.” Fargo, ND: ISEC.
Hauss, Y., and K. Eyferth. 2003. “Securing future ATM-concepts’ safety by measuring situation awareness in ATC.” Aerosp. Sci. Technol. 7 (6): 417–427. https://doi.org/10.1016/S1270-9638(02)00011-1.
Hayhoe, M. M., and D. H. Ballard. 2005. “Eye movements in natural behavior.” Trends Cognit. Sci. 9 (4): 188–194. https://doi.org/10.1016/j.tics.2005.02.009.
HSE (Health & Safety Executive). 2005. “Research into the behavioral aspects of slips and trip accidents and incidents. 1: Literature review.” Accessed April 23, 2018. http://www.hse.gov.uk/research/rrpdf/rr396.pdf.
Jovanevic-Misic, J., and M. M. Hayhoe. 2009. “Adaptive gaze control in natural environments.” J. Neurosci. 29 (19): 6234–6238.
Kaber, D., S. Jin, M. Zahabi, and C. Pankok. 2016. “The effect of driver cognitive abilities and distractions on situation awareness and performance under hazard conditions.” Transp. Res. Part F Traffic Psychol. Behav. 42 (1): 177–194. https://doi.org/10.1016/j.trf.2016.07.014.
Keller, J., C. Lebiere, C. R. Shay, and K. Latorella. 2004. “Cockpit system situational awareness modeling tool.” In Vol. 2 of Human performance, situation awareness and automation: Current research trends HPSAA II. edited by D. A. Vincenzi, M. Mouloua, and P. A. Hancock, 66–71. Daytona Beach, FL: Psychology Press.
Kemmlert, K., and L. Lundholm. 2001. “Slips, trips and falls in different work groups—With reference to age and from a preventive perspective.” Appl. Ergon. 32 (2): 149–153. https://doi.org/10.1016/S0003-6870(00)00051-X.
Kiefer, P., F. Straub, and M. Raubal. 2012. “Towards location-aware mobile eye tracking.” In Symp. on Eye Tracking Research and Applications, 313–316. New York, NY: Association for Computing Machinery.
Kim, H., S. Ährlund-Richter, X. Wang, K. Deisseroth, and M. Carlén. 2016. “Prefrontal parvalbumin neurons in control of attention.” Cell 164 (1): 208–218. https://doi.org/10.1016/j.cell.2015.11.038.
Kuzel, M., H. H. Cohen, R. Rauschenberger, and J. Cohen. 2013. “Evaluation of mobile eye tracking for forensic analysis of pedestrian falls.” In Vol. 57 of Proc., Human Factors and Ergonomics Society Annual Meeting, 570–574. Los Angeles, CA: SAGE Publications.
Laeng, B., and D. S. Teodorescu. 2002. “Eye scanpaths during visual imagery reenact those of perception of the same visual scene.” Cognit. Sci. 26 (2): 207–231. https://doi.org/10.1207/s15516709cog2602_3.
LaFleur, B. J., and R. A. Greevy. 2009. “Introduction to permutation and resampling-based hypothesis tests.” J. Clin. Child Adolesc. Psychol. 38 (2): 286–294. https://doi.org/10.1080/15374410902740411.
Land, M. 2006. “Eye movements and the control of actions in everyday life.” Progress Retinal Eye Res. 25 (3): 296–324. https://doi.org/10.1016/j.preteyeres.2006.01.002.
Land, M. F., and P. McLeod. 2000. “From eye movements to actions: How batsmen hit the ball.” Nat. Neurosci. 3 (12): 1340–1345. https://doi.org/10.1038/81887.
Layne, L., and K. Pollack. 2004. “Nonfatal occupational injuries from slips, trips, and falls among older workers treated in hospital emergency departments, United States 1998.” Am. J. Ind. Med. 46 (1): 32–41. https://doi.org/10.1002/ajim.20038.
Leclercq, S., and S. Thouy. 2004. “Systemic analysis of so-called ‘accidents on the level’ in a multi trade company.” Ergonomics 47 (12): 1282–1300. https://doi.org/10.1080/00140130410001712627.
Lim, T. K., S. M. Park, H. C. Lee, and D. E. Lee. 2015. “Artificial neural network-based slip-trip classifier using smart sensor for construction workplace.” J. Constr. Eng. Manage. 142 (2): 04015065. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001049.
Lipscomb, H. J., J. E. Glazner, J. Bondy, K. Guarini, and D. Lezotte. 2006. “Injuries from slips and trips in construction.” Appl. Ergon. 37 (3): 267–274. https://doi.org/10.1016/j.apergo.2005.07.008.
Mitropoulos, P., G. Cupido, and M. Namboodiri. 2009. “Cognitive approach to construction safety: Task demand-capability model.” J. Constr. Eng. Manage. 135 (9): 881–889. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000060.
Pan, B., H. A. Hembrooke, G. K. Gay, L. A. Granka, M. K. Feusner, and J. K. Newman. 2004. “The determinants of web page viewing behavior: An eye-tracking study.” In 2004 Symp. on Eye Tracking Research and Applications, 147–154. New York, NY: Association for Computing Machinery.
Patla, A. E. 2003. “Strategies for dynamic stability during adaptive human locomotion.” IEEE Eng. Med. Biol. Mag. 22 (2): 48–52. https://doi.org/10.1109/MEMB.2003.1195695.
Pfeiffer, T., and P. Renner. 2014. “Eyesee3d: A low-cost approach for analyzing mobile 3D eye tracking data using computer vision and augmented reality technology.” In Symp. on Eye Tracking Research and Applications, 369–376. New York, NY: Association for Computing Machinery.
Raschke, M., T. Blascheck, M. Richter, T. Agapkin, and T. Ertl. 2014. “Visual analysis of perceptual and cognitive processes.” In Proc., Int. Conf. on Information Visualization Theory and Applications (IVAPP), 284–291. New York, NY: IEEE.
Rodgers, M. D., R. H. Mogford, and B. Strauch. 2000. “Post hoc assessment of situation awareness in air traffic control incidents and major aircraft accidents.” In Situation awareness analysis and measurement, 73–112. Mahwah, NJ: Lawrence Erlbaum Associates Publishers.
Salmon, P., N. Stanton, G. Walker, and D. Green. 2006. “Situation awareness measurement: A review of applicability for C4i environments.” Appl. Ergon. 37 (2): 225–238. https://doi.org/10.1016/j.apergo.2005.02.001.
Salvucci, D. D., and J. H. Goldberg. 2000. “Identifying fixations and saccades in eye-tracking protocols.” In Proc., Symp. on Eye Tracking Research and Applications, 71–78. New York, NY: Association for Computing Machinery.
Sarter, N. B., and D. D. Woods. 1995. “How in the world did we ever get into that mode? Mode error and awareness in supervisory control.” Hum. Factors 37 (1): 5–19. https://doi.org/10.1518/001872095779049516.
Segev-Jacubovski, O., T. Herman, G. Yogev-Seligmann, A. Mirelman, N. Giladi, and J. M. Hausdorff. 2014. “The interplay between gait, falls and cognition: Can cognitive therapy reduce fall risk?” Expert Rev. Neurother. 11 (7): 1057–1075. https://doi.org/10.1586/ern.11.69.
Sheik-Nainar, M., D. Kaber, S. Hsiang, C. Pankok Jr., and M. Zahabi. 2015. “Influence of cognitive and perceptual processing on multitask performance with locomotion.” Theor. Issues Ergon. Sci. 16 (3): 273–298. https://doi.org/10.1080/1463922X.2014.1001005.
Shinoda, H., M. M. Hayhoe, and A. Shrivastava. 2001. “What controls attention in natural environments?” Vision Res. 41 (25–26): 3535–3545. https://doi.org/10.1016/S0042-6989(01)00199-7.
Smilek, D., J. D. Eastwood, M. G. Reynolds, and A. Kingstone. 2008. “Metacognition and change detection: Do lab and life really converge?” Consciousness Cognition 17 (3): 1056–1061. https://doi.org/10.1016/j.concog.2007.08.003.
Tatler, B. W., R. G. Macdonald, T. Hamling, and C. Richardson. 2016. “Looking at domestic textiles: An eye-tracking experiment analysing influences on viewing behaviour at Owlpen Manor.” Text. Hist. 47 (1): 94–118. https://doi.org/10.1080/00404969.2016.1144865.
Taylor, R. M. 1990. “Situational awareness rating technique (SART): The development of a tool for aircrew systems design.” In Proc., AGARD AMP Symp.: SA in Aerospace Operations, AGARD CP. Paris: NATO-AGARD CP.
Whetsel, S. A., and A. O. Campbell. 2016. “The utility of mobile eye tracking technology in the forensic analysis of personal injury.” In Vol. 60 of Proc., Human Factors and Ergonomics Society Annual Meeting, 485–488. Los Angeles, CA: SAGE Publications.
Wickens, C. D. 1996. “Situation awareness: Impact of automation and display technology.” In AGARD AMP Symp. on Situation Awareness: Limitations and Enhancement in the Aviation Environment. Brussels, Belgium.
Wickens, C. D., J. G. Hollands, S. Banbury, and R. Parasuraman. 2013. Engineering psychology and human performance. Routledge, NY: Psychology Press.
Wooding, D. S. 2002. “Eye movements of large populations. II: Deriving regions of interest, coverage, and similarity using fixation maps.” Behav. Res. Methods Instrum. Comput. 34 (4): 518–528. https://doi.org/10.3758/BF03195481.
Wooley, S. M., S. J. Czaja, and C. G. Drury. 1997. “An assessment of falls in elderly men and women.” J. Gerontol. 52 (2): M80–M87.
Yarbus, A. L. 1967. In Vol. 2 of Eye movements and vision, edited by L. A. Rigss. New York, NY: Plenum Press.
Yeoh, H. T., T. E. Lockhart, and X. Wu. 2013. “Non-fatal occupational falls on the same level.” Ergonomics 56 (2): 153–165. https://doi.org/10.1080/00140139.2012.746739.
Information & Authors
Information
Published In
Journal of Construction Engineering and Management
Volume 144 • Issue 7 • July 2018
Copyright
©2018 American Society of Civil Engineers.
History
Received: Aug 1, 2017
Accepted: Jan 23, 2018
Published online: May 15, 2018
Published in print: Jul 1, 2018
Discussion open until: Oct 15, 2018
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.