3D-DesktopEye: A Desktop-Based Eye-Tracking System for Facility Management
Publication: Construction Research Congress 2022
ABSTRACT
Understanding the attentional patterns of construction professionals in design, construction, and facilities management processes is critical to identifying the performance bottlenecks and improving the current workflow designs in the Architecture, Engineering, Construction, and Facility Management (AEC/FM) industry. Recent developments in eye-tracking technologies have attracted an increasing attention of construction scholars as it is an effective tool for attentional analysis. However, the existing monitor-mounted eye trackers are designed for tracking gaze focus on 2D screens (such as attentions during a 2D drawing review) and thus are limited for understanding attentional patterns in 3D model reviews. To track gaze focus in 3D environments, scholars have to use expensive eye trackers integrated with glasses or headset displays such as Virtual Reality headsets. As an alternative, this paper proposes an effective solution for tracking gaze focus in 3D model reviews on 2D screens using the regular monitor-mounted eye trackers. The proposed 3D Desktop-Based Eye-Tracking System called “3D-DesktopEye” leverages the eye-tracking function of the Unity Game engine and a set of geometric conversations to project the 2D eye-tracking points into virtual 3D models. As a result, it can track the focus points of a user looking at a 3D model on a 2D screen. We tested the 3D-DesktopEye system in a facility management scenario—a pipe maintenance task. We also compared the effectiveness of the proposed 3D-DesktopEye system with the traditional 2D eye-tracking system. The results confirmed the usability and feasibility of the 3D-DesktopEye, and the proposed 3D-DesktopEye can help the user achieve better task performance.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
AlfaLaval. (2016). Instruction Manual - Plate Heat Exchangers.
Alruwaythi, O., and Goodrum, P. (2019). “A Difference in Perspective: Impact of Different Formats of Engineering Information and Spatial Cognition on Craft-Worker Eye-Gaze Patterns.” Journal of Construction Engineering and Management, 145(11), 04019065.
Buettner, R., Sauer, S., Maier, C., and Eckhardt, A. (2018). “Real-time prediction of user performance based on pupillary assessment via eye tracking.” AIS Transactions on Human-Computer Interaction, 10(1), 26–56.
Deng, Q., Wang, J., Hillebrand, K., Benjamin, C. R., and Söffker, D. (2019). “Prediction performance of lane changing behaviors: a study of combining environmental and eye-tracking data in a driving simulator.” IEEE Transactions on Intelligent Transportation Systems, 21(8), 3561–3570.
Gingerich, M., and Conati, C. “Constructing Models of User and Task Characteristics from Eye Gaze Data for User-Adaptive Information Highlighting.” Proc., AAAI, 1728–1734.
Hasanzadeh, S., Esmaeili, B., and Dodd, M. D. (2018). “Examining the Relationship between Construction Workers’ Visual Attention and Situation Awareness under Fall and Tripping Hazard Conditions: Using Mobile Eye Tracking.” Journal of Construction Engineering and Management, 144(7), 04018060.
Jacob, R. J., and Karn, K. S. (2003). “Eye tracking in human-computer interaction and usability research: Ready to deliver the promises.” The mind’s eye, Elsevier, 573–605.
Jeelani, I., Han, K., and Albert, A. (2018). “Automating and scaling personalized safety training using eye-tracking data.” Automation in Construction, 93, 63–77.
Le, A. S., Suzuki, T., and Aoki, H. (2020). “Evaluating driver cognitive distraction by eye tracking: From simulator to driving.” Transportation research interdisciplinary perspectives, 4, 100087.
Li, J., Li, H., Umer, W., Wang, H., Xing, X., Zhao, S., and Hou, J. (2020). “Identification and classification of construction equipment operators’ mental fatigue using wearable eye-tracking technology.” Automation in Construction, 109, 103000.
Monty, R. A., and Senders, J. W. (2017). Eye movements and psychological processes, Routledge.
Palinko, O., Rea, F., Sandini, G., and Sciutti, A. “Robot reading human gaze: Why eye tracking is better than head tracking for human-robot collaboration.” Proc., 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, 5048–5054.
Shi, Y., Du, J., and Ragan, E. (2020). “Review visual attention and spatial memory in building inspection: Toward a cognition-driven information system.” Advanced Engineering Informatics, 44, 101061.
Shi, Y., Du, J., and Worthy, D. A. (2020). “The impact of engineering information formats on learning and execution of construction operations: A virtual reality pipe maintenance experiment.” Automation in Construction, 119, 103367.
Shi, Y., Du, J., and Zhu, Q. (2020). “The impact of engineering information format on task performance: Gaze scanning pattern analysis.” Advanced Engineering Informatics, 46, 101167.
Tobii. (2017). “Tobii Eye Tracker 4C.” <https://gaming.tobii.com/product/tobii-eye-tracker-4c/>.
Tobii. (2019). “How do Tobii Eye Trackers work?”, <https://www.tobiipro.com/learn-and-support/learn/eye-tracking-essentials/how-do-tobii-eye-trackers-work/>. (October 21th, 2019).
Toker, D., Conati, C., Steichen, B., and Carenini, G. “Individual user characteristics and information visualization: connecting the dots through eye tracking.” Proc., proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 295–304.
Verney, S. P., Granholm, E., and Dionisio, D. P. (2001). “Pupillary responses and processing resources on the visual backward masking task.” Psychophysiology, 38(1), 76–83.
Wang, Q., Yang, S., Liu, M., Cao, Z., and Ma, Q. (2014). “An eye-tracking study of website complexity from cognitive load perspective.” Decision support systems, 62, 1–10.
Wu, C., Cha, J., Sulek, J., Zhou, T., Sundaram, C. P., Wachs, J., and Yu, D. (2019). “Eye-Tracking Metrics Predict Perceived Workload in Robotic Surgical Skills Training.” Human Factors, 0018720819874544.
Information & Authors
Information
Published In
Construction Research Congress 2022
Pages: 1033 - 1041
History
Published online: Mar 7, 2022
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.