Detection of Cognitive Loads during Exoskeleton Use for Construction Flooring Work
Publication: Construction Research Congress 2024
ABSTRACT
Active back-support exoskeletons are increasingly being perceived as potential solutions to the ergonomic risks of construction work. However, users of exoskeletons are susceptible to increased cognitive load could thwart the benefits of the device. Using self-reported cognitive load and electroencephalogram (EEG) data, this study investigated the detection of the cognitive load of users of an active back-support exoskeleton. EEG data and perceived ratings of cognitive load from participants performing flooring tasks are trained with several classifiers. The performance of the best classifier, Ensemble, improved using synthetic minority oversampling technique. This study contributes to existing knowledge by providing evidence of the extent to which cognitive load can be detected from the brain activity of exoskeleton users. The study also advances knowledge of the extent to which synthetic data could enhance the detection of cognitive load. Therefore, the study opens doors for improving exoskeleton designs to better support human cognition and performance.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Awada, M., F. J. Srour, and I. M. Srour. (2021). “Data-driven machine learning approach to integrate field submittals in project scheduling.” Journal of Management in Engineering 37(1): 04020104. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000873.
Bilalpur, M., M. Kankanhalli, S. Winkler, and R. Subramanian. (2018). EEG-based evaluation of cognitive workload induced by acoustic parameters for data sonification. Proceedings of the 20th ACM International Conference on Multimodal Interaction. https://doi.org/10.1145/3242969.3243016.
Capitani, S. L., M. Bianchi, N. Secciani, M. Pagliai, E. Meli, and A. Ridolfi. (2021). “Model-based mechanical design of a passive lower-limb exoskeleton for assisting workers in shotcrete projection.” Meccanica 56: 195–210.
CDCP. (2023). “Exoskeletons in Construction: Will they reduce or create hazards?” Retrieved March 25, 2023, from https://blogs.cdc.gov/niosh-science-blog/2017/06/15/exoskeletons-in-construction/#:~:text=Musculoskeletal%20disorders%20(MSDs)%20are%20a,one%2Dthird%20of%20these%20injuries.
Cohen, M. X. (2017). “Where does EEG come from and what does it mean?” Trends in neurosciences 40(4): 208–218. https://doi.org/10.1016/j.tins.2017.02.004.
Delorme, A., and S. Makeig. (2004). “EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis.” Journal of neuroscience methods 134(1): 9–21.
Fox, S., O. Aranko, J. Heilala, and P. Vahala. (2019). “Exoskeletons: Comprehensive, comparative and critical analyses of their potential to improve manufacturing performance.” Journal of Manufacturing Technology Management 31(6): 1261–1280. https://doi.org/10.1108/JMTM-01-2019-0023.
Huysamen, K., M. de Looze, T. Bosch, J. Ortiz, S. Toxiri, and L. W. O’Sullivan. (2018). “Assessment of an active industrial exoskeleton to aid dynamic lifting and lowering manual handling tasks.” Appl Ergon 68: 125–131. https://doi.org/10.1016/j.apergo.2017.11.004.
Hwang, S., H. Jebelli, B. Choi, M. Choi, and S. Lee. (2018). “Measuring workers’ emotional state during construction tasks using wearable EEG.” Journal of Construction Engineering and Management 144(7): 04018050. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001506.
Jebelli, H., S. Hwang, and S. Lee. (2018). “EEG signal-processing framework to obtain high-quality brain waves from an off-the-shelf wearable EEG device.” Journal of Computing in Civil Engineering 32(1): 04017070. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000719.
Jeon, J., and H. Cai. (2021). “Classification of construction hazard-related perceptions using: Wearable electroencephalogram and virtual reality.” Automation in Construction 132: 103975. 103975. https://doi.org/10.1016/j.autcon.2021.103975.
Jiang, K., J. Lu, and K. Xia. (2016). “A novel algorithm for imbalance data classification based on genetic algorithm improved SMOTE.” Arabian journal for science and engineering 41: 3255–3266. DOI 10.1007/s13369-016-2179-2.
Kim, S., M. A. Nussbaum, M. Smets, and S. Ranganathan. (2021). “Effects of an arm‐support exoskeleton on perceived work intensity and musculoskeletal discomfort: An 18‐month field study in automotive assembly.” American Journal of Industrial Medicine 64(11): 905–914. https://doi.org/10.1007/s40846-021-00644-w.
Linnenberg, C., and R. Weidner. (2022). “Industrial exoskeletons for overhead work: Circumferential pressures on the upper arm caused by the physical human-machine-interface.” Applied Ergonomics 101: 103706. https://doi.org/10.1016/j.apergo.2022.103706.
Liu, Y., M. Habibnezhad, and H. Jebelli. (2021). “Brainwave-driven human-robot collaboration in construction.” Automation in Construction 124: 103556. https://doi.org/10.1016/j.autcon.2021.103556.
Liu, Y., X. Li, J. Lai, A. Zhu, X. Zhang, Z. Zheng, H. Zhu, Y. Shi, L. Wang, and Z. Chen. (2021). “The effects of a passive exoskeleton on human thermal responses in temperate and cold environments.” International Journal of Environmental Research and Public Health 18(8): 3889. https://doi.org/10.3390/ijerph18083889.
Mahmoodzadeh, A., M. Mohammadi, A. Daraei, H. F. H. Ali, N. K. Al-Salihi, and R. M. D. Omer (2020). “Forecasting maximum surface settlement caused by urban tunneling.” Automation in Construction 120: 103375. https://doi.org/10.1016/j.autcon.2020.103375.
Ogunseiju, O., N. Gonsalves, A. Akanmu, and C. Nnaji. (2021). “Subjective Evaluation of Passive Back-Support Exoskeleton for Flooring Work.” EPiC Series in Built Environment 2: 10–17.
Okpala, I., C. Nnaji, O. Ogunseiju, and A. Akanmu. (2022). “Assessing the Role of Wearable Robotics in the Construction Industry: Potential Safety Benefits, Opportunities, and Implementation Barriers.” Automation and Robotics in the Architecture, Engineering, and Construction Industry: 165–180. https://doi.org/10.1007/978-3-030-77163-8_8.
Salaken, S. M., I. Hettiarachchi, L. Crameri, S. Hanoun, T. Nguyen, and S. Nahavandi. (2020). Evaluation of classification techniques for identifying cognitive load levels using EEG signals. 2020 IEEE International Systems Conference (SysCon), IEEE. https://doi.org/10.1109/SysCon47679.2020.9381828.
Shayesteh, S., and H. Jebelli. (2022). Investigating the Impact of Construction Robots Autonomy Level on Workers’ Cognitive Load. Proceedings of the Canadian Society of Civil Engineering Annual Conference 2021: CSCE21 General Track Volume 1, Springer. https://doi.org/10.1007/978-981-19-0503-2_21.
von Glinski, A., E. Yilmaz, S. Mrotzek, E. Marek, B. Jettkant, A. Brinkemper, C. Fisahn, T. A. Schildhauer, and J. Geßmann. (2019). “Effectiveness of an on-body lifting aid (HAL® for care support) to reduce lower back muscle activity during repetitive lifting tasks.” Journal of Clinical Neuroscience 63: 249–255. https://doi.org/10.1016/j.jocn.2019.01.038.
Wang, J., M. Xu, H. Wang, and J. Zhang. (2006). Classification of imbalanced data by using the SMOTE algorithm and locally linear embedding. 2006 8th International Conference on Signal Processing, IEEE. https://doi.org/10.1109/ICOSP.2006.345752.
Zarjam, P., J. Epps, and N. H. Lovell. (2015). “Beyond subjective self-rating: EEG signal classification of cognitive workload.” IEEE Transactions on Autonomous Mental Development 7(4): 301–310. https://doi.org/10.1109/TAMD.2015.2441960.
Zhu, Y., E. B. Weston, R. K. Mehta, and W. S. Marras. (2021). “Neural and biomechanical tradeoffs associated with human-exoskeleton interactions.” Applied Ergonomics 96: 103494. https://doi.org/10.1016/j.apergo.2021.103494.
Information & Authors
Information
Published In
Construction Research Congress 2024
Pages: 885 - 895
History
Published online: Mar 18, 2024
ASCE Technical Topics:
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.