Online Assessment of Spontaneous Mental Fatigue in Construction Workers Considering Data Quality: Improved Online Sequential Extreme Learning Machine
Publication: Journal of Construction Engineering and Management
Volume 150, Issue 11
Abstract
Biological data-based methods for monitoring workers’ mental fatigue have become widely adopted in recent years. However, few have concentrated on the online monitoring and assessment of mental fatigue considering the complexity and high dimension of the biological data, especially for scenarios where data arrives continuously in the form of flows. This study aimed to propose an online learning model to learn model parameters according to the order of data acquisition. Specifically, the fuzziness-based online sequential extreme learning machine (Fuzziness-OS-ELM) model was proposed, consisting of two parts: (1) a data value estimator; and (2) an online mental fatigue classification model. As new data arrives, the Fuzziness-OS-ELM model can effectively identify and select samples with high data quality based on fuzziness, which are then used to continuously update the online mental fatigue classification model. A cognitive experiment was carried out to evaluate the Fuzziness-OS-ELM model. The results indicated that samples with low fuzziness corresponded to high data quality. The proposed online sequential learning model exhibited enhanced classification performance on mental fatigue. This study’s dynamic diagnostic method for identifying the onset and progression of mental fatigue can provide targeted support for precise interventions aimed at construction workers.
Practical Applications
Different from subjective and passive management of mental fatigue, this study proposed an enabling technology for minimally obtrusive monitoring and online feedback on construction workers, allowing for monitoring over extended periods of time on construction sites. With the online visualization of mental statuses, workers in special construction operations at inappropriate mental fatigue levels can be found. The ability to monitor fluctuations allows for immediate and proactive interventions, thereby addressing mental fatigue more effectively than interval-based monitoring methods. Based on the portability of the research outcomes, long-term mental status data of workers on sites can be collected. Through revealing the generation and development rules of construction workers’ psychological load, targeted industry-wide guidance will be developed and promoted.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
The data, models, or code supporting this study’s findings are available from the corresponding author upon a reasonable request.
Acknowledgments
The authors gratefully acknowledge the supports of the Humanities and Social Sciences Fund of the Education Ministry of China (No. 23YJCZH251), China Postdoctoral Science Foundation (No. 2023M733923), Hong Kong Research Grants Council Theme-based Research Scheme (No. T22-505/19-N), Shenzhen-Hong Kong-Macau S&T Program (Category C) (No. SGDX20201103095203031), and all the experimental subjects.
References
Antwi-Afari, M., S. Anwer, W. Umer, H. Mi, Y. Yu, S. Moon, and U. Hossain. 2022. “Machine learning-based identification and classification of physical fatigue levels: A novel method based on a wearable insole device.” Int. J. Ind. Ergon 93 (Jan): 103404. https://doi.org/10.1016/j.ergon.2022.103404.
Aryal, A., A. Ghahramani, and B. Becerik-Gerber. 2017. “Monitoring fatigue in construction workers using physiological measurements.” Autom. Constr. 82 (Oct): 154–165. https://doi.org/10.1016/j.autcon.2017.03.003.
Ashfaq, R., and X. Wang. 2017. “Impact of fuzziness categorization on divide and conquer strategy for instance selection.” J. Intell. Fuzzy Syst. 33 (2): 1007–1018. https://doi.org/10.3233/JIFS-162297.
Borragán, G., H. Slama, A. Destrebecqz, and P. Peigneux. 2016. “Cognitive fatigue facilitates procedural sequence learning.” Front. Hum. Neurosci. 10 (Mar): 86. https://doi.org/10.3389/fnhum.2016.00086.
Brouwer, A., M. Hogervorst, J. van Erp, T. Heffelaar, P. Zimmerman, and R. Oostenveld. 2012. “Estimating workload using EEG spectral power and ERPs in the n-back task.” J. Neural Eng. 9 (4): 045008. https://doi.org/10.1088/1741-2560/9/4/045008.
Cao, W., J. Gao, Z. Ming, S. Cai, and Z. Shan. 2018. Fuzziness-based online sequential extreme learning machine for classification problems. Berlin: Springer.
Cesa-Bianchi, N., and F. Orabona. 2021. “Online learning algorithms.” Annu. Rev. Stat. Appl. 8 (1): 165–190. https://doi.org/10.1146/annurev-statistics-040620-035329.
Chen, J., X. Song, and Z. Lin. 2016. “Revealing the ‘Invisible Gorilla’ in construction: Estimating construction safety through mental workload assessment.” Autom. Constr. 63 (Mar): 173–183. https://doi.org/10.1016/j.autcon.2015.12.018.
Chen, R., et al. 2015. “Research on multi-dimensional N-back task induced EEG variations.” In Proc., 37th Annual Int. Conf. of the IEEE Engineering in Medicine and Biology Society (EMBC), 5163–5166. New York: IEEE. https://doi.org/10.1109/EMBC.2015.7319554.
Cheng, B., C. Fan, H. Fu, J. Huang, H. Chen, and X. Luo. 2022. “Measuring and computing cognitive statuses of construction workers based on electroencephalogram: A critical review.” IEEE Trans. Comput. Social Syst. 9 (6): 1644–1659. https://doi.org/10.1109/TCSS.2022.3158585.
Choi, B., and S. Lee. 2017. “Role of social norms and social identifications in safety behavior of construction workers. II: Group analyses for the effects of cultural backgrounds and organizational structures on social influence process.” J. Constr. Eng. Manage. 143 (5): 04016125. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001254.
Choi, S., C. Han, G. Choi, J. Shin, K. Song, C. Im, and H. Hwang. 2018. “On the feasibility of using an ear-EEG to develop an endogenous brain-computer interface.” Sensors 18 (9): 2856. https://doi.org/10.3390/s18092856.
Fang, D., Z. Jiang, M. Zhang, and H. Wang. 2015. “An experimental method to study the effect of fatigue on construction workers’ safety performance.” Saf. Sci. 73 (Mar): 80–91. https://doi.org/10.1016/j.ssci.2014.11.019.
Fang, Q., X. Chen, D. Castro-lacouture, and C. Li. 2023. “Intervention and management of construction workers’ unsafe behavior: A simulation digital twin model.” Adv. Eng. Inf. 58 (Oct): 102182. https://doi.org/10.1016/j.aei.2023.102182.
Fang, W., D. Wu, P. Love, L. Ding, and H. Luo. 2022a. “Physiological computing for occupational health and safety in construction: Review, challenges and implications for future research.” Adv. Eng. Inf. 54 (Oct): 101729. https://doi.org/10.1016/j.aei.2022.101729.
Fang, X., H. Li, S. Zhang, X. Wang, and C. Wang. 2022b. “A combined finite element and deep learning network for structural dynamic response estimation on concrete gravity dam subjected to blast loads.” Def. Technol. 24 (Jun): 298–313. https://doi.org/10.1016/j.dt.2022.04.012.
Fang, X., X. Yang, X. Xing, J. Wang, W. Umer, and W. Guo. 2024. “Real-time monitoring of mental fatigue of construction workers using enhanced sequential learning and timeliness.” Autom. Constr. 159 (Mar): 105267. https://doi.org/10.1016/j.autcon.2024.105267.
Gangopadhyay, S., and S. Das. 2021. “Fuzzy theory based quality assessment of multivariate electrical measurements of smart grids.” IEEE Access 9 (Jul): 97686–97704. https://doi.org/10.1109/ACCESS.2021.3094671.
Gatti, U., S. Schneider, and G. Migliaccio. 2014. “Physiological condition monitoring of construction workers.” Autom. Constr. 44 (Aug): 227–233. https://doi.org/10.1016/j.autcon.2014.04.013.
Gawron, V., J. French, and D. Funke. 2001. “An overview of fatigue.” In Stress, workload, and fatigue, 581–595. Mahwah, NJ: Lawrence Erlbaum Associates Publishers.
Hajonides, J., A. Nobre, F. van Ede, and M. Stokes. 2021. “Decoding visual colour from scalp electroencephalography measurements.” NeuroImage 237 (Aug): 118030. https://doi.org/10.1016/j.neuroimage.2021.118030.
Hall, M. 2000. “Correlation-based feature selection for discrete and numeric class machine learning.” In Proc., 17th Int. Conf. on Machine Learning, 359–366. Burlington, MA: Morgan Kaufmann Publishers.
Han, S., N. Kwak, T. Oh, and S. Lee. 2020. “Classification of pilots’ mental states using a multimodal deep learning network.” Biocybern. Biomed. Eng. 40 (1): 324–336. https://doi.org/10.1016/j.bbe.2019.12.002.
Hartley, L., P. Arnold, G. Smythe, and J. Hansen. 1994. “Indicators of fatigue in truck drivers.” Appl. Ergon. 25 (3): 143–156. https://doi.org/10.1016/0003-6870(94)90012-4.
Hopstaken, J., D. Linden, and M. Kompier. 2015. “Multifaceted investigation of the link between mental fatigue and task disengagement.” Psychophysiology 52 (3): 305–315. https://doi.org/10.1111/psyp.12339.
Hwang, S., H. Jebelli, B. Choi, M. Choi, and S. Lee. 2018. “Measuring workers’ emotional state during construction tasks using wearable EEG.” J. Constr. Eng. Manage. 144 (7): 04018050. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001506.
Jagtap, S., and M. Uplane. 2012. “The impact of digital filtering to ECG analysis: Butterworth filter application.” In Proc., 2012 Int. Conf. on Communication, Information & Computing Technology (ICCICT), 1–6. New York: IEEE.
Jebelli, H., S. Hwang, and S. Lee. 2017. “EEG signal-processing framework to obtain high-quality brain waves from an off-the-shelf wearable EEG device.” J. Comput. Civ. Eng. 32 (1): 04017070. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000719.
Jebelli, H., S. Hwang, and S. Lee. 2018. “EEG-based workers’ stress recognition at construction sites.” Autom. Constr. 93 (Sep): 315–324. https://doi.org/10.1016/j.autcon.2018.05.027.
Jiang, Z., D. Fang, and M. Zhang. 2015. “Understanding the causation of construction workers’ unsafe behaviors based on system dynamics modeling.” J. Manage. Eng. 31 (6): 04014099. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000350.
Jiao, Y., X. Wang, Y. Kang, Z. Zhong, and W. Chen. 2023. “A quick identification model for assessing human anxiety and thermal comfort based on physiological signals in a hot and humid working environment.” Int. J. Ind. Ergon 94 (Mar): 103423. https://doi.org/10.1016/j.ergon.2023.103423.
Kappel, S., M. Rank, H. Toft, M. Andersen, and P. Kidmose. 2019. “Dry-contact electrode ear-EEG.” IEEE Trans. Bio-Med. Eng. 66 (1): 150–158. https://doi.org/10.1109/TBME.2018.2835778.
Kohout, L., M. Butz, and W. Stork. 2019. “Using acceleration data for detecting temporary cognitive overload in health care exemplified shown in a pill sorting task.” In Proc., 2019 IEEE 32nd Int. Symp. on Computer-Based Medical Systems (CBMS). New York: IEEE.
Kontonasios, K. N., J. Vreeken, and T. D. Bie. 2011. “Maximum entropy modelling for assessing results on real-valued data.” In Proc., 2011 IEEE 11th Int. Conf. on Data Mining, 350–359. New York: IEEE.
Lee, B., B. Lee, and W. Chung. 2014. “Mobile healthcare for automatic driving sleep-onset detection using wavelet-based EEG and respiration signals.” Sensors 14 (10): 17915–17936. https://doi.org/10.3390/s141017915.
Lerman, S., E. Eskin, D. Flower, E. George, B. Gerson, N. Hartenbaum, S. Hursh, and M. Moore-Ede. 2012. “Fatigue risk management in the workplace.” J. Occup. Environ. Med. 54 (2): 231–258. https://doi.org/10.1097/JOM.0b013e318247a3b0.
Li, G., S. Jia, and H. Li. 2019a. “Efficiency evaluation of structural nonlinear analysis method based on the Woodbury formula.” Eng. Comput. 36 (4): 1082–1100. https://doi.org/10.1108/EC-09-2018-0393.
Li, H., M. Lu, S. Hsu, M. Gray, and T. Huang. 2015. “Proactive behavior-based safety management for construction safety improvement.” Saf. Sci. 75 (Jun): 107–117. https://doi.org/10.1016/j.ssci.2015.01.013.
Li, H., D. Wang, J. Chen, X. Luo, J. Li, and X. Xing. 2019b. “Pre-service fatigue screening for construction workers through wearable EEG-based signal spectral analysis.” Autom. Constr. 106 (Oct): 102851. https://doi.org/10.1016/j.autcon.2019.102851.
Li, J., H. Li, W. Umer, H. Wang, and J. Hou. 2020. “Identification and classification of construction equipment operators’ mental fatigue using wearable eye-tracking technology.” Autom. Constr. 109 (Jan): 103000. https://doi.org/10.1016/j.autcon.2019.103000.
Li, J., H. Li, H. Wang, W. Umer, H. Fu, and X. Xing. 2019c. “Evaluating the impact of mental fatigue on construction equipment operators’ ability to detect hazards using wearable eye-tracking technology.” Autom. Constr. 105 (Sep): 102835. https://doi.org/10.1016/j.autcon.2019.102835.
Li, Y., X. Chao, and S. Ercisli. 2022. “Disturbed-entropy: A simple data quality assessment approach.” ICT Express 8 (3): 309–312. https://doi.org/10.1016/j.icte.2022.01.006.
Liang, N. Y., G. B. Huang, P. Saratchandran, and N. Sundararajan. 2006. “A fast and accurate online sequential learning algorithm for feedforward networks.” IEEE Trans. Neural Networks 17 (6): 1411–1423. https://doi.org/10.1109/TNN.2006.880583.
Liu, Y., Z. Lan, H. Khoon, H. Li, and W. Muller-Wittig. 2018. “EEG-based evaluation of mental fatigue using machine learning algorithms.” In Proc., 2018 Int. Conf. on Cyberworlds (CW), 276–279. New York: IEEE.
Liu, Y., G. Ye, Q. Xiang, J. Yang, G. Miang, and L. Gan. 2023. “Antecedents of construction workers’ safety cognition: A systematic review.” Saf. Sci. 157 (Jan): 105923. https://doi.org/10.1016/j.ssci.2022.105923.
Looney, D., P. Kidmose, C. Park, M. Ungstrup, M. Park, K. Rosenkranz, and D. Mandic. 2012. “The in-the-ear recording concept: User-centered and wearable brain monitoring.” IEEE Pulse 3 (6): 32–42. https://doi.org/10.1109/MPUL.2012.2216717.
Ma, J., et al. 2023. “Fatigue assessment of construction equipment operators using a sweat lactate biosensor.” Int. J. Ind. Ergon. 96 (Jul): 103472. https://doi.org/10.1016/j.ergon.2023.103472.
Ma, Q., X. Zhou, L. Zhao, J. Bian, and W. Dai. 2014. “The difference of physiological indicators of ground and underground subway workers: A preliminary field study.” Appl. Mech. Mater. 3558 (670): 1608–1611. https://doi.org/10.4028/www.scientific.net/AMM.670-671.1608.
Majid, F., M. Majid, H. Rashid, R. Ali, and M. Shinji. 2016. “Effects of mental workload on physiological and subjective responses during traffic density monitoring: A field study.” Appl. Ergon. 52 (Jan): 95–103. https://doi.org/10.1016/j.apergo.2015.07.009.
Malik, M., J. Bigger, A. Camm, R. Kleiger, A. Malliani, A. Moss, and P. Schwartz. 1996. “Heart rate variability: Standards of measurement, physiological interpretation, and clinical use.” EHJ 17 (3): 354–381. https://doi.org/10.1111/j.1542-474X.1996.tb00275.x.
Mehmood, I., H. Li, Y. Qarout, W. Umer, S. Anwer, H. Wu, M. Hussain, and M. Antwi-Afari. 2023. “Deep learning-based construction equipment operators’ mental fatigue classification using wearable EEG sensor data.” Adv. Eng. Inf. 56 (Apr): 101978. https://doi.org/10.1016/j.aei.2023.101978.
Mehmood, I., H. Li, W. Umer, A. Arsalan, M. Shakeel, and S. Anwer. 2022. “Validity of facial features’ geometric measurements for real-time assessment of mental fatigue in construction equipment operators.” Adv. Eng. Inf. 54 (Oct): 101777. https://doi.org/10.1016/j.aei.2022.101777.
Michielsen, H., J. Vries, G. Heck, F. Vijver, and K. Sijtsma. 2004. “Examination of the dimensionality of fatigue: The construction of the fatigue assessment scale (FAS).” Eur. J. Psychol. Assess. 20 (1): 39–48. https://doi.org/10.1027/1015-5759.20.1.39.
Micklewright, D., A. St Clair Gibson, V. Gladwell, and A. Al Salman. 2017. “Development and validity of the rating-of-fatigue scale.” Sports Med. 47 (Nov): 2375–2393. https://doi.org/10.1007/s40279-017-0711-5.
Pan, J., and W. Tompkins. 2007. “A real-time QRS detection algorithm.” IEEE Transact. Bio-Med. Eng. BME-32 (3): 230–236. https://doi.org/10.1109/TBME.1985.325532.
Paulus, D., G. de Vries, and B. Van de Walle. 2019. “Effects of data ambiguity and cognitive biases on the interpretability of machine learning models in humanitarian decision making.” Preprint, submitted November 12, 2019. https://arxiv.org/abs/arxiv.1911.04787.
Picard, R., S. Fedor, and Y. Ayzenberg. 2016. “Multiple arousal theory and daily-life electrodermal activity asymmetry.” Emotion Rev. 8 (1): 62–75. https://doi.org/10.1177/1754073914565517.
Ren, Q., M. Li, T. Kong, and J. Ma. 2022. “Multi-sensor real-time monitoring of dam behavior using self-adaptive online sequential learning.” Autom. Constr. 140 (Aug): 104365. https://doi.org/10.1016/j.autcon.2022.104365.
Sargolzaei, A., K. Faez, and S. Sargolzaei. 2010. “A new robust wavelet based algorithm for baseline wandering cancellation in ECG signalsm.” In Proc., 2009 IEEE Int. Conf. on Signal and Image Processing Applications. New York: IEEE.
Shanghai Hanzhong Network Technology Co., Ltd. 2024. “Human ear anatomy illustration (ID: 0m4mwl).” Accessed July 11, 2024. https://xsj.699pic.com/.
Smets, E., B. Garssen, B. Bonke, and J. De Haes. 1995. “The multidimensional fatigue inventory (MFI) psychometric qualities of an instrument to assess fatigue.” J. Psychosom. Res. 39 (3): 315–325. https://doi.org/10.1016/0022-3999(94)00125-o.
Song, A., C. Niu, X. Ding, X. Xu, and Z. Song. 2019. “Mental fatigue prediction model based on multimodal fusion.” IEEE Access 7 (Sep): 177056–177062. https://doi.org/10.1109/ACCESS.2019.2941043.
Wang, X., R. Ashfaq, A. Fu, and R. Langari. 2015a. “Fuzziness based sample categorization for classifier performance improvement.” J. Intell. Fuzzy Syst. 29 (3): 1–12. https://doi.org/10.3233/IFS-151729.
Wang, X., H. Xing, Y. Li, Q. Hua, C. Dong, and W. Pedrycz. 2015b. “A study on relationship between generalization abilities and fuzziness of base classifiers in ensemble learning.” IEEE Trans. Fuzzy Syst. 23 (5): 1638–1654. https://doi.org/10.1109/TFUZZ.2014.2371479.
Wang, Y., Y. Huang, B. Gu, S. Cao, and D. Fang. 2023. “Identifying mental fatigue of construction workers using EEG and deep learning.” Autom. Constr. 151 (Jul): 104887. https://doi.org/10.1016/j.autcon.2023.104887.
Wei, Z., C. Wu, X. Wang, A. Supratak, P. Wang, and Y. Guo. 2018. “Using support vector machine on EEG for advertisement impact assessment.” Front. Neurosci. 12 (Mar): 76. https://doi.org/10.3389/fnins.2018.00076.
Wong, D., J. Chung, A. Chan, F. Wong, and W. Yi. 2014. “Comparing the physiological and perceptual responses of construction workers (bar benders and bar fixers) in a hot environment.” Appl. Ergon. 45 (6): 1705–1711. https://doi.org/10.1016/j.apergo.2014.06.002.
Xing, X., H. Li, J. Li, B. Zhong, and M. Skitmore. 2019. “A multicomponent and neurophysiological intervention for the emotional and mental states of high-altitude construction workers.” Autom. Constr. 105 (Sep): 102836. https://doi.org/10.1016/j.autcon.2019.102836.
Xing, X., B. Zhong, H. Luo, T. Rose, J. Li, and M. Antwi-Afari. 2020. “Effects of physical fatigue on the induction of mental fatigue of construction workers: A pilot study based on a neurophysiological approach.” Autom. Constr. 120 (Dec): 103381. https://doi.org/10.1016/j.autcon.2020.103381.
Yin, Z., and J. Zhang. 2018. “Task-generic mental fatigue recognition based on neurophysiological signals and dynamical deep extreme learning machine.” Neurocomputing 283 (Mar): 266–281. https://doi.org/10.1016/j.neucom.2017.12.062.
Yu, K., Q. Cao, C. Xie, N. Qu, and L. Zhou. 2019a. “Analysis of intervention strategies for coal miners’ unsafe behaviors based on analytic network process and system dynamics.” Saf. Sci. 118 (6): 145–157. https://doi.org/10.1016/j.ssci.2019.05.002.
Yu, Y., H. Li, X. Yang, L. Kong, X. Luo, and A. Wong. 2019b. “An automatic and non-invasive physical fatigue assessment method for construction workers.” Autom. Constr. 103 (Jul): 1–12. https://doi.org/10.1016/j.autcon.2019.02.020.
Zadeh, L. 1968. “Probability measures of Fuzzy events.” J. Math. Anal. Appl. 23 (2): 421–427. https://doi.org/10.1016/0022-247X(68)90078-4.
Zeng, Z., Z. Huang, K. Leng, W. Han, and J. Zang. 2020. “Nonintrusive monitoring of mental fatigue status using epidermal electronic systems and machine-learning algorithms.” ACS Sens. 5 (5): 1305–1313. https://doi.org/10.1021/acssensors.9b02451.
Zhang, H., S. Zhang, and Y. Yin. 2017. “Online sequential ELM algorithm with forgetting factor for real applications.” Neurocomputing 261 (Oct): 144–152. https://doi.org/10.1016/j.neucom.2016.09.121.
Zhang, X., X. Yang, Y. Ding, Y. Wang, J. Zhou, and L. Zhang. 2021. “Contactless simultaneous breathing and heart rate detections in physical activity using IR-UWB radars.” Sensors 21 (16): 5503. https://doi.org/10.3390/S21165503.
Zhou, X., Z. Liu, and C. Zhu. 2014. “Online regularized and kernelized extreme learning machines with forgetting mechanism.” Math. Probl. Eng. 2014 (1): 938548. https://doi.org/10.1155/2014/938548.
Information & Authors
Information
Published In
Journal of Construction Engineering and Management
Volume 150 • Issue 11 • November 2024
Copyright
© 2024 American Society of Civil Engineers.
History
Received: Oct 21, 2023
Accepted: May 23, 2024
Published online: Aug 21, 2024
Published in print: Nov 1, 2024
Discussion open until: Jan 21, 2025
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.