Contactless Vital-Sign Monitoring of Construction Machinery Operators Using Millimeter-Wave Technology
Publication: Journal of Construction Engineering and Management
Volume 151, Issue 1
Abstract
Accidents related to construction machinery primarily result from operators engaging in unsafe behavior. Continuous monitoring of the vital signs of heavy machinery operators is necessary to enable timely intervention in the event of abnormal physical or mental states, thereby reducing the risk of accidents. Researchers have proposed methods for monitoring vital signs in heavy machinery operators through wearable devices. However, sensor-based wearable systems, such as surface electromyography, are often invasive or necessitate the affixing of numerous sensors to the workers’ bodies, which may result in discomfort for the workers and potential instability within the system, thereby constraining their utilization on construction sites. To mitigate these limitations, this study proposes a contactless monitoring method based on millimeter-wave (MMW) radar and tests the accuracy and robustness of the method. Ten participants of various figures were recruited for sensing and robustness tests within a simulated heavy machinery cabin. The experimental results demonstrate that MMW radar can accurately monitor the respiration rate and heart rate of heavy machinery operators within a range of horizontally and vertically and unaffected by illumination and attire conditions. The proposed method has great potential for enabling continuous monitoring of vital signs in heavy machinery operators in harsh construction environments. Further analysis of the vital sign information obtained from MMW radar can be involved to enable future research, such as fatigue monitoring and attention assessment.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or code that support the findings of this study are available from the corresponding author upon reasonable request.
Acknowledgments
This work was supported by the National Natural Science Foundation of China (Grant Nos. 42302322, 72271186); Open Research Fund of State Key Laboratory of Hydraulic Engineering Intelligent Construction and Operation, Tianjin University (Grant No. HESS-2406); General Research Fund grant [15201621] titled “Monitoring and managing fatigue of construction plant and equipment operators exposed to prolonged sitting”; and General Research Fund grant [15210923] titled “Non-invasive non-contact mental workload and stress monitoring of construction equipment operators.”
References
Abdelnasser, H., K. A. Harras, and M. Youssef. 2015. “UbiBreathe: A ubiquitous non-invasive WiFi-based breathing estimator.” In Proc., 16th ACM Int. Symp. on Mobile Ad Hoc Networking and Computing, 277–286. New York: Association for Computing Machinery.
Abuella, H., and S. Ekin. 2020. “Non-contact vital signs monitoring through visible light sensing.” IEEE Sens. J. 20 (7): 3859–3870. https://doi.org/10.1109/JSEN.2019.2960194.
Ahmed, S., J. Park, and S. H. Cho. 2022. “Effects of receiver beamforming for vital sign measurements using FMCW radar at various distances and angles.” Sensors 22 (18): 6877. https://doi.org/10.3390/s22186877.
Ahn, C. R., S. Lee, C. F. Sun, H. Jebelli, K. Yang, and B. Choi. 2019. “Wearable sensing technology applications in construction safety and health.” J. Constr. Eng. Manage. 145 (11): 03119007. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001708.
Anwer, S., H. Li, M. F. Antwi-Afari, A. M. Mirza, M. A. Rahman, I. Mehmood, R. Guo, and A. Y. L. Wong. 2024. “Evaluation of data processing and artifact removal approaches used for physiological signals captured using wearable sensing devices during construction tasks.” J. Constr. Eng. Manage. 150 (1): 03123008. https://doi.org/10.1061/JCEMD4.COENG-13263.
Anwer, S., H. Li, M. F. Antwi-Afari, W. Umer, I. Mehmood, M. Al-Hussein, and A. Y. L. Wong. 2021a. “Test-retest reliability, validity, and responsiveness of a textile-based wearable sensor for real-time assessment of physical fatigue in construction bar-benders.” J. Build. Eng. 44 (Dec): 103348. https://doi.org/10.1016/j.jobe.2021.103348.
Anwer, S., H. Li, M. F. Antwi-Afari, W. Umer, and A. Y. L. Wong. 2021b. “Evaluation of physiological metrics as real-time measurement of physical fatigue in construction workers: State-of-the-art review.” J. Constr. Eng. Manage. 147 (5): 03121001. https://doi.org/10.1061/(ASCE)CO.1943-7862.0002038.
Anwer, S., H. Li, W. Umer, M. F. Antwi-Afari, I. Mehmood, Y. T. Yu, C. Haas, and A. Y. L. Wong. 2023. “Identification and classification of physical fatigue in construction workers using linear and nonlinear heart rate variability measurements.” J. Constr. Eng. Manage. 149 (7): 04023057. https://doi.org/10.1061/JCEMD4.COENG-13100.
Bland, J. M., and D. G. Altman. 1986. “Statistical methods for assessing agreement between two methods of clinical measurement.” Lancet 327 (8476): 307–310. https://doi.org/10.1016/S0140-6736(86)90837-8.
Bresnahan, D. G., Y. Li, and IEEE. 2022. “Measurement of multiple simultaneous human vital signs using a millimeter-wave FMCW radar.” In Proc., IEEE Radar Conf. (RadarConf). New York: IEEE.
Chen, F. K., Y. K. Wang, H. P. Lin, C. Y. Chen, S. M. Yeh, C. Y. Wang, and I. C. Soc. 2022. “Feasibility study for apnea screening in patients’ homes using radar and machine learning method.” In Proc., IEEE 22nd Int. Conf. on Bioinformatics and Bioengineering (BIBE), 282–287. New York: IEEE.
Cheng, Y., C. Pang, M. Jiang, and Y. Liu. 2023. “Relocalization based on millimeter wave radar point cloud for visually degraded environments.” J. Field Rob. 40 (4): 901–918. https://doi.org/10.1002/rob.22162.
Cheng, Y., J. Su, M. Jiang, and Y. Liu. 2022. “A novel radar point cloud generation method for robot environment perception.” IEEE Trans. Rob. 38 (6): 3754–3773. https://doi.org/10.1109/TRO.2022.3185831.
Churkin, S., L. Anishchenko, and IEEE. 2015. “Millimeter-wave radar for vital signs monitoring.” In Proc., IEEE Int. Conf. on Microwaves, Communications, Antennas and Electronic Systems (COMCAS). New York: IEEE.
Diebold, S., S. Ayhan, S. Scherr, H. Massler, A. Tessmann, A. Leuther, O. Ambacher, T. Zwick, and I. Kallfass. 2012. “A w-band MMIC radar system for remote detection of vital signs.” J. Infrared Millim. Terahertz Waves 33 (12): 1250–1267. https://doi.org/10.1007/s10762-012-9941-7.
Dijkstra, M. S., R. Soer, A. Bieleman, R. McCraty, F. Oosterveld, D. Gross, and M. Reneman. 2019. “Exploring a 1-minute paced deep-breathing measurement of heart rate variability as part of a workers’ health assessment.” Appl. Psychophysiol. Biofeedback 44 (2): 83–96. https://doi.org/10.1007/s10484-018-9422-4.
Gao, Z. Q., L. Ali, C. Wang, R. Z. Liu, C. W. Wang, C. Qian, H. Sung, and F. Y. Meng. 2022. “Real-time non-contact millimeter wave radar-based vital sign detection.” Sensors 22 (19): 7560. https://doi.org/10.3390/s22197560.
Han, S., J. Zhang, Z. S. Shaikh, J. Wang, and W. Ren. 2023. “Four-dimensional (4D) millimeter wave-based sensing and its potential applications in digital construction: A review.” Buildings 13 (6): 1454. https://doi.org/10.3390/buildings13061454.
Han, S.-Y., N.-S. Kwak, T. Oh, and S.-W. Lee. 2020. “Classification of pilots’ mental states using a multimodal deep learning network.” Biocybern. Biomed. Eng. 40 (1): 324–336. https://doi.org/10.1016/j.bbe.2019.12.002.
Hashiguchi, N., J. F. Cao, Y. Lim, S. Kuroishi, Y. Miyazaki, S. Kitahara, S. Sengoku, K. Matsubayashi, and K. Kodama. 2021. “Psychological effects of heart rate and physical vibration on the operation of construction machines: Experimental study.” JMIR Mhealth Uhealth 9 (9): e31637. https://doi.org/10.2196/31637.
Hinze, J. W., and J. Teizer. 2011. “Visibility-related fatalities related to construction equipment.” Saf. Sci. 49 (5): 709–718. https://doi.org/10.1016/j.ssci.2011.01.007.
Hirata, A., M. Nakashizuka, K. Suizu, Y. Sudo, and IEEE. 2019. “Improvement of detection in concrete surface cracks covered with paper by using standing wave of 77-GHz-band millimeter-wave.” In Proc., IEEE-MTT-S International Microwave Symposium (IMS), 297–300. New York: IEEE.
Hwang, S., H. Jebelli, B. Choi, M. Choi, and S. Lee. 2018. “Measuring workers’ emotional state during construction tasks using wearable EEG.” J. Constr. Eng. Manage. 144 (7): 04018050. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001506.
International Labour Organization. 2023. “World Statistic. The enormous burden of poor working conditions.” Accessed 28 November, 2023. https://www.ilo.org/moscow/areas-of-work/occupational-safety-and-health/WCMS_249278/lang--en/index.htm.
Jebelli, H., S. Hwang, and S. Lee. 2017. “Feasibility of field measurement of construction workers’ valence using a wearable EEG device.” In Proc., ASCE Int. Workshop on Computing in Civil Engineering (IWCCE), 99–106. Seattle: Univ. of Washington.
Jubadi, W. M., and S. F. A. M. Sahak. 2009. “Heartbeat monitoring alert via SMS.” In Proc., 2009 IEEE Symp. on Industrial Electronics & Applications, 1–5. New York: IEEE.
Kakamu, T., S. Endo, Y. Tsutsui, T. Hidaka, Y. Masuishi, H. Kasuga, and T. Fukushima. 2022. “Heart rate increase from rest as an early sign of heat-related illness risk in construction workers.” Int. J. Ind. Ergon. 89 (May): 103282. https://doi.org/10.1016/j.ergon.2022.103282.
Lee, B.-G., B.-L. Lee, and W.-Y. Chung. 2014. “Mobile healthcare for automatic driving sleep-onset detection using wavelet-based EEG and respiration signals.” Sensors 14 (10): 17915–17936. https://doi.org/10.3390/s141017915.
Legris, M., and P. Poulin. 1998. “Noise exposure profile among heavy equipment operators, associated laborers, and crane operators.” Am. Ind. Hyg. Assoc. J. 59 (11): 774–778. https://doi.org/10.1080/15428119891010947.
Li, C. X., M. F. Wang, X. K. Gao, B. Yang, and IOP. 2020a. “Research on on-site monitoring and measurement technology of tunnel.” In Proc., 6th Int. Conf. on Environmental Science and Civil Engineering (ESCE). Bristol, UK: IOP Publishing.
Li, G., Y. L. Sit, S. Manchala, T. Kettner, A. Ossowska, K. Krupinski, C. Sturm, U. Luebbert, and IEEE. 2019. “Novel 4D 79 GHz radar concept for object detection and active safety applications.” In Proc., 12th German Microwave Conf. (GeMiC), 87–90. New York: IEEE.
Li, J., H. Li, W. Umer, H. W. Wang, X. J. Xing, S. K. Zhao, and J. Hou. 2020b. “Identification and classification of construction equipment operators’ mental fatigue using wearable eye-tracking technology.” Autom. Constr. 109 (Jan): 103000. https://doi.org/10.1016/j.autcon.2019.103000.
Liao, P.-C., X. Luo, T. Wang, and Y. Su. 2016. “The mechanism of how design failures cause unsafe behavior: The cognitive reliability and error analysis method (CREAM).” Procedia Eng. 145 (Jan): 715–722. https://doi.org/10.1016/j.proeng.2016.04.088.
Liu, J. T., Y. C. Li, C. Z. Li, C. Z. Gu, and J. F. Mao. 2021. “Accurate measurement of human vital signs with linear FMCW radars under proximity stationary clutters.” IEEE Trans. Biomed. Circuits Syst. 15 (6): 1393–1404. https://doi.org/10.1109/TBCAS.2021.3123830.
Liu, L. Y., J. Zhang, Y. Qu, S. Zhang, and W. D. Xiao. 2023. “mmRH: Noncontact vital sign detection with an FMCW mm-wave radar.” IEEE Sens. J. 23 (8): 8856–8866. https://doi.org/10.1109/JSEN.2023.3250500.
Liu, X. F., J. N. Cao, S. J. Tang, J. Q. Wen, and IEEE. 2014. “Wi-Sleep: Contactless sleep monitoring via WiFi signals.” In Proc., 35th IEEE Real-Time Systems Symp. (RTSS), 346–355. New York: IEEE.
Liu, Y., and Y. Liu. 2021. “A data fusion model for millimeter-wave radar and vision sensor in advanced driving assistance system.” Int. J. Automot. Technol. 22 (6): 1695–1709. https://doi.org/10.1007/s12239-021-0146-8.
Ma, J., et al. 2023. “Fatigue assessment of construction equipment operators using a sweat lactate biosensor.” Int. J. Ind. Ergon. 96 (Jul): 103472. https://doi.org/10.1016/j.ergon.2023.103472.
Massaroni, C., A. Nicolo, M. Sacchetti, and E. Schena. 2020. “Contactless methods for measuring respiratory rate: A review.” IEEE Sens. J. 21 (11): 12821–12839. https://doi.org/10.1109/JSEN.2020.3023486.
Massaroni, C., A. Nicolò, D. Lo Presti, M. Sacchetti, S. Silvestri, and E. Schena. 2019. “Contact-based methods for measuring respiratory rate.” Sensors 19 (4): 908. https://doi.org/10.3390/s19040908.
Mehmood, I., H. Li, W. Umer, A. Arsalan, M. S. Shakeel, and S. Anwer. 2022. “Validity of facial features? Geometric measurements for real-time assessment of mental fatigue in construction equipment operators.” Adv. Eng. Inf. 54 (Oct): 101777. https://doi.org/10.1016/j.aei.2022.101777.
Mirmohamadsadeghi, L., J.-M. Vesin, M. Lemay, and O. Dériaz. 2015. “The respiration pattern as an indicator of the anaerobic threshold.” In Proc., 2015 37th Annual Int. Conf. of the IEEE Engineering in Medicine and Biology Society (EMBC), 546–549. New York: IEEE.
Miyashita, K., I. Morioka, T. Tanabe, H. Iwata, and S. Takeda. 1992. “Symptoms of construction workers exposed to whole-body vibration and local vibration.” Int. Arch. Occup. Environ. Health 64 (5): 347–351. https://doi.org/10.1007/BF00379545.
Molan, G., and M. Molan. 2021. “Theoretical model for accident prevention based on root cause analysis with graph theory.” Saf. Health Work 12 (1): 42–50. https://doi.org/10.1016/j.shaw.2020.09.004.
Molinaro, N., E. Schena, S. Silvestri, F. Bonotti, D. Aguzzi, E. Viola, F. Buccolini, and C. Massaroni. 2022. “Contactless vital signs monitoring from videos recorded with digital cameras: An overview.” Front. Physiol. 13 (Feb): 801709. https://doi.org/10.3389/fphys.2022.801709.
Pourbemany, J., A. Essa, Y. Zhu, and IEEE. 2021. “Real-time video-based heart and respiration rate monitoring.” In Proc., 73rd IEEE National Aerospace and Electronics Conf. (NAECON), 332–336. New York: IEEE.
Rahman, A., V. M. Lubecke, O. Boric-Lubecke, J. H. Prins, and T. Sakamoto. 2018. “Doppler radar techniques for accurate respiration characterization and subject identification.” IEEE J. Emerging Sel. Top. Circuits Syst. 8 (2): 350–359. https://doi.org/10.1109/JETCAS.2018.2818181.
Sacco, G., E. Piuzzi, E. Pittella, and S. Pisa. 2020. “An FMCW radar for localization and vital signs measurement for different chest orientations.” Sensors 20 (12): 3489. https://doi.org/10.3390/s20123489.
Sakamoto, T., and IEEE. 2019. “Noncontact measurement of human vital signs during sleep using low-power millimeter-wave ultrawideband MIMO array radar.” In Proc., IEEE MTT-S Int. Microwave Biomedical Conf. (IMBioC). New York: IEEE.
Siam, A. I., S. A. Gamel, and F. M. Talaat. 2023. “Automatic stress detection in car drivers based on non-invasive physiological signals using machine learning techniques.” Neural Comput. Appl. 35 (17): 12891–12904. https://doi.org/10.1007/s00521-023-08428-w.
Spencer, E., and P. Kovalchik. 2007. “Heavy construction equipment noise study using dosimetry and time-motion studies.” Noise Control Eng. J. 55 (4): 408–416. https://doi.org/10.3397/1.2756307.
Suess, W. M., A. B. Alexander, D. D. Smith, H. W. Sweeney, and R. J. Marion. 1980. “The effects of psychological stress on respiration: A preliminary study of anxiety and hyperventilation.” Psychophysiology 17 (6): 535–540. https://doi.org/10.1111/j.1469-8986.1980.tb02293.x.
Tan, F., W. Lyu, S. Chen, Z. Liu, and C. Yu. 2020. “Contactless vital signs monitoring based on few-mode and multi-core fibers.” Opto-electron. Adv. 3 (5): 190034. https://doi.org/10.29026/oea.2020.190034.
Turppa, E., J. M. Kortelainen, O. Antropov, and T. Kiuru. 2020. “Vital sign monitoring using FMCW radar in various sleeping scenarios.” Sensors 20 (22): 6505. https://doi.org/10.3390/s20226505.
Upadhyay, B. R., A. B. Baral, and M. Torlak. 2022. “Vital sign detection via angular and range measurements with mmWave MIMO radars: Algorithms and trials.” IEEE Access 10 (Oct): 106017–106032. https://doi.org/10.1109/ACCESS.2022.3211527.
Vlemincx, E., J. Taelman, S. De Peuter, I. Van Diest, and O. Van Den Bergh. 2011. “Sigh rate and respiratory variability during mental load and sustained attention.” Psychophysiology 48 (1): 117–120. https://doi.org/10.1111/j.1469-8986.2010.01043.x.
Wang, F. Y., F. Zhang, C. S. Wu, B. B. Wang, and K. J. R. Liu. 2020. “Respiration tracking for people counting and recognition.” IEEE Internet Things J. 7 (6): 5233–5245. https://doi.org/10.1109/JIOT.2020.2977254.
Wang, L., H. Li, Y. Z. Yao, D. L. Han, C. Y. Yu, W. M. Lyu, and H. T. Wu. 2023. “Smart cushion-based non-invasive mental fatigue assessment of construction equipment operators: A feasible study.” Adv. Eng. Inf. 58 (Oct): 102134. https://doi.org/10.1016/j.aei.2023.102134.
Waters, R. L., and S. Mulroy. 1999. “The energy expenditure of normal and pathologic gait.” Gait Posture 9 (3): 207–231. https://doi.org/10.1016/S0966-6362(99)00009-0.
Yang, J., G. Ye, Q. Xiang, M. Kim, Q. Liu, and H. Yue. 2021. “Insights into the mechanism of construction workers’ unsafe behaviors from an individual perspective.” Saf. Sci. 133 (Jan): 105004. https://doi.org/10.1016/j.ssci.2020.105004.
Yu, Y. T., X. M. Cheng, L. Wang, and C. Wang. 2022. “Convolutional neural network-based quantitative evaluation for corrosion cracks in oil/gas pipeline by millimeter-wave imaging.” IEEE Trans. Instrum. Meas. 71 (Sep): 1–9. https://doi.org/10.1109/tim.2022.3204992.
Yuan, G., N. A. Drost, and R. A. McIvor. 2013. “Respiratory rate and breathing pattern.” McMaster Univ. Med. J. 10 (1): 23–25.
Zhang, B., F. T. Xie, L. L. Wang, S. Li, L. D. Wei, and L. Feng. 2023. “Airborne millimeter-wave InSAR terrain mapping experiments based on automatic extraction and interferometric calibration of tie-points.” Remote Sens. 15 (3): 572. https://doi.org/10.3390/rs15030572.
Zhou, T., M. Yang, K. Jiang, H. Wong, and D. Yang. 2020. “MMW radar-based technologies in autonomous driving: A review.” Sensors 20 (24): 7283. https://doi.org/10.3390/s20247283.
Information & Authors
Information
Published In
Journal of Construction Engineering and Management
Volume 151 • Issue 1 • January 2025
Copyright
© 2024 American Society of Civil Engineers.
History
Received: Nov 29, 2023
Accepted: Jul 2, 2024
Published online: Oct 16, 2024
Published in print: Jan 1, 2025
Discussion open until: Mar 16, 2025
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.