Virtual Environment for Studying the Effects of Operational and Environmental Sounds on Teleoperated Demolition
Publication: Computing in Civil Engineering 2023
ABSTRACT
Teleoperated robots are increasingly being used in construction sites, but there is still a need for better human-robot interfaces. Auditory feedback using sonification has commonly been used to complement visual feedback in teleoperation applications. However, it is not yet well understood how operational and environmental sounds can support operators in complex tasks such as construction machine operations. In this paper, we describe the development of a virtual environment to assess the impacts of operational and environmental sounds on operators’ performances and cognitive loads during teleoperated demolition. Our goal is to examine whether different levels of operational and environmental sounds can increase the workers’ situation awareness, operational efficiency, and safety performance. Alternatively, we anticipate that some environmental noises may negatively affect the operators’ performances by increasing their mental workload and stress levels. Consequently, we plan to evaluate the effectiveness of including audio filters that minimize unwanted sounds while prioritizing desired sounds.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Bremner, P., Mitchell, T. J., and McIntosh, V. (2022). “The impact of data sonification in virtual reality robot teleoperation.” Front. Virtual Real., https://doi.org/10.3389/frvir.2022.904720, 3:904720.
Davila Delgado, J. M., Oyedele, L., Demian, P., and Beach, T. (2020). “A research agenda for augmented and virtual reality in architecture, engineering and construction.” Adv. Eng. Inform., https://doi.org/10.1016/j.aei.2020.101122, 45:101122.
Fu, Y., Chen, W., Li, S., and Jiao, Z. (2015). “Evaluating Operator Performance in Teleoperated Manipulator System Factored by Camera Configurations.” Engineering Psychology and Cognitive Ergonomics, Springer International Publishing, Cham, 327–334.
Harder, J., Wilde, M., Ventura, J., and Dziura, M. (2016). “Acoustic telepresence for spacecraft proximity operations.” 2016 IEEE Aerospace Conference. IEEE, https://doi.org/10.1109/AERO.2016.7500670, 2016:4587–12.
Ke, J., Zhang, M., Luo, X., and Chen, J. (2021). “Monitoring distraction of construction workers caused by noise using a wearable Electroencephalography (EEG) device.” Autom. Constr., https://doi.org/10.1016/j.autcon.2021.103598, 125:103598.
Kerns, E., Masterson, E. A., Themann, C. L., and Calvert, G. M. (2018). “Cardiovascular conditions, hearing difficulty, and occupational noise exposure within U.S. industries and occupations.” Am. J. Ind. Med., https://doi.org/10.1002/ajim.22833, 61(6), 477–491.
Khenak, N., Vézien, J., Théry, D., and Bourdot, P. (2018). “Spatial Presence in Real and Remote Immersive Environments and the Effect of Multisensory Stimulation.” Presence: Teleoperators and Virtual Environments, https://doi.org/10.1162/pres_a_00332, 27(3), 287–308.
Lee, H. J., and Brell-Cokcan, S. (2021). “Cartesian coordinate control for teleoperated construction machines.” Construction Robotics, https://doi.org/10.1007/s41693-021-00055-y, 5, 1–11.
Lu, X., and Davis, S. (2018). “Priming effects on safety decisions in a virtual construction simulator.” Eng. Constr. Archit. Manag., https://doi.org/10.1108/ECAM-05-2016-0114, 25(2), 273–294.
Lu, X., and Davis, S. (2016). “How sounds influence user safety decisions in a virtual construction simulator.” Saf. Sci., https://doi.org/10.1016/j.ssci.2016.02.018, 86:184–194.
Masterson, E. A., Deddens, J. A., Themann, C. L., Bertke, S., and Calvert, G. M. (2015). “Trends in worker hearing loss by industry sector, 1981-2010”. Am. J. Ind. Med., https://doi.org/10.1002/ajim.22429, 58(4), 392–401.
Mir, M., Nasirzadeh, F., Bereznicki, H., Enticott, P., Lee, S., and Mills, A. (2023). “Construction noise effects on human health: Evidence from physiological measures.” Sustain. Cities Soc., https://doi.org/10.1016/j.scs.2023.104470, 91:104470.
Morita, T., Zhu, Y., Aoyama, T., Takeuchi, M., Yamamoto, K., and Hasegawa, Y. (2022). “Auditory Feedback for Enhanced Sense of Agency in Shared Control.” Sensors, https://doi.org/10.3390/s22249779, 22:9779.
Rea, D. J., and Seo, S. H. (2022). “Still Not Solved: A Call for Renewed Focus on User-Centered Teleoperation Interfaces.” Front. Robot. AI, https://doi.org/10.3389/frobt.2022.704225, 9, 704225.
Siu, K. C., Suh, I. H., Mukherjee, M., Oleynikov, D., and Stergiou, N. (2010). “The impact of environmental noise on robot-assisted laparoscopic surgical performance.” Surgery, https://doi.org/10.1016/j.surg.2009.08.010, 147(1), 107–113.
Triantafyllidis, E., Mcgreavy, C., Gu, J., and Li, Z. (2020). “Study of Multimodal Interfaces and the Improvements on Teleoperation.” IEEE Access, https://doi.org/10.1109/ACCESS.2020.2990080, vol. 8, 78213–78227.
Information & Authors
Information
Published In
Computing in Civil Engineering 2023
Pages: 54 - 61
History
Published online: Jan 25, 2024
ASCE Technical Topics:
- Audits
- Automation and robotics
- Business management
- Construction engineering
- Construction equipment
- Construction management
- Construction methods
- Construction sites
- Demolition
- Design (by type)
- Engineering fundamentals
- Equipment and machinery
- Financial management
- Human and behavioral factors
- Load factors
- Occupational safety
- Practice and Profession
- Public administration
- Public health and safety
- Safety
- Structural design
- Systems engineering
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.