Feedback System for Enhancing Human-Robot Interaction Performance in Construction Robots
Publication: Construction Research Congress 2024
ABSTRACT
Many fatal incidents in the construction project occur during the earthmoving phase. Teleoperation has been a promising solution for such dangerous tasks since this method can remove humans from hazardous workplaces. Although humans are not on the jobsite for safety reasons, teleoperation requires human-in-the-loop automation, so humans need to robustly operate the construction robot at a distance. Operating equipment from a distance often reduces task performance and safety performance since spatial awareness of human operators is restricted compared to onboarding control. It is an important issue since the decisions and actions taken by operators directly affect the performance of construction robots. This study proposes the use of a feedback system for the teleoperation of construction robots to improve proximity sensing of risks and improve the human operator’s understanding of obstacles in the workplace where robots are used. The proposed teleoperation feedback system is validated with a human subject experiment in the virtual environment. This research will contribute to the body of knowledge on improving teleoperation, human operators’ spatial awareness, and human-robot interaction task performance.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Hong, Z., Q. Zhang, X. Su, and H. Zhang. 2020. “Effect of virtual annotation on performance of construction equipment teleoperation under adverse visual conditions.” Automation in Construction, 118: 103296. https://doi.org/10.1016/j.autcon.2020.103296.
Hosseini, A., and M. Lienkamp. 2016. “Enhancing telepresence during the teleoperation of road vehicles using HMD-based mixed reality.” 2016 IEEE Intelligent Vehicles Symposium (IV), 1366–1373.
Jo, B.-W., Y.-S. Lee, J.-H. Kim, D.-K. Kim, and P.-H. Choi. 2017. “Proximity Warning and Excavator Control System for Prevention of Collision Accidents.” Sustainability, 9 (8): 1488. Multidisciplinary Digital Publishing Institute. https://doi.org/10.3390/su9081488.
Kim, D., M. Liu, S. Lee, and V. R. Kamat. 2019. “Remote proximity monitoring between mobile construction resources using camera-mounted UAVs.” Automation in Construction, 99: 168–182. https://doi.org/10.1016/j.autcon.2018.12.014.
Kim, J., Y. Ham, and H. Park. 2022. “Underground Metal Pipeline Localization Using Low-Cost Wireless Magnetic Sensors Mounted on an Excavator.” IEEE Transactions on Industrial Electronics, 69 (10): 10674–10683. https://doi.org/10.1109/TIE.2022.3159953.
Lee, J. S., and Y. Ham. 2022a. “Exploring Human-Machine Interfaces for Teleoperation of Excavator.” 757–765. American Society of Civil Engineers. https://doi.org/10.1061/9780784483961.079.
Lee, J. S., and Y. Ham. 2022b. “The effect of challenging work environment on human-robot interaction and cognitive load during teleoperation: a case study of teleoperated excavator in a virtual experiment.” Proceedings of the 1st Future of Construction Workshop at the International Conference on Robotics and Automation (ICRA 2022). International Association for Automation and Robotics in Construction (IAARC).
Lee, J. S., Y. Ham, H. Park, and J. Kim. 2022. “Challenges, tasks, and opportunities in teleoperation of excavator toward human-in-the-loop construction automation.” Automation in Construction, 135: 104119. https://doi.org/10.1016/j.autcon.2021.104119.
Liu, D., and Y. Ham. 2022. “Multi-User Immersive Operation and Communication in Virtual Reality: A Research Case on Robotic Excavator.” The 22nd International Conference on Construction Applications of Virtual Reality (CONVR2022), 16-19 Nov, Seoul, South Korea.
Liu, D., Y. Ham, J. Kim, and H. Park. 2022. “Towards a Collaborative Future in Construction Robotics: A Human-centered Study in a Multi-user Immersive Operation and Communication System for Excavation” 2022 IEEE International Conference on Robotics and Automation, Workshop on Future of Construction: Build Faster, Better, Safer - Together with Robots, 23-27 May, Philadelphia, PA.
Nagano, H., H. Takenouchi, N. Cao, M. Konyo, and S. Tadokoro. 2020. “Tactile feedback system of high-frequency vibration signals for supporting delicate teleoperation of construction robots.” Advanced Robotics, 34 (11): 730–743. Taylor & Francis. https://doi.org/10.1080/01691864.2020.1769725.
Sheridan, T. B. 1992. “Musings on telepresence and virtual presence.” Presence Teleoperators Virtual Environ., 1 (1): 120–125.
Su, X., S. Talmaki, H. Cai, and V. R. Kamat. 2013. “Uncertainty-aware visualization and proximity monitoring in urban excavation: a geospatial augmented reality approach.” Vis. in Eng., 1 (1): 2. https://doi.org/10.1186/2213-7459-1-2.
Tanoli, W. A., A. Sharafat, J. Park, and J. W. Seo. 2019. “Damage Prevention for underground utilities using machine guidance.” Automation in Construction, 107: 102893. https://doi.org/10.1016/j.autcon.2019.102893.
Teizer, J. 2015. “Magnetic Field Proximity Detection and Alert Technology for Safe Heavy Construction Equipment Operation.” ISARC. Proceedings of the International Symposium on Automation and Robotics in Construction, 1–9. Waterloo, Canada: IAARC Publications.
Wen, L., D. Kim, M. Liu, and S. Lee. 2023. “3D Excavator Pose Estimation Using Projection-Based Pose Optimization for Contact-Driven Hazard Monitoring.” Journal of Computing in Civil Engineering, 37 (1): 04022048. American Society of Civil Engineers. https://doi.org/10.1061/(ASCE)CP.1943-5487.0001060.
Information & Authors
Information
Published In
Construction Research Congress 2024
Pages: 79 - 88
History
Published online: Mar 18, 2024
ASCE Technical Topics:
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.