Design and Evaluation of Human-Centered Visualization Interfaces in Construction Teleoperation
Publication: Construction Research Congress 2024
ABSTRACT
Teleoperation is widely used in hazardous and uncertain site settings, allowing scheduled procedures to be carried out across long distances while workers are away from the sites. Teleoperators in off-sites collect both the site information and feedback from the interfaces which provide synthesized information that a robot collects. This interface mainly conveys visionary information for the operator’s intuitiveness such as the spatial awareness of objects and surroundings. To achieve a rich visual understanding of the site, the interface should fully contain and intuitively convey the associated contextual information. Excessive or unintuitive information not only makes it difficult for operators to exert their full potential but also increases their cognitive load. This study explores how different visual interface configurations affect operators’ work performance and their cognitive load during the teleoperation task. The findings from the experimental studies are expected to help develop human-centered interfaces for teleoperation in the context of construction tasks and provide the cornerstone for not only an intuitive but fruitfully informative interface in a provided task setting.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Carayon, P., A. S. Hundt, B. Karsh, A. P. Gurses, C. J. Alvarado, M. Smith, and P. F. Brennan. 2006. “Work system design for patient safety: the SEIPS model.” Qual. Saf. Health Care, 15 (Suppl 1): i50–i58. https://doi.org/10.1136/qshc.2005.015842.
Hart, S. G., and L. E. Staveland. 1988. “Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research.” Adv. Psychol., Human Mental Workload, P. A. Hancock and N. Meshkati, eds., 139–183. North-Holland.
Hedayati, H., M. Walker, and D. Szafir. 2018. “Improving Collocated Robot Teleoperation with Augmented Reality.” Proc. 2018 ACMIEEE Int. Conf. Hum.-Robot Interact., HRI ’18, 78–86. New York, NY, USA: Association for Computing Machinery.
Hiramatsu, Y., T. Aono, and M. Nishio. 2002. “Disaster restoration work for the eruption of Mt Usuzan using an unmanned construction system.” Adv. Robot., 16 (6): 505–508. https://doi.org/10.1163/156855302320535836.
Ito, S., Y. Sakano, K. Fujino, and H. Ando. 2017. “Remote Controlled Construction Equipment by Using High-Resolution Stereoscopic 3d Images.” J. Jpn. Soc. Civ. Eng. Ser F3 Civ. Eng. Inform., 73 (1): 15–24. https://doi.org/10.2208/jscejcei.73.15.
Kamezaki, M., J. Yang, H. Iwata, and S. Sugano. 2016. “Visibility Enhancement using Autonomous Multicamera Controls with Situational Role Assignment for Teleoperated Work Machines.” J. Field Robot., 33 (6): 802–824. https://doi.org/10.1002/rob.21580.
Lee, J. S., and Y. Ham. 2022. “The effect of challenging work environment on human-robot interaction and cognitive load during teleoperation: a case study of teleoperated excavator in a virtual experiment.” Proc. 1st Future Constr. Workshop Int. Conf. Robot. Autom. ICRA 2022. International Association for Automation and Robotics in Construction (IAARC).
Lee, J. S., Y. Ham, H. Park, and J. Kim. 2022. “Challenges, tasks, and opportunities in teleoperation of excavator toward human-in-the-loop construction automation.” Autom. Constr., 135: 104119. https://doi.org/10.1016/j.autcon.2021.104119.
Li, W., H. Gao, L. Ding, and M. Tavakoli. 2016. “Trilateral Predictor-Mediated Teleoperation of a Wheeled Mobile Robot With Slippage.” IEEE Robot. Autom. Lett., 1 (2): 738–745. https://doi.org/10.1109/LRA.2016.2522503.
Lunghi, G., R. M. Prades, and M. D. Castro. 2016. “An Advanced, Adaptive and Multimodal Graphical User Interface for Human-robot Teleoperation in Radioactive Scenarios:” Proc. 13th Int. Conf. Inform. Control Autom. Robot., 224–231. Lisbon, Portugal: SCITEPRESS - Science and and Technology Publications.
Motohashi, S., Z. Qiao, T. Moteki, and H. Iwata. 2023. “Analysis of the Effect of the Operator’s Spatial Cognition on Their Planning Skills in Unmanned Construction.” 2023 IEEESICE Int. Symp. Syst. Integr. SII, 1–7.
Naceri, A., D. Mazzanti, J. Bimbo, D. Prattichizzo, D. G. Caldwell, L. S. Mattos, and N. Deshpande. 2019. “Towards a Virtual Reality Interface for Remote Robotic Teleoperation.” 2019 19th Int. Conf. Adv. Robot. ICAR, 284–289.
Nielsen, C. W., M. A. Goodrich, and R. W. Ricks. 2007. “Ecological Interfaces for Improving Mobile Robot Teleoperation.” IEEE Trans. Robot., 23 (5): 927–941. https://doi.org/10.1109/TRO.2007.907479.
Rasmussen, J. 1983. “Skills, rules, and knowledge; signals, signs, and symbols, and other distinctions in human performance models.” IEEE Trans. Syst. Man Cybern., SMC-13 (3): 257–266. https://doi.org/10.1109/TSMC.1983.6313160.
Seraji, H., and A. Howard. 2002. “Behavior-based robot navigation on challenging terrain: A fuzzy logic approach.” IEEE Trans. Robot. Autom., 18 (3): 308–321. https://doi.org/10.1109/TRA.2002.1019461.
Shigematsu, K., T. Tsubouchi, and S. Sarata. 2021. “Tip-over prevention system based on motion prediction for teleoperated excavator.” Adv. Robot., 35 (23): 1438–1449. Taylor & Francis. https://doi.org/10.1080/01691864.2021.2004223.
Su, Y., X. Chen, T. Zhou, C. Pretty, and G. Chase. 2022. “Mixed reality-integrated 3D/2D vision mapping for intuitive teleoperation of mobile manipulator.” Robot. Comput.-Integr. Manuf., 77: 102332. https://doi.org/10.1016/j.rcim.2022.102332.
Tanimoto, T., K. Shinohara, and H. Yoshinada. 2017. “Research on effective teleoperation of construction machinery fusing manual and automatic operation.” ROBOMECH J., 4 (1): 14. https://doi.org/10.1186/s40648-017-0083-5.
Verner, I. M., S. Gamer, and A. Polishuk. 2018. “Development of spatial awareness and operation skills in a remote robot laboratory.” 2018 IEEE Glob. Eng. Educ. Conf. EDUCON, 389–393.
Wang, X., and P. S. Dunston. 2012. “Mixed Reality — Enhanced Operator Interface for Teleoperation Systems in Unstructured Environment.” 1–8. American Society of Civil Engineers. https://doi.org/10.1061/40830(188)93.
Witmer, B. G., and M. J. Singer. 1998. “Measuring Presence in Virtual Environments: A Presence Questionnaire.” Presence Teleoperators Virtual Environ., 7 (3): 225–240. https://doi.org/10.1162/105474698565686.
Yanco, H. A., J. L. Drury, and J. Scholtz. 2004. “Beyond Usability Evaluation: Analysis of Human-Robot Interaction at a Major Robotics Competition.” Human–Computer Interact., 19 (1–2): 117–149. Taylor & Francis. https://doi.org/10.1080/07370024.2004.9667342.
Yerkes, R. M., and J. D. Dodson. 1908. “The relation of strength of stimulus to rapidity of habit-formation.” J. Comp. Neurol. Psychol., 18 (5): 459–482. https://doi.org/10.1002/cne.920180503.
Information & Authors
Information
Published In
Construction Research Congress 2024
Pages: 109 - 118
History
Published online: Mar 18, 2024
ASCE Technical Topics:
- Business management
- Construction engineering
- Construction management
- Construction sites
- Data collection
- Design (by type)
- Employment
- Engineering fundamentals
- Geotechnical engineering
- Geotechnical investigation
- Human and behavioral factors
- Labor
- Load factors
- Methodology (by type)
- Occupational safety
- Personnel management
- Practice and Profession
- Public administration
- Public health and safety
- Research methods (by type)
- Safety
- Site investigation
- Structural design
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.