User Experience and Workload Evaluation in Robot-Assisted Virtual Reality Welding Training
Publication: Construction Research Congress 2024
ABSTRACT
Remote virtual training for tasks that involve intensive human motor participation is gaining popularity in the emerging education 4.0 era. However, the user experience and the underlying cognitive characteristics while facing the state-of-the-art training platform are less understood. This paper implements a robot-assisted virtual reality training system for welding training. The virtual reality system creates an immersive environment, and the robotic device provides the necessary physical interaction. A total of 28 participants who had no prior welding experience were recruited to learn welding skills. The participants were trained under the conventional training condition, visual guidance condition, and haptic guidance condition. Participants’ pupillary response and subjective feedback were evaluated to investigate the user experience and the cognitive characteristics’ differences while being trained under different conditions. The results showed that participants felt easier when learning with conventional learning method, while pupillary response showed learning with visual and haptic feedback reduced the cognitive load. By showing the complexity of evaluating user experience, this study encourages training designers to evaluate the use of new technology with more dimensions.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
3DSystems. (2022). “Touch.” <https://www.3dsystems.com/haptics-devices/touch>. (2022).
Achour, N., and Daoudi, A. “SPIDAR-Welder a haptic interface for virtual welding training.” Proc., 2020 1st International Conference on Communications, Control Systems and Signal Processing (CCSSP), IEEE, 293–297.
Allam, A., and Dahlan, H. M. (2013). “User experience: challenges and opportunities.” Journal of Information Systems Research and Innovation, 3(1), 28–36.
Gavas, R., Chatterjee, D., and Sinha, A. “Estimation of cognitive load based on the pupil size dilation.” Proc., 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), IEEE, 1499–1504.
Hadinejad, A., Fesharakifard, R., Rezaei, S. M., and Nahvi, A. (2021). “Virtual Manual Arc Welding by Real-Time Process Simulation for an Effective Training.” AUT Journal of Mechanical Engineering, 5(1), 121–140.
Hart, S. G. “NASA-task load index (NASA-TLX); 20 years later.” Proc., Proceedings of the human factors and ergonomics society annual meeting, Sage publications Sage CA: Los Angeles, CA, 904–908.
Ipsita, A., Erickson, L., Dong, Y., Huang, J., Bushinski, A. K., Saradhi, S., Villanueva, A. M., Peppler, K. A., Redick, T. S., and Ramani, K. “Towards Modeling of Virtual Reality Welding Simulators to Promote Accessible and Scalable Training.” Proc., CHI Conference on Human Factors in Computing Systems, 1–21.
Kwon, C. (2019). “Verification of the possibility and effectiveness of experiential learning using HMD-based immersive VR technologies.” Virtual Reality, 23(1), 101–118.
Marshall, S. P. “The index of cognitive activity: Measuring cognitive workload.” Proc., Proceedings of the IEEE 7th conference on Human Factors and Power Plants, IEEE, 7–7.
Papakostas, C., Troussas, C., Krouska, A., and Sgouropoulou, C. (2022). “User acceptance of augmented reality welding simulator in engineering training.” Education and Information Technologies, 27(1), 791–817.
Payne, D. T., Parry, M. E., and Harasymiw, S. J. (1968). “Percentage of pupillary dilation as a measure of item difficulty.” Perception & Psychophysics, 4(3), 139–143.
Philbrick, R. M., and Colton, M. B. (2014). “Effects of haptic and 3D audio feedback on operator performance and workload for quadrotor UAVs in indoor environments.” Journal of Robotics and Mechatronics, 26(5), 580–591.
Pitts, M. J., Burnett, G., Skrypchuk, L., Wellings, T., Attridge, A., and Williams, M. A. (2012). “Visual–haptic feedback interaction in automotive touchscreens.” Displays, 33(1), 7–16.
Rusli, F. N., Zulkifli, A., Bin Saad, M., and Yussop, Y. M. (2019). A study of students’ motivation in using the mobile arc welding learning app.
Rutten, I., Van den Bogaert, L., and Geerts, D. (2020). “From initial encounter with mid-air haptic feedback to repeated use: the role of the novelty effect in user experience.” IEEE Transactions on Haptics, 14(3), 591–602.
Scholz, F. W., and Stephens, M. A. (1987). “K-sample Anderson–Darling tests.” Journal of the American Statistical Association, 82(399), 918–924.
Shi, Y., Du, J., and Worthy, D. A. (2020). “The impact of engineering information formats on learning and execution of construction operations: A virtual reality pipe maintenance experiment.” Automation in Construction, 119, 103367.
Siemens. (2019). “Siemens/Ros-sharp.” <https://github.com/siemens/ros-sharp>. (06 February, 2020).
TobiiPro. (2022). “Tobii Pro VR Integration.” <https://www.tobiipro.com/product-listing/vr-integration/>. (2022).
Wang, Y., Chen, Y., Nan, Z., and Hu, Y. “Study on welder training by means of haptic guidance and virtual reality for arc welding.” Proc., 2006 IEEE international conference on robotics and biomimetics, IEEE, 954–958.
Xie, B., Zhou, Q., and Yu, L. “A real-time welding training system base on virtual reality.” Proc., 2015 IEEE Virtual Reality (VR), IEEE, 309–310.
Xu, F., Xia, P., You, H., and Du, J. (2022). “Robotic cross-platform sensor fusion and augmented visualization for large indoor space reality capture.” Journal of Computing in Civil Engineering, 36(6), 04022036.
Xu, F., Zhu, Q., Li, S., Song, Z., and Du, J. (2021). “VR-Based Haptic Simulator for Subsea Robot Teleoperations.” Computing in Civil Engineering 2021, 1024–1032.
Ye, Y., Shi, Y., Srinivasan, D., and Du, J. (2022). “Sensation transfer for immersive exoskeleton motor training: Implications of haptics and viewpoints.” Automation in Construction, 141, 104411.
Ye, Y., Shi, Y., Xia, P., Kang, J., Tyagi, O., Mehta, R. K., and Du, J. (2022). “Cognitive characteristics in firefighter wayfinding Tasks: An Eye-Tracking analysis.” Advanced Engineering Informatics, 53, 101668.
Ye, Y., Xia, P., Zhou, T., and Du, J. (2023). “Spatial Memory of BIM and Virtual Reality: Mental Mapping Study.” Journal of Construction Engineering and Management, 149(7), 04023042.
Ye, Y., Zhou, T., and Du, J. (2023). “Robot-Assisted Immersive Kinematic Experience Transfer for Welding Training.” Journal of Computing in Civil Engineering, 37(2), 04023002.
Zhou, T., Xia, P., Zhu, Q., and Du, J. (2023). “Cognition-driven navigation assistive system for emergency indoor wayfinding (CogDNA): proof of concept and evidence.” Safety science, 162, 106100.
Zhou, T., Zhu, Q., Ye, Y., and Du, J. (2023). “Humanlike Inverse Kinematics for Improved Spatial Awareness in Construction Robot Teleoperation: Design and Experiment.” Journal of Construction Engineering and Management, 149(7), 04023044.
Information & Authors
Information
Published In
Construction Research Congress 2024
Pages: 99 - 108
History
Published online: Mar 18, 2024
ASCE Technical Topics:
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.