Human-Like Bilateral Robotic Arm Controls for Remote Pipe Maintenance
Publication: Computing in Civil Engineering 2021
ABSTRACT
The use of robotics has demonstrated numerous advantages in civil engineering applications. Telerobotics is expected to play a key role in achieving a successful civil engineering project in humans’ hard-to-reach environment, such as scenes of nuclear leakage and mining disasters. Due to the high accuracy and flexibility, the robotic arm has gained popularity in telerobotics. Most existing approaches have focused on teleoperate robotic arms based on the pose (position and orientation) of the end-effector, leading to the risk of the pose of other joints moving in undesired directions and cause collisions. This paper proposes an innovative control method that teleoperates the robotic arm based on the pose of the end-effector and another joint between the start joint and the end-effector. The Baxter robot (Rethink Robotics) was developed as the testbed to be controlled based on a VR controller (end-effector) and a VR tracker (middle joint) in a pipe skid maintenance task. The human operator held the VR controller in his hand, wore the VR tracker on his elbow joint, and operates Baxter to complete the task. The inverse kinematics (IK) was used to calculate the rotations of the rest of the joints based on the poses of the start joint, middle joint, and end-effector. The proposed method can control the robot to move according to the pose of the human arm and reduce the risk of collision.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Anderson, R. J., and Spong, M. W. “Bilateral control of teleoperators with time delay.” Proc., Proceedings of the 1988 IEEE International Conference on Systems, Man, and Cybernetics, IEEE, 131–138.
Aristidou, A., Lasenby, J., Chrysanthou, Y., and Shamir, A. “Inverse kinematics techniques in computer graphics: A survey.” Proc., Computer Graphics Forum, Wiley Online Library, 35–58.
Cavallin, K., and Svensson, P. (2009). “Semi-Autonomous, Teleoperated Search and Rescue Robot.”
Chen, Z., Pan, Y. J., and Gu, J. (2016). “Integrated adaptive robust control for multilateral teleoperation systems under arbitrary time delays.” International Journal of Robust and Nonlinear Control, 26(12), 2708–2728.
Chitta, S., Sucan, I., and Cousins, S. (2012). “Moveit![ros topics].” IEEE Robotics & Automation Magazine, 19(1), 18–19.
Diankov, R. (2010). “Ikfast: The robot kinematics compiler.” URL here.
Du, J., Shi, Y., Mei, C., Quarles, J., and Yan, W. “Communication by interaction: A multiplayer VR environment for building walkthroughs.” Proc., Construction Research Congress 2016, 2281–2290.
Du, J., Shi, Y., Zou, Z., and Zhao, D. (2018). “CoVR: Cloud-based multiuser virtual reality headset system for project communication of remote users.” Journal of Construction Engineering and Management, 144(2), 04017109.
Du, J., Zou, Z., Shi, Y., and Zhao, D. (2017). “Simultaneous data exchange between BIM and VR for collaborative decision making.” Computing in Civil Engineering 2017, 1–8.
Du, J., Zou, Z., Shi, Y., and Zhao, D. (2018). “Zero latency: Real-time synchronization of BIM data in virtual reality for collaborative decision-making.” Automation in Construction, 85, 51–64.
El-Sherbiny, A., Elhosseini, M. A., and Haikal, A. Y. (2018). “A comparative study of soft computing methods to solve inverse kinematics problem.” Ain Shams Engineering Journal, 9(4), 2535–2548.
Hirche, S., and Buss, M. (2012). “Human-oriented control for haptic teleoperation.” Proceedings of the IEEE, 100(3), 623–647.
Hirche, S., Stanczyk, B., and Buss, M. “Transparent exploration of remote environments by internet telepresence.” Proc., Proceedings of Int. Workshop on High-Fidelity Telepresence and Teleaction jointly with the conference HUMANOIDS.
Hitz, G., Gotovos, A., Garneau, M.-É., Pradalier, C., Krause, A., and Siegwart, R. Y. “Fully autonomous focused exploration for robotic environmental monitoring.” Proc., 2014 IEEE International Conference on Robotics and Automation (ICRA), IEEE, 2658–2664.
Ikuta, K., Yamamoto, K., and Sasaki, K. “Development of remote microsurgery robot and new surgical procedure for deep and narrow space.” Proc., 2003 IEEE International Conference on Robotics and Automation (Cat. No. 03CH37422), IEEE, 1103–1108.
Kanehiro, F., Hirukawa, H., Kaneko, K., Kajita, S., Fujiwara, K., Harada, K., and Yokoi, K. “Locomotion planning of humanoid robots to pass through narrow spaces.” Proc., IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA'04. 2004, IEEE, 604–609.
Lumelsky, V. J., and Cheung, E. (1993). “Real-time collision avoidance in teleoperated whole-sensitive robot arm manipulators.” IEEE Transactions on Systems, Man, and Cybernetics, 23(1), 194–203.
Motaleb, A. K. B., Hoque, M. B., and Hoque, M. A. “Bomb disposal robot.” Proc., 2016 International Conference on Innovations in Science, Engineering and Technology (ICISET), IEEE, 1–5.
Natori, K., Tsuji, T., Ohnishi, K., Hace, A., and Jezernik, K. (2009). “Time-delay compensation by communication disturbance observer for bilateral teleoperation under time-varying delay.” IEEE Transactions on Industrial Electronics, 57(3), 1050–1062.
Niemeyer, G., Preusche, C., Stramigioli, S., and Lee, D. (2016). “Telerobotics.” Springer handbook of robotics, Springer, 1085–1108.
Partel, L. “Final IK: Animation Tools: Unity Asset Store.” <https://assetstore.unity.com/packages/tools/animation/final-ik-14290>. (04 April, 2021).
Penrose, R. “A generalized inverse for matrices.” Proc., Mathematical proceedings of the Cambridge philosophical society, Cambridge University Press, 406–413.
Perez, A., and McCarthy, J. M. “Sizing a serial chain to fit a task trajectory using clifford algebra exponentials.” Proc., Proceedings of the 2005 IEEE International Conference on Robotics and Automation, IEEE, 4709–4715.
Qian, K., Song, A., Bao, J., and Zhang, H. (2012). “Small teleoperated robot for nuclear radiation and chemical leak detection.” International Journal of Advanced Robotic Systems, 9(3), 70.
Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Wheeler, R., and Ng, A. Y. “ROS: an open-source Robot Operating System.” Proc., ICRA workshop on open source software, Kobe, Japan, 5.
Rakita, D., Mutlu, B., and Gleicher, M. “An autonomous dynamic camera method for effective remote teleoperation.” Proc., Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, 325–333.
Reddivari, H., Yang, C., Ju, Z., Liang, P., Li, Z., and Xu, B. “Teleoperation control of Baxter robot using body motion tracking.” Proc., 2014 International conference on multisensor fusion and information integration for intelligent systems (MFI), IEEE, 1–6.
Robotics, R. (2016). “Baxter datasheet.” <https://sdk.rethinkrobotics.com/wiki/Home>. (06 February, 2020).
Sciavicco, L., and Siciliano, B. (2012). Modelling and control of robot manipulators, Springer Science & Business Media.
Shi, Y., Du, J., Ragan, E., Choi, K., and Ma, S. “Social influence on construction safety behaviors: a multi-user virtual reality experiment.” Proc., Construction Research Congress, 147–183.
Siciliano, B., and Khatib, O. (2016). Springer handbook of robotics, Springer.
Siemens. (2019). “Siemens/Ros-sharp.” <https://github.com/siemens/ros-sharp>. (06 February, 2020).
Song, W., Guo, X., Jiang, F., Yang, S., Jiang, G., and Shi, Y. “Teleoperation humanoid robot control system based on kinect sensor.” Proc., 2012 4th international conference on intelligent human-machine systems and cybernetics, IEEE, 264–267.
Squyres, S. W., Arvidson, R. E., Baumgartner, E. T., Bell, J. F., Christensen, P. R., Gorevan, S., Herkenhoff, K. E., Klingelhöfer, G., Madsen, M. B., and Morris, R. V. (2003). “Athena Mars rover science investigation.” Journal of Geophysical Research: Planets, 108(E12).
Stanton, C., Bogdanovych, A., and Ratanasena, E. “Teleoperation of a humanoid robot using full-body motion capture, example movements, and machine learning.” Proc., Proc. Australasian Conference on Robotics and Automation, 51.
Yang, C., Wang, X., Cheng, L., and Ma, H. (2016). “Neural-learning-based telerobot control with guaranteed performance.” IEEE transactions on cybernetics, 47(10), 3148–3159.
Zhou, T., Zhu, Q., and Du, J. (2020). “Intuitive robot teleoperation for civil engineering operations with virtual reality and deep learning scene reconstruction.” Advanced Engineering Informatics, 46, 101170.
Zhu, Q., Du, J., Shi, Y., and Wei, P. (2021). “Neurobehavioral assessment of force feedback simulation in industrial robotic teleoperation.” Automation in Construction, 126, 103674.
Information & Authors
Information
Published In
Computing in Civil Engineering 2021
Pages: 1050 - 1058
History
Published online: May 24, 2022
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.