Interactive and Immersive Process-Level Digital Twin for Collaborative Human–Robot Construction Work
Publication: Journal of Computing in Civil Engineering
Volume 35, Issue 6
Abstract
Human cognition plays a critical role in construction work, particularly in the context of high-level task planning and in-field improvisation. On the other hand, robots are adept at performing numerical computation and repetitive physical tasks with precise motion control. The unstructured and complex nature of construction environments and the inability to maintain tight tolerances in assembled workpieces pose several unique challenges to the wide application of robots in construction work. Thus, the robotization of field construction processes is best conceived as a collaborative human–robot endeavor that takes advantage of both human and robot intelligence as well as robots’ physical operation capabilities to overcome uncertainties and successfully perform useful construction work onsite. This paper proposes an interactive and immersive process-level digital twin (I2PL-DT) system in virtual reality (VR) that integrates visualization and supervision, task planning and execution, and bidirectional communication to enable collaborative human–robot construction work. In this work paradigm, the human worker is responsible for high-level task planning and work process supervision. The robot undertakes workspace sensing and monitoring, detailed motion planning, and physical execution of the work. A drywall installation case study involving imperfect rough carpentry (wall framing) is presented using a KUKA mobile industrial robotic arm emulator. A human-in-the-loop study involving 20 subjects was conducted for system verification and to collect feedback for future improvements. The experimental results show that users can use the system to specify work sequences, select optimal task plans, and perform robot trajectory guidance after simple training and felt positive about the system functions and user experience. The system demonstrates the potential of transitioning the role of construction workers from physical task performers to robot supervisors. In addition, the system establishes a promising framework for construction workers to remotely collaborate with onsite construction robots.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some data, models, or codes that support the findings of this study are available from the corresponding author upon reasonable request. The models and codes that can be requested from the corresponding author are working environment 3D models and code for robot planning and control. All anonymized human subject data are also available upon request.
Acknowledgments
The authors would like to acknowledge the financial support for this research received from the US National Science Foundation (NSF—FW Award No. 2025805). Any opinions and findings in this paper are those of the authors and do not necessarily represent those of the NSF.
References
Akanmu, A. A., J. Olayiwola, O. Ogunseiju, and D. McFeeters. 2020. “Cyber-physical postural training system for construction workers.” Autom. Constr. 117 (Sep): 103272. https://doi.org/10.1016/j.autcon.2020.103272.
Bassier, M., B. Van Genechten, and M. Vergauwen. 2019. “Classification of sensor independent point cloud data of building objects using random forests.” J. Build. Eng. 21 (Jan): 468–477. https://doi.org/10.1016/j.jobe.2018.04.027.
Bilberg, A., and A. A. Malik. 2019. “Digital twin driven human–robot collaborative assembly.” CIRP Ann. 68 (1): 499–502. https://doi.org/10.1016/j.cirp.2019.04.011.
Bischoff, M. 2020. “ROS#.” Accessed May 4, 2020. https://github.com/siemens/ros-sharp.
Bock, T. 2007. “Construction robotics.” Auton. Robots 22 (3): 201–209. https://doi.org/10.1007/s10514-006-9008-5.
Brosque, C., G. Skeie, and M. Fischer. 2021. “Comparative analysis of manual and robotic concrete drilling for installation hangers.” J. Constr. Eng. Manage. 147 (3): 05021001. https://doi.org/10.1061/(ASCE)CO.1943-7862.0002002.
Chen, J. Y. C., E. C. Haas, and M. J. Barnes. 2007. “Human performance issues and user interface design for teleoperated robots.” IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 37 (6): 1231–1245. https://doi.org/10.1109/TSMCC.2007.905819.
Chen, Y.-C., H.-L. Chi, S.-C. Kang, and S.-H. Hsieh. 2016. “Attention-based user interface design for a tele-operated crane.” J. Comput. Civ. Eng. 30 (3): 04015030. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000489.
Chitta, S., et al. 2017. “ros_control: A generic and simple control framework for ROS.” J. Open Source Software 2 (20): 456. https://doi.org/10.21105/joss.00456.
Chitta, S., I. Sucan, and S. Cousins. 2012. “MoveIt! [ROS Topics]” IEEE Rob. Autom. Mag. 19 (1): 18–19. https://doi.org/10.1109/MRA.2011.2181749.
Chotiprayanakul, P., D. K. Liu, and G. Dissanayake. 2012. “Human-robot-environment interaction interface for robotic grit-blasting of complex steel bridges.” Autom. Constr. 27 (Nov): 11–23. https://doi.org/10.1016/j.autcon.2012.04.014.
Chung, J., S. H. Lee, B. J. Yi, and W. K. Kim. 2010. “Implementation of a foldable 3-DOF master device to a glass window panel fitting task.” Autom. Constr. 19 (7): 855–866. https://doi.org/10.1016/j.autcon.2010.05.004.
Cichon, T., and J. Robmann. 2018. “Digital twins: Assisting and supporting cooperation in human-robot teams.” In Vol. 2 of Proc., 2018 15th Int. Conf. on Control, Automation, Robotics and Vision, ICARCV 2018, 486–491. New York: IEEE.
CPWR (Center for Construction Research and Training). 2018. The construction chart book: The US construction industry and its workers. 6th ed. Silver Spring, MD: CPWR.
David, O., F. X. Russotto, M. Da Silva Simoes, and Y. Measson. 2014. “Collision avoidance, virtual guides and advanced supervisory control teleoperation techniques for high-tech construction: Framework design.” Autom. Constr. 44 (Aug): 63–72. https://doi.org/10.1016/j.autcon.2014.03.020.
Deng, M., C. C. Menassa, and V. R. Kamat. 2021. “From BIM to digital twins: A systematic review of the evolution of intelligent building representations in the AEC-FM industry.” J. Inf. Technol. Construct. 26 (5): 58–83. https://doi.org/10.36680/j.itcon.2021.005.
Devadass, P., S. Stumm, and S. Brell-Cokcan. 2019. “Adaptive haptically informed assembly with mobile robots in unstructured environments.” In Proc., 36th Int. Symp. on Automation and Robotics in Construction, ISARC 2019, 469–476. Oulu, Finland: International Association for Automation and Robotics in Construction.
Dijkstra, E. W. 1959. “A note on two problems in connexion with graphs.” Numer. Math. 1 (1): 269–271. https://doi.org/10.1007/BF01386390.
Du, G., P. Zhang, J. Mai, and Z. Li. 2012. “Markerless Kinect-based hand tracking for robot teleoperation.” Int. J. Adv. Rob. Syst. 9 (2): 1–10. https://doi.org/10.5772/50093.
Du, J., Z. Zou, Y. Shi, and D. Zhao. 2018. “Zero latency: Real-time synchronization of BIM data in virtual reality for collaborative decision-making.” Autom. Constr. 85 (Jan): 51–64. https://doi.org/10.1016/j.autcon.2017.10.009.
El Hafi, L., et al. 2020. “System for augmented human–robot interaction through mixed reality and robot training by non-experts in customer service environments.” Adv. Rob. 34 (3–4): 157–172. https://doi.org/10.1080/01691864.2019.1694068.
ENR (Engineering News-Record). 2020. “Construction loses 975,000 jobs in April, due to COVID-19 impacts.” Accessed August 8, 2020. https://www.enr.com/articles/49333-construction-loses-975000-jobs-in-april-due-to-covid-19-impacts.
Fang, H. C., S. K. Ong, and A. Y. C. Nee. 2012. “Interactive robot trajectory planning and simulation using augmented reality.” Rob. Comput. Integr. Manuf. 28 (2): 227–237. https://doi.org/10.1016/j.rcim.2011.09.003.
Fang, Y., Y. K. Cho, and J. Chen. 2016. “A framework for real-time pro-active safety assistance for mobile crane lifting operations.” Autom. Constr. 72 (Dec): 367–379. https://doi.org/10.1016/j.autcon.2016.08.025.
Feng, C., Y. Xiao, A. Willette, W. McGee, and V. R. Kamat. 2015. “Vision guided autonomous robotic assembly and as-built scanning on unstructured construction sites.” Autom. Constr. 59 (Nov): 128–138. https://doi.org/10.1016/j.autcon.2015.06.002.
Frank, J. A., A. Brill, and V. Kapila. 2016. “Interactive mobile interface with augmented reality for learning digital control concepts.” In Proc., 2016 Indian Control Conf., ICC 2016, 85–92. New York: IEEE.
Ge, L., and F. Kuester. 2015. “Integrative simulation environment for conceptual structural analysis.” J. Comput. Civ. Eng. 29 (4): B4014004. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000405.
Gordian/RSMeans Data. 2019. Building construction costs with RSMeans data, 2020. Melbourne, FL: Florida Institute of Technology.
Grieves, M. 2014. Digital twin: Manufacturing excellence through virtual factory replication. Milford, MA: Digital Twin Consortium.
Hashimoto, S., A. Ishida, M. Inami, and T. Igarash. 2011. “TouchMe: An augmented reality based remote robot manipulation.” In Proc., 21st Int. Conf. on Artificial Reality and Telexistence (ICAT), 1–6. Tokyo: Virtual Reality Society of Japan.
Hornung, A., K. M. Wurm, M. Bennewitz, C. Stachniss, and W. Burgard. 2013. “OctoMap: An efficient probabilistic 3D mapping framework based on octrees.” Auton. Robots 34 (3): 189–206. https://doi.org/10.1007/s10514-012-9321-0.
IEEE. 2017. ISO/IEC/IEEE International Standard—Systems and software engineering—Vocabulary. ISO/IEC/IEEE 24765:2017(E). New York: IEEE. https://doi.org/10.1109/IEEESTD.2017.8016712.
Jung, K., B. Chu, S. Park, and D. Hong. 2013. “An implementation of a teleoperation system for robotic beam assembly in construction.” Int. J. Precis. Eng. Manuf. 14 (3): 351–358. https://doi.org/10.1007/s12541-013-0049-3.
Khasawneh, A., H. Rogers, J. Bertrand, K. C. Madathil, and A. Gramopadhye. 2019. “Human adaptation to latency in teleoperated multi-robot human-agent search and rescue teams.” Autom. Constr. 99 (Mar): 265–277. https://doi.org/10.1016/j.autcon.2018.12.012.
Kim, B., C. Kim, and H. Kim. 2012. “Interactive modeler for construction equipment operation using augmented reality.” J. Comput. Civ. Eng. 26 (3): 331–341. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000137.
Kim, D., J. Kim, K. Lee, C. Park, J. Song, and D. Kang. 2009. “Excavator tele-operation system using a human arm.” Autom. Constr. 18 (2): 173–182. https://doi.org/10.1016/j.autcon.2008.07.002.
Kim, J., S. You, S. Lee, V. R. Kamat, and L. P. Robert. 2015. “Evaluation of human robot collaboration in masonry work using immersive virtual environments need for IVE for advancing HRC in construction.” Accessed May 4, 2020. http://www.convr2015.com/wp-content/uploads/2015/10/Web-Proceedings-CONVR2015.pdf.
Kim, S., M. Peavy, P. C. Huang, and K. Kim. 2021. “Development of BIM-integrated construction robot task planning and simulation system.” Autom. Constr. 127 (Jul): 103720. https://doi.org/10.1016/j.autcon.2021.103720.
Koenig, N., and A. Howard. 2004. “Design and use paradigms for Gazebo, an open-source multi-robot simulator.” In Proc., 2004 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), 2149–2154. New York: IEEE.
Kubik, T., and M. Sugisaka. 2001. “Use of a cellular phone in mobile robot voice control.” In Proc., SICE Annual Conf., 106–111. New York: IEEE.
Kurien, M., M. K. Kim, M. Kopsida, and I. Brilakis. 2018. “Real-time simulation of construction workers using combined human body and hand tracking for robotic construction worker system.” Autom. Constr. 86 (Feb): 125–137. https://doi.org/10.1016/j.autcon.2017.11.005.
Kuts, V., T. Otto, T. Tahemaa, Y. Bondarenko, and E. Equilibrium. 2019. “Digital twin based synchronised control and simulation of the industrial robotic cell using virtual reality.” J. Mach. Eng. 19 (1): 128–144. https://doi.org/10.5604/01.3001.0013.0464.
Kyjanek, O., B. Al Bahar, L. Vasey, B. Wannemacher, and A. Menges. 2019. “Implementation of an augmented reality AR workflow for human robot collaboration in timber prefabrication.” In Proc., 36th Int. Symp. on Automation and Robotics in Construction, ISARC 2019, 1223–1230. Oulu, Finland: International Association for Automation and Robotics in Construction.
Lee, S., and J. I. Moon. 2014. “Introduction of human-robot cooperation technology at construction sites.” In Proc., 31st Int. Symp. on Automation and Robotics in Construction and Mining, ISARC 2014, 978–983. Oulu, Finland: International Association for Automation and Robotics in Construction.
Li, X., W. Yi, H. L. Chi, X. Wang, and A. P. C. Chan. 2018. “A critical review of virtual and augmented reality (VR/AR) applications in construction safety.” Autom. Constr. 86 (Feb): 150–162. https://doi.org/10.1016/j.autcon.2017.11.003.
Liang, C. J., V. R. Kamat, and C. C. Menassa. 2019. “Teaching robots to perform construction tasks via learning from demonstration.” In Proc., 36th Int. Symp. on Automation and Robotics in Construction, ISARC 2019, 1305–1311. Oulu, Finland: International Association for Automation and Robotics in Construction.
Liang, C. J., V. R. Kamat, and C. C. Menassa. 2020a. “Teaching robots to perform quasi-repetitive construction tasks through human demonstration.” Autom. Constr. 120 (Dec): 103370. https://doi.org/10.1016/j.autcon.2020.103370.
Liang, C. J., W. McGee, C. Menassa, and V. Kamat. 2020b. “Bi-directional communication bridge for state synchronization between digital twin simulations and physical construction robots.” In Proc., 37th Int. Symp. on Automation and Robotics in Construction, ISARC 2020, 1480–1487. Oulu, Finland: International Association for Automation and Robotics in Construction.
Liang, C. J., X. Wang, V. R. Kamat, and C. C. Menassa. 2021. “Human-robot collaboration in construction: Classification and research trends.” J. Constr. Eng. Manage. https://doi.org/10.1061(ASCE)CO.1943-7862.0002154.
Lin, Y. C., and D. Berenson. 2016. “Using previous experience for humanoid navigation planning.” In Proc., IEEE-RAS Int. Conf. on Humanoid Robots, 794–801. New York: IEEE.
Liu, C., S. Shirowzhan, S. M. E. Sepasgozar, and A. Kaboli. 2019. “Evaluation of classical operators and fuzzy logic algorithms for edge detection of panels at exterior cladding of buildings.” Buildings 9 (2): 40. https://doi.org/10.3390/buildings9020040.
Liu, M., S. Han, and S. Lee. 2017. “Potential of convolutional neural network-based 2D human pose estimation for on-site activity analysis of construction workers.” In Proc., Computing in Civil Engineering 2017, 141–149. Reston, VA: ASCE.
Liu, Y., F. Castronovo, J. Messner, and R. Leicht. 2020. “Evaluating the impact of virtual reality on design review meetings.” J. Comput. Civ. Eng. 34 (1): 04019045. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000856.
Lundeen, K. M. 2019. “Autonomous scene understanding, motion planning, and task execution for geometrically adaptive robotized construction work.” Ph.D. dissertation, Dept. of Civil and Environmental Engineering, Univ. of Michigan.
Lundeen, K. M., V. R. Kamat, C. C. Menassa, and W. McGee. 2017. “Scene understanding for adaptive manipulation in robotized construction work.” Autom. Constr. 82 (Oct): 16–30. https://doi.org/10.1016/j.autcon.2017.06.022.
Lundeen, K. M., V. R. Kamat, C. C. Menassa, and W. McGee. 2019. “Autonomous motion planning and task execution in geometrically adaptive robotized construction work.” Autom. Constr. 100 (Apr): 24–45. https://doi.org/10.1016/j.autcon.2018.12.020.
Malik, A. A., and A. Brem. 2021. “Digital twins for collaborative robots: A case study in human-robot interaction.” Rob. Comput. Integr. Manuf. 68 (Apr): 102092. https://doi.org/10.1016/j.rcim.2020.102092.
Mantha, B. R. K., C. C. Menassa, V. R. Kamat, and C. R. D’Souza. 2020. “Evaluation of preference- and constraint-sensitive path planning for assisted navigation in indoor building environments.” J. Comput. Civ. Eng. 34 (1): 04019050. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000865.
Maragkos, C., G. C. Vosniakos, and E. Matsas. 2019. “Virtual reality assisted robot programming for human collaboration.” Procedia Manuf. 38 (Jan): 1697–1704. https://doi.org/10.1016/j.promfg.2020.01.109.
Marton, Z. C., R. B. Rusu, and M. Beetz. 2009. “On fast surface reconstruction methods for large and noisy point clouds.” In Proc., 2009 IEEE Int. Conf. on Robotics and Automation, 3218–3223. New York: IEEE.
Milberg, C. T. 2006. “Application of tolerance management to civil systems.” Ph.D. dissertation, Dept. of Civil and Environmental Engineering, Univ. of California.
Murali, P. K., K. Darvish, and F. Mastrogiovanni. 2020. “Deployment and evaluation of a flexible human–robot collaboration model based on AND/OR graphs in a manufacturing environment.” Intell. Serv. Rob. 13 (4): 439–457. https://doi.org/10.1007/s11370-020-00332-9.
NAHB (National Association of Home Builders). 2015. Residential construction performance guidelines: For professional builders & remodelers. Washington, DC: NAHB.
Ong, S. K., A. W. W. Yew, N. K. Thanigaivel, and A. Y. C. Nee. 2020. “Augmented reality-assisted robot programming system for industrial applications.” Rob. Comput. Integr. Manuf. 61 (Feb): 101820. https://doi.org/10.1016/j.rcim.2019.101820.
Pan, J., S. Chitta, and D. Manocha. 2012. “FCL: A general purpose library for collision and proximity queries.” In Proc., IEEE Int. Conf. on Robotics and Automation, 3859–3866. New York: IEEE.
Patra, A. K., and S. J. Ray. 2007. “Guiding robots using mobile phone.” In Proc., 24th Int. Symp. on Automation and Robotics in Construction, ISARC 2007, 339–344. Oulu, Finland: International Association for Automation and Robotics in Construction.
Quigley, M., B. Gerkey, K. Conley, J. Faust, T. Foote, J. Leibs, E. Berger, R. Wheeler, and A. Ng. 2009. “ROS: An open-source robot operating system.” In Proc., ICRA Workshop on Open Source Software. New York: IEEE.
Quintero, C. P., R. Tatsambon, M. Gridseth, and M. Jagersand. 2015. “Visual pointing gestures for bi-directional human robot interaction in a pick-and-place task.” In Proc., IEEE International Workshop on Robot and Human Interactive Communication, 349–354. New York: IEEE.
Roldán, J. J., E. Peña-Tapia, D. Garzón-Ramos, J. de León, M. Garzón, J. del Cerro, and A. Barrientos. 2019. “Multi-robot systems, virtual reality and ROS: Developing a new generation of operator interfaces.” In Robot operating system (ROS), 29–64. Cham, Switzerland: Springer.
Roldán, J. J., E. Peña-Tapia, A. Martín-Barrio, M. A. Olivares-Méndez, J. Del Cerro, and A. Barrientos. 2017. “Multi-robot interfaces and operator situational awareness: Study of the impact of immersion and prediction.” Sensors 17 (8): 1720. https://doi.org/10.3390/s17081720.
ROS Wiki. 2020. “gazebo_ros_pkgs.” Accessed August 8, 2020. http://wiki.ros.org/gazebo_ros_pkgs.
Ruiz, J. J., A. Viguria, J. R. Martinez-De-Dios, and A. Ollero. 2015. “Immersive displays for building spatial knowledge in multi-UAV operations.” In Proc., 2015 Int. Conf. on Unmanned Aircraft Systems, 1043–1048. New York: IEEE.
Sawacha, E., S. Naoum, and D. Fong. 1999. “Factors affecting safety performance on construction sites.” Int. J. Project Manage. 17 (5): 309–315. https://doi.org/10.1016/S0263-7863(98)00042-8.
Seong, S., C. Lee, and J. Kim. 2019. “Intelligent multi-fingered dexterous hand using virtual reality (VR) and robot operating system (ROS).” In Vol. 751 of Advances in intelligent systems and computing, 35–41. Cham, Switzerland: Springer.
Sharif, M.-M., M. Nahangi, C. Haas, and J. West. 2017. “Automated model-based finding of 3D objects in cluttered construction point cloud models.” Comput.-Aided Civ. Infrastruct. Eng. 32 (11): 893–908. https://doi.org/10.1111/mice.12306.
Sharif, S., T. R. Gentry, and L. M. Sweet. 2016. “Human-robot collaboration for creative and integrated design and fabrication processes.” In Proc., 33th Int. Symp. on Automation and Robotics in Construction, ISARC 2016, 596–604. Oulu, Finland: International Association for Automation and Robotics in Construction.
Son, H., C. Kim, and K. Choi. 2010. “Rapid 3D object detection and modeling using range data from 3D range imaging camera for heavy equipment operation.” Autom. Constr. 19 (7): 898–906. https://doi.org/10.1016/j.autcon.2010.06.003.
Sucan, I. A., M. Moll, and L. E. Kavraki. 2012. “The open motion planning library.” IEEE Rob. Autom. Mag. 19 (4): 72–82. https://doi.org/10.1109/MRA.2012.2205651.
Sukumar, D. K., S. Lee, C. Georgoulas, and T. Bock. 2015. “Augmented reality-based tele-robotic system architecture for on-site construction.” In Proc., 32th Int. Symp. on Automation and Robotics in Construction, ISARC 2015, 1–8. Oulu, Finland: International Association for Automation and Robotics in Construction.
Tavares, P., C. M. Costa, L. Rocha, P. Malaca, P. Costa, A. P. Moreira, A. Sousa, and G. Veiga. 2019. “Collaborative welding system using BIM for robotic reprogramming and spatial augmented reality.” Autom. Constr. 106 (Oct): 102825. https://doi.org/10.1016/j.autcon.2019.04.020.
UQO Cyberpsychology Lab. 2004. “Revised presence questionnaire 3.0.” Accessed August 8, 2020. http://w3.uqo.ca/cyberpsy/docs/qaires/pres/PQ_va.pdf.
US DOD (Department of Defense). 2005. Dictionary of military and associated terms. Washington, DC: US DOD.
Walker, M., H. Hedayati, J. Lee, and D. Szafir. 2018. “Communicating robot motion intent with augmented reality.” In Proc., ACM/IEEE Int. Conf. on Human-Robot Interaction, 316–324. New York: IEEE.
Wang, Q., J. Guo, and M. K. Kim. 2019. “An application oriented scan-to-BIM framework.” Remote Sensing 11 (3): 365. https://doi.org/10.3390/rs11030365.
Wang, Q., Y. Tan, and Z. Mei. 2020a. “Computational methods of acquisition and processing of 3D point cloud data for construction applications.” Arch. Comput. Methods Eng. 27 (2): 479–499. https://doi.org/10.1007/s11831-019-09320-4.
Wang, X., C. J. Liang, C. Menassa, and V. Kamat. 2020b. “Real-time process-level digital twin for collaborative human-robot construction work.” In Proc., 37th Int. Symp. on Automation and Robotics in Construction, ISARC 2020, 1528–1535. Oulu, Finland: International Association for Automation and Robotics in Construction.
Wang, X. V., Z. Kemény, J. Váncza, and L. Wang. 2017. “Human–robot collaborative assembly in cyber-physical production: Classification framework and implementation.” CIRP Ann. 66 (1): 5–8. https://doi.org/10.1016/j.cirp.2017.04.101.
Whitney, D., E. Rosen, D. Ullman, E. Phillips, and S. Tellex. 2018. “ROS reality: A virtual reality framework using consumer-grade hardware for ROS-enabled robots.” In Proc., IEEE Int. Conf. on Intelligent Robots and Systems, 5018–5025. New York: IEEE.
Xu, L., C. Feng, V. R. Kamat, and C. C. Menassa. 2020. “A scene-adaptive descriptor for visual SLAM-based locating applications in built environments.” Autom. Constr. 112 (Apr): 103067. https://doi.org/10.1016/j.autcon.2019.103067.
Xu, X., and B. Garcia de Soto. 2020. “On-site autonomous construction robots: A review of research areas, technologies, and suggestions for advancement.” In Proc., 37th Int. Symp. on Automation and Robotics in Construction, 385–392. Oulu, Finland: International Association for Automation and Robotics in Construction.
You, S., J. H. Kim, S. H. Lee, V. Kamat, and L. P. Robert. 2018. “Enhancing perceived safety in human–robot collaborative construction using immersive virtual environments.” Autom. Constr. 96 (Dec): 161–170. https://doi.org/10.1016/j.autcon.2018.09.008.
Yu, Y. H., C. H. Yeh, T. T. Lee, P. Y. Chen, and Y. H. Shiau. 2014. “Chip-based real-time gesture tracking for construction robot’s guidance.” In Proc., 31th Int. Symp. on Automation and Robotics in Construction, ISARC 2014, 821–828. Oulu, Finland: International Association for Automation and Robotics in Construction.
Zhou, T., Q. Zhu, and J. Du. 2020. “Intuitive robot teleoperation for civil engineering operations with virtual reality and deep learning scene reconstruction.” Adv. Eng. Inf. 46 (Oct): 101170. https://doi.org/10.1016/j.aei.2020.101170.
Information & Authors
Information
Published In
Journal of Computing in Civil Engineering
Volume 35 • Issue 6 • November 2021
Copyright
© 2021 American Society of Civil Engineers.
History
Received: Dec 31, 2020
Accepted: Jun 17, 2021
Published online: Aug 26, 2021
Published in print: Nov 1, 2021
Discussion open until: Jan 26, 2022
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited by
- Xiaoyun Liang, Usman Rasheed, Jiannan Cai, Bastian Wibranek, Ibukun Awolusi, Impacts of Collaborative Robots on Construction Work Performance and Worker Perception: Experimental Analysis of Human–Robot Collaborative Wood Assembly, Journal of Construction Engineering and Management, 10.1061/JCEMD4.COENG-14390, 150, 8, (2024).
- Hongrui Yu, Vineet R. Kamat, Carol C. Menassa, Cloud-Based Hierarchical Imitation Learning for Scalable Transfer of Construction Skills from Human Workers to Assisting Robots, Journal of Computing in Civil Engineering, 10.1061/JCCEE5.CPENG-5731, 38, 4, (2024).
- Junjie Chen, Weisheng Lu, Yipeng Pan, Yonglin Fu, Building “RoboAvatar”: Industry Foundation Classes–Based Digital Representation of Robots in the Built Environment, Journal of Computing in Civil Engineering, 10.1061/JCCEE5.CPENG-5723, 38, 4, (2024).
- Sungboo Yoon, Moonseo Park, Changbum R. Ahn, LaserDex: Improvising Spatial Tasks Using Deictic Gestures and Laser Pointing for Human–Robot Collaboration in Construction, Journal of Computing in Civil Engineering, 10.1061/JCCEE5.CPENG-5715, 38, 3, (2024).
- Hongrui Yu, Vineet R. Kamat, Carol C. Menassa, Wes McGee, Yijie Guo, Honglak Lee, Grip State Recognition for Enabling Safe Human-Robot Object Handover in Physically Collaborative Construction Work, Computing in Civil Engineering 2023, 10.1061/9780784485224.095, (787-795), (2024).
- Sungboo Yoon, Jinsik Park, Moonseo Park, Changbum R. Ahn, A Deictic Gesture-Based Human-Robot Interface for In Situ Task Specification in Construction, Computing in Civil Engineering 2023, 10.1061/9780784485224.054, (445-452), (2024).
- Xuemin (Sherman) Shen, Jie Gao, Mushu Li, Conghao Zhou, Shisheng Hu, Mingcheng He, Weihua Zhuang, Toward immersive communications in 6G, Frontiers in Computer Science, 10.3389/fcomp.2022.1068478, 4, (2023).
- Maciej K. Wozniak, Rebecca Stower, Patric Jensfelt, Andre Pereira, Ginevra Castellano, Laurel Riek, Maya Cakmak, Iolanda Leite, What You See Is (not) What You Get, Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction, 10.1145/3568294.3580081, (243-247), (2023).
- Somin Park, Hongrui Yu, Carol C. Menassa, Vineet R. Kamat, A Comprehensive Evaluation of Factors Influencing Acceptance of Robotic Assistants in Field Construction Work, Journal of Management in Engineering, 10.1061/JMENEA.MEENG-5227, 39, 3, (2023).
- Sungboo Yoon, YeSeul Kim, Moonseo Park, Changbum R. Ahn, Effects of Spatial Characteristics on the Human–Robot Communication Using Deictic Gesture in Construction, Journal of Construction Engineering and Management, 10.1061/JCEMD4.COENG-12997, 149, 7, (2023).
- See more