Application of Vision-Based Artificial Intelligence in Creating a Contactless Interaction with Immersive Environments
Publication: Computing in Civil Engineering 2021
ABSTRACT
Virtual reality (VR) is one of the building information modeling (BIM) use cases that can benefit a project from the early stages of design to the construction and operation phases. VR enables designers, contractors, and owners to experience interacting with a facility before it is constructed. Currently, interaction with VR environments takes place through controllers. The equipment helps users to navigate virtual facilities and interact with the surrounding objects. Although controllers address the need for creating an interactive virtual environment, they make the experience less realistic, since real-life interactions take place through body movements, not by/through pressing buttons. This paper reports a project in which vision-based artificial intelligence (AI) technology is used to create a contactless connection between users and virtual environments. In this project, a series of body movements and gestures are mapped to the input commands of a BIM-based VR software. The paper overviews the state of the art in remote human-computer interaction (HCI) technologies and discusses both the potential and challenges of applying HCI technologies to immersive VR environments. It then introduces the architecture of the developed, contactless virtual environment and reports a case study of using this technology in an immersive setting.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Ahmed, S. (2019). A review on using opportunities of augmented reality and virtual reality in construction project management. Organization, Technology and Management in Construction: an International Journal, 11(1), 1839–1852.
Alin, P., Iorio, J., and Taylor, J. E. (2013). Digital boundary objects as negotiation facilitators: Spanning boundaries in virtual engineering project networks. Project Management Journal, 44(3), 48–63.
Anderson, A., Dossick, C., Azari, R., Taylor, J. E., Hartmann, T., and Mahalingam, A. (2014). Exploring BIMs as avatars: using 3D virtual worlds to improve collaboration with models. Proceedings of Construction Research Congress: Construction in a Global Network, 179–188.
Bademosi, F., Blinn, N., and Issa, R. R. (2019). Use of augmented reality technology to enhance comprehension of construction assemblies. ITcon, 24, 58–79.
Du, J., Zhao, D., Issa, R. R., and Singh, N. (2020). BIM for improved project communication networks: Empirical evidence from email logs. Journal of Computing in Civil Engineering, 34(5), 04020027.
Guna, J., Geršak, G., Humar, I., et al. (2020). Virtual Reality Sickness and Challenges Behind Different Technology and Content Settings. Mobile Netw Appl. 25, 1436–1445.
Hachaj, T., and Baraniewicz, D. (2015). Knowledge Bricks—Educational immersive reality environment, International Journal of Information Management, Volume 35, Issue 3, 2015, Pages 396–406.
Haria, A., Subramanian, A., Asokkumar, N., Poddar, S., and Nayak, J. (2017). Hand Gesture Recognition for Human Computer Interaction, Procedia Computer Science, Volume 115, Pages 367–374.
Hou, L., Wang, X., and Truijens, M. (2015). Using augmented reality to facilitate piping assembly: an experiment-based evaluation. Journal of Computing in Civil Engineering, 29(1), 05014007.
Iorio, J., Peschiera, G., Taylor, J. E., and Korpela, L. (2011). Factors impacting usage patterns of collaborative tools designed to support global virtual design project networks. Journal of Information Technology in Construction (ITcon), 16(14), 209–230.
Iorio, J., and Taylor, J. E. (2015). Precursors to engaged leaders in virtual project teams. International Journal of Project Management, 33(2), 395–405.
Jones, S., and Laquida-Carr, D. (2015). Measuring the Impact of BIM on Complex Buildings, Dodge Data & Analytics, Beford, MA.
Messner, J., Anumba, C., Dubler, C., Goodman, S., Kasprzak, C., Kreider, R., Leicht, R., Saluja, C., and Zikic, N. (2019). BIM Project Execution Planning Guide (v. 2.2).
NIBS. (2015). National BIM Standard – United States Version 3, National Institute of Building Sciences buildingSMART alliance.
Sacks, R., Perlman, A., and Barak, R. (2013). Construction safety training using immersive virtual reality, Construction Management and Economics, 31:9, 1005–1017.
Saredakis, D., Szpak, A., Birckhead, B., Keage, H. A., Rizzo, A., and Loetscher, T. (2020). Factors associated with virtual reality sickness in head-mounted displays: a systematic review and meta-analysis. Frontiers in human neuroscience, 14.
Sharma, R., and Verma, G. (2015). Human Computer Interaction using Hand Gesture, Procedia Computer Science, Volume 54, Pages 721–727.
Stephan, J., and Jadwaa, S. (2010). Gesture Recognition for Human-Computer Interaction (HCI). Int. J. Adv. Comp. Techn. Vol. 2. 30–35.
Tsung-Han, T., Chih-Chi, H., and Kung-Long, Z. (2020). Design of hand gesture recognition system for human-computer interaction. Multimedia Tools and Applications, 79(9-10), 5989–6007.
Vuletic, T., Duffy, A., Hay, L., McTeague, C., Campbell, G., and Grealy,M. (2019). Systematic literature review of hand gestures used in human computer interaction interfaces. International Journal of Human-Computer Studies, Volume 129, 74–94.
Wang, X., and Yan, K. (2019). Immersive human–computer interactive virtual environment using large-scale display system, Future Generation Computer Systems, Volume 96, 2019, Pages 649–659.
Woksepp, S., and Olofsson, T. (2008). Credibility and applicability of virtual reality models in design and construction. Advanced Engineering Informatics, 22(4), 520–528.
Yeo, H., Lee, B., and Lim, H. (2015). Hand tracking and gesture recognition system for human-computer interaction using low-cost hardware. Multimedia Tools and Applications, 74(8), 2687–2715.
Information & Authors
Information
Published In
Computing in Civil Engineering 2021
Pages: 1351 - 1358
History
Published online: May 24, 2022
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.