Influence of Virtual Human Appearance Fidelity within Building Science Storytelling Educational Applications
Publication: Journal of Architectural Engineering
Volume 27, Issue 4
Abstract
Building science employs student–professional interactions to increase the learning and engagement of domain topics. Although these interactions are beneficial to students, labor shortages and automation trends will create barriers to expose students to professionals in the future. One solution is to utilize virtual situated learning contexts for students to experience simulated interactions with virtual professionals. Within these simulations, virtual humans are often used as a vehicle to preserve knowledge and deliver it to students. However, the impact of the fidelity of virtual human appearance on providing knowledge to the students within the building science domain remains unexplored. This paper presents a virtual reality (VR) educational system integrated with digital storytellers and grounded in the building science electrical career path context to explore how virtual human appearance fidelity affects student learning and engagement. A between-subject study was conducted with 42 construction management participants to explore the impact of 3 virtual human appearance fidelity conditions (realistic, modeled, and abstracted virtual human) in terms of student learning, social presence, virtual human persona factors, and topic interest. The findings of this study demonstrated that successful educational outcomes could be achieved with low virtual human appearance fidelity due to the lack of significant differences observed across experimental conditions. Furthermore, the study results did not detect significant differences in students' engagement by increasing the virtual human appearance fidelity. However, students across all experimental conditions reported engagement increments in the topic learned. The increments in student engagement suggest that the virtual human's age and gender are important factors to consider when designing educational interventions. These results contribute to the understanding of how to create virtual humans for building science educational interventions.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
The research team thanks Eileen Pesantes-Taveres, Ravi Srinivasan, Russell C. Walters, and Andrew Wehle from the Rinker School of Construction Management at the University of Florida for helping with the review and distribution of the online survey. The research team would also like to thank Alexander Webber for assisting in the usability testing of the storytelling system. This material is based upon work supported by the National Science Foundation under Grant No. 1821852.
References
Alahmad, M., M. Pfannenstiel, C. Waters, and D. Alvine. 2007. “Education and industry, union to facilitate engineering learning.” In Proc., 114th Annual American Society for Engineering Education, 24–27. Washington, DC: ASEE.
Alahmad, M., and J. Tills. 2010. “Learning applications in the architectural engineering educational setting.” J. Archit. Eng. 16 (4): 126–135. https://doi.org/10.1061/(ASCE)AE.1943-5568.0000021.
Anderson, A., C. S. Dossick, R. Azari, J. E. Taylor, T. Hartmann, and A. Mahalingham. 2014. “Exploring BIMs as avatars: Using 3D virtual worlds to improve collaboration with models.” In Construction Research Congress 2014: Construction in a Global Network, edited by D. Castro-Lacouture, J. Irizarry, and B. Ashuri, 179–188. Reston, VA: ASCE.
Arain, F. M., and M. Burkle. 2011. “Learning construction project management in the virtual world: Leveraging on second life.” J. Inf. Technol. Constr. 16 (16): 243–258.
Badler, N. 1997. “Virtual humans for animation, ergonomics, and simulation.” In Proc., IEEE Nonrigid and Articulated Motion Workshop, 28–36. Piscataway, NJ: IEEE.
Bailenson, J. N., J. Blascovich, A. C. Beall, and J. M. Loomis. 2003. “Interpersonal distance in immersive virtual environments.” Personality Soc. Psychol. Bull. 29 (7): 819–833. https://doi.org/10.1177/0146167203029007002.
Baylor, A., and J. Ryu. 2003. “The API (agent persona instrument) for assessing pedagogical agent persona.” In EdMedia+Innovate Learning, 448–451. Waynesville, NC: Association for the Advancement of Computing in Education (AACE).
Baylor, A. L., and Y. Kim. 2004. “Pedagogical agent design: The impact of agent realism, gender, ethnicity, and instructional role.” In Int. Conf. on Intelligent Tutoring Systems, 592–603. Berlin: Springer.
Beaty, C. S., C. E. Waters, G. R. Dziuvenis, and T. M. Feldman. 2014. “Use of professional industry interaction to enhance engineering education.” J. Archit. Eng. 20 (3): 05014001. https://doi.org/10.1061/(ASCE)AE.1943-5568.0000148.
Bock, T. 2015. “The future of construction automation: Technological disruption and the upcoming ubiquity of robotics.” Autom. Constr. 59: 113–121. https://doi.org/10.1016/j.autcon.2015.07.022.
Bowles, N. 1995. “Storytelling: A search for meaning within nursing practice.” Nurse Educ. Today 15 (5): 365–369. https://doi.org/10.1016/S0260-6917(95)80010-7.
Brennan, C., M. Daly, E. Fitzpatrick, and E. Sweeney. 2004. “Tradition versus technology: Careers fairs in the 21st century.” Int. J. Educ. Vocat. Guid. 4 (1): 23–41. https://doi.org/10.1023/B:IJVO.0000021056.29294.06.
Callejas-Sandoval, S., and S. Kwon. 2019. “Smart wearable technologies to promote safety in aging construction labor.” In Creative Construction Conf. 2019, 733–738. Budapest, Hungary: Budapest University of Technology and Economics.
Carini, R. M., G. D. Kuh, and S. P. Klein. 2006. “Student engagement and student learning: Testing the linkages.” Res. Higher Educ. 47 (1): 1–32. https://doi.org/10.1007/s11162-005-8150-9.
Castronovo, F., D. Nikolic, S. E. Zappe, R. M. Leicht, and J. I. Messner. 2014. “Enhancement of learning objectives in construction engineering education: A step toward simulation assessment.” In Construction Research Congress 2014: Construction in a Global Network, edited by D. Castro-Lacouture, J. Irizarry, and B. Ashuri, 339–348. Reston, VA: ASCE.
Chaturvedi, H., N. D. Newsome, and S. V. Babu. 2015. “An evaluation of virtual human appearance fidelity on user’s positive and negative affect in human–virtual human interaction.” In 2015 IEEE Virtual Reality, 163–164. Piscataway, NJ: IEEE.
Cheng, T., and J. Teizer. 2013. “Real-time resource location data collection and visualization technology for construction safety and activity monitoring applications.” Autom. Constr. 34: 3–15. https://doi.org/10.1016/j.autcon.2012.10.017.
Daher, S., J. Hochreiter, N. Norouzi, L. Gonzalez, G. Bruder, and G. Welch. 2018. “Physical-virtual agents for healthcare simulation.” In Proc., 18th Int. Conf. on Construction Applications of Virtual Reality, 99–106. New York: Association for Computing Machinery.
Dinçer, S., and A. Doğanay. 2017. “The effects of multiple-pedagogical agents on learners’ academic success, motivation, and cognitive load.” Comput. Educ. 111: 74–100. https://doi.org/10.1016/j.compedu.2017.04.005.
Eiris, R., and M. Gheisari. 2017. “Research trends of virtual human applications in architecture, engineering and construction.” J. Inf. Technol. Constr. 22 (9): 168–184.
Eiris, R., and M. Gheisari. 2019. “360-Degree panoramas as a reality capturing technique in construction domain: Applications and limitations.” In Proc., 55th ASC Annual Int. Conf, 435–442. Cheyenne, WY: Associated Schools of Construction. Accessed October 18, 2020. http://ascpro0.ascweb.org/archives/cd/2019/welcome.htm.
Eiris, R., M. Gheisari, and B. Esmaeili. 2018. “PARS: Using augmented 360-degree panoramas of reality for construction safety training.” Int. J. Environ. Res. Public Health 15 (11): 2452. https://doi.org/10.3390/ijerph15112452.
Eiris, R., M. Gheisari, and B. Esmaeili. 2020a. “Desktop-based safety training using 360-degree panorama and static virtual reality techniques: A comparative experimental study.” Autom. Constr. 109: 102969. https://doi.org/10.1016/j.autcon.2019.102969.
Eiris, R., A. Jain, M. Gheisari, and A. Wehle. 2020b. “Safety immersive storytelling using narrated 360-degree panoramas: A fall hazard training within the electrical trade context.” Saf. Sci. 127: 104703. https://doi.org/10.1016/j.ssci.2020.104703.
Eiris, R., J. Wen, and M. Gheisari. 2020c. “iVisit: Digital interactive construction site visits using 360-degree panoramas and virtual humans.” In Construction Research Congress 2020: Computer Applications, edited by P. Tang, D. Grau, and M. El Asmar, 1106–1116. Reston, VA: ASCE.
Giannakou, O., and A. I. Klonari. 2019. “Digital storytelling in education using Webgis.” Eur. J. Geogr. 10 (3): 154–172.
Goedert, J. D., and S. Rokooei. 2016. “Project-based construction education with simulations in a gaming environment.” Int. J. Constr. Educ. Res. 12 (3): 208–223. https://doi.org/10.1080/15578771.2015.1121936.
Gu, N., W. Nakapan, A. Williams, and L. Gul. 2009. “Evaluating the use of 3D virtual worlds in collaborative design learning.” In Proc., CAAD Futures, 51–64. The Netherlands: PUM Publisher. Accessed October 18, 2020. https://sites.google.com/unicamp.br/caadfutures/.
Hamilton, M., and M. Weiss. 2005. Children tell stories: Teaching and using storytelling in the classroom. Katonah, NY: Richard C Owen.
Hidi, S., and K. A. Renninger. 2006. “The four-phase model of interest development.” Educ. Psychol. 41 (2): 111–127. https://doi.org/10.1207/s15326985ep4102_4.
Kandi, V. R., F. Castronovo, P. Brittle, S. Mastrolembo Ventura, and D. Nikolic. 2020. “Assessing the impact of a construction virtual reality game on design review skills of construction students.” J. Archit. Eng. 26 (4): 04020035. https://doi.org/10.1061/(ASCE)AE.1943-5568.0000434.
Kiral, I. A., S. Comu, and C. Kavaklioglu. 2015. “Enhancing the construction safety training by using virtual safety training tool: V-safe.” In Canadian Society for Civil Engineering Int. Construction Specialty Conf., 1–10. Vancouver, Canada: Canadian Society for Civil Engineering. Accessed October 18, 2020. https://open.library.ubc.ca/cIRcle/collections/52660.
Kobre, K. 2013. Videojournalism: Multimedia storytelling. Burlington, MA: Focal Press.
Le, Q. T., A. Pedro, and C. S. Park. 2015. “A social virtual reality based construction safety education system for experiential learning.” J. Intell. Rob. Syst. 79 (3–4): 487–506. https://doi.org/10.1007/s10846-014-0112-z.
Lee, E. A. L., K. W. Wong, and C. C. Fung. 2010. “How does desktop virtual reality enhance learning outcomes? A structural equation modeling approach.” Comput. Educ. 55 (4): 1424–1442. https://doi.org/10.1016/j.compedu.2010.06.006.
Lee, J., B. Kim, K. Kim, Y. Kim, and J. Noh. 2016. “Rich360: Optimized spherical representation from structured panoramic camera arrays.” ACM Trans. Graphics 35 (4): 63. https://doi.org/10.1145/2897824.2925983.
Leece, R. 2005. “A virtual careers fair.” Aust. J. Career Dev. 14 (2): 34–39. https://doi.org/10.1177/103841620501400207.
Li, T., and S. Tai. 2017. “Workplace condition needs for aging project management personnel in the construction industry.” In ICCREM 2016: BIM Application and Off-Site Construction, 378–385. Reston, VA: ASCE.
McDonnell, R., M. Breidt, and H. H. Bülthoff. 2012. “Render me real?.” ACM Trans. Graphics 31 (4): 1–11. https://doi.org/10.1145/2185520.2185587.
Minooei, F., M. A. Albattah, P. M. Goodrum, and T. Taylor. 2017. “Towards deeper understanding of future craft shortages in the construction industry: Supply and demand sides.” In CSCE 2017 Annual Conf., 1–8. Vancouver, Canada: Canadian Society for Civil Engineering.
Mutis, I. 2018. “Spatial–temporal cognitive ability: Coupling representations to situations and contexts for coordinating activities in the construction project environment.” In Transforming Engineering Education: Innovative Computer-Mediated Learning Technologies, edited by I. Mutis, R. Fruchter, and C. C. Menassa, 5–24. Reston, VA: ASCE. https://doi.org/10.1061/9780784414866.ch02.
Neuhauser, P. 1993. Corporate legends and lore: The power of storytelling as a management tool. New York: McGraw-Hill.
Ning Shen, K., and M. Khalifa. 2008. “Exploring multidimensional conceptualization of social presence in the context of online communities.” Int. J. Hum.-Comput. Interact. 24 (7): 722–748. https://doi.org/10.1080/10447310802335789.
NSN (National Storytelling Network). n.d. What is storytelling? Kansas City, MO: NSM.
Olsen, D., M. Tatum, and C. Defnall. 2012. “How industrial contractors are handling skilled labor shortages in the United States.” In Proc., 48th ASC Annual Int. Conf., 1–6. Cheyenne, WY: Associated Schools of Construction.
Pedro, A., Q. T. Le, and C. S. Park. 2016. “Framework for integrating safety into construction methods education through interactive virtual reality.” J. Prof. Issues Eng. Educ. Pract. 142 (2): 04015011. https://doi.org/10.1061/(ASCE)EI.1943-5541.0000261.
Pence, T. B., L. C. Dukes, L. F. Hodges, N. K. Meehan, and A. Johnson. 2013. “The effects of interaction and visual fidelity on learning outcomes for a virtual pediatric patient system.” In 2013 IEEE Int. Conf. on Healthcare Informatics, 209–218. Piscataway, NJ: IEEE.
Pham, H. C., N.-N. Dao, J.-U. Kim, S. Cho, and C.-S. Park. 2018. “Energy-efficient learning system using web-based panoramic virtual photoreality for interactive construction safety education.” Sustainability 10 (7): 2262. https://doi.org/10.3390/su10072262.
Robin, B. R. 2016. “The power of digital storytelling to support teaching and learning.” Digital Educ. Rev. 30: 17–29.
Rossiter, M. 2002. Narrative and stories in adult teaching and learning. ERIC digest. Columbus, OH: ERIC.
Sakka, Z. I., and I. A. Zualkernan. 2005. “Digital storytelling in higher education: A case study in a civil engineering laboratory.” In Proc., 5th IEEE Int. Conf. on Advanced Learning Technologies, 365–367. Piscataway, NJ: IEEE.
Selmanovic, E., S. Rizvic, C. Harvey, D. Boskovic, V. Hulusic, M. Chahin, and S. Sljivo. 2018. “VR video storytelling for intangible cultural heritage preservation.” In Proc., 16th EUROGRAPHICS Workshop on Graphics and Cultural Heritage, 1–11. Vienna, Austria: CHNT Cultural Heritage and New Technologies.
Shaw, N., and P. Liu. 2016. “A knowledge management system (KMS) using a storytelling-based approach to collect tacit knowledge.” In SoutheastCon 2016, 1–6. Piscataway, NJ: IEEE.
Spearman, C. 1904. “The proof and measurement of association between two things.” Am. J. Psychol. 15 (1): 72–101. https://doi.org/10.2307/1412159.
Su, X., P. S. Dunston, R. W. Proctor, and X. Wang. 2013. “Influence of training schedule on development of perceptual–motor control skills for construction equipment operators in a virtual training system.” Autom. Constr. 35: 439–447. https://doi.org/10.1016/j.autcon.2013.05.029.
Suryadi, J. 2018. “Examining the Labor Shortage in the Construction Industry and Possible Solutions Presented by Industry Members.” Construction Management, Accessed October 18, 2020. https://digitalcommons.calpoly.edu/cmsp/121/.
US Bureau of Labor Statistics. 2020. “Electricians: Occupational outlook handbook.” Accessed October 18, 2020. https://www.bls.gov/ooh/construction-and-extraction/electricians.htm#tab-6.
Volante, M., S. V. Babu, H. Chaturvedi, N. Newsome, E. Ebrahimi, T. Roy, S. B. Daily, and T. Fasolino. 2016. “Effects of virtual human appearance fidelity on emotion contagion in affective inter-personal simulations.” IEEE Trans. Visual Comput. Graphics 22 (4): 1326–1335. https://doi.org/10.1109/TVCG.2016.2518158.
Volonte, M., A. T. Duchowski, and S. V. Babu. 2019. “Effects of a virtual human appearance fidelity continuum on visual attention in virtual reality.” In Proc., 19th ACM Int. Conf. Intelligent Virtual Agents, 141–147. New York: Association for Computing Machinery. https://doi.org/10.1145/3308532.3329461.
Vosinakis, S., P. Koutsabasis, M. Stavrakis, J. Darzentas, and N. Viorres. 2008. “Virtual environments for collaborative design: Requirements and guidelines from a social action perspective.” Int. J. CoCreation Des. Arts 4 (3): 133–150. https://doi.org/10.1080/15710880802250112.
Walsh, L. 2016. “Media buying: A case study of the IBEW recruitment campaign.” Accessed March 25, 2021. https://www.oswegocreative.com/single-post/2016/02/23/Media-Buying-a-Case-Study-of-the-IBEW-Recruitment-Campaign.
Wang, P., P. Wu, J. Wang, H.-L. Chi, and X. Wang. 2018. “A critical review of the use of virtual reality in construction engineering education and training.” Int. J. Environ. Res. Public Health 15 (6): 1204. https://doi.org/10.3390/ijerph15061204.
Warwick, K., J. Gray, and D. Roberts. 1993. Virtual reality in engineering. London: Institution of Electrical Engineers.
Wefald, A. J., and R. G. Downey. 2009. “Construct dimensionality of engagement and its relation with satisfaction.” J. Psychol. 143 (1): 91–112. https://doi.org/10.3200/JRLP.143.1.91-112.
Wen, J., and M. Gheisari. 2020. “Using virtual reality to facilitate communication in the AEC domain: A systematic review.” Constr. Innov. 20 (3): 509–542. https://doi.org/10.1108/CI-11-2019-0122.
Wu, J., and D.-T. V. Chen. 2020. “A systematic review of educational digital storytelling.” Comput. Educ. 147: 103786. https://doi.org/10.1016/j.compedu.2019.103786.
Yan, W., C. Culp, and R. Graf. 2011. “Integrating BIM and gaming for real-time interactive architectural visualization.” Autom. Constr. 20 (4): 446–458. https://doi.org/10.1016/j.autcon.2010.11.013.
Young, B., E. Ellobody, and T. W. Hu. 2012. “3D visualization of structures using finite-element analysis in teaching.” J. Prof. Issues Eng. Educ. Pract. 138 (2): 131–138. https://doi.org/10.1061/(ASCE)EI.1943-5541.0000093.
Zhai, D., P. M. Goodrum, C. T. Haas, and C. H. Caldas. 2009. “Relationship between automation and integration of construction information systems and labor productivity.” J. Constr. Eng. Manage. 135 (8): 746–753. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000024.
Zibrek, K., S. Martin, and R. McDonnell. 2019. “Is photorealism important for perception of expressive virtual humans in virtual reality?” ACM Trans. Appl. Percept. 16 (3): 1–19. https://doi.org/10.1145/3349609.
Zibrek, K., and R. McDonnell. 2014. “Does render style affect perception of personality in virtual humans?” In Proc., ACM Symp. on Applied Perception, 111–115. New York: Association for Computing Machinery. https://doi.org/10.1145/2628257.2628270.
Information & Authors
Information
Published In
Journal of Architectural Engineering
Volume 27 • Issue 4 • December 2021
Copyright
© 2021 American Society of Civil Engineers.
History
Received: Dec 7, 2020
Accepted: Aug 6, 2021
Published online: Sep 7, 2021
Published in print: Dec 1, 2021
Discussion open until: Feb 7, 2022
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited by
- Yuan Sun, Masoud Gheisari, Idris Jeelani, A Virtual Site Visit on Four-Legged Robot Applications in Construction, Construction Research Congress 2024, 10.1061/9780784485293.009, (80-89), (2024).
- Jiun-Yao Cheng, Masoud Gheisari, Idris Jeelani, Using 360-Degree Virtual Reality Technology for Training Construction Workers about Safety Challenges of Drones, Journal of Computing in Civil Engineering, 10.1061/JCCEE5.CPENG-5140, 37, 4, (2023).