Perceived Importance of Authentic Learning Factors in Designing Construction Safety Simulation Game-Based Assignment: Random Forest Approach
Publication: Journal of Construction Engineering and Management
Volume 146, Issue 3
Abstract
The construction industry remains the top contributor of fatalities and major injuries despite its stringent laws, safety technologies, and mandatory construction safety courses. Limited safety knowledge, insufficient safety training, lack of work experience, and ineffective pedagogy in institutes of higher learning (IHLs) are some of the possible reasons for the industry’s poor safety performance. Thus, there is an urgent need to improve the construction safety and health (CSH) education in IHLs. Authentic learning was found to be a suitable pedagogical framework to guide CSH education in IHLs. In this study, a simulation game-based assignment was proposed, and feedback was sought from practitioners and undergraduate students. In terms of academic contributions, the study found that the nine characteristics of an authentic learning environment can be grouped into three factors: authenticity, group work, and guidance. Based on a random forest permutation importance evaluation, the three authentic learning factors are more important than the role (student or practitioner) and the number of gaming hours per week. Furthermore, authenticity is the most important factor followed by group work and guidance. From a practice perspective, it is important to note that even though the role is not an important factor in influencing the perceived effectiveness of the proposed simulation game-based assignment, practitioners still have a stronger preference for game design that promotes realism and authenticity, e.g. realistic gaming environment, ability to take pictures of hazards in the game, and an authentic (versus fantasy) game theme. Students have a stronger preference for multiplayer games than practitioners. This study provided the basis for the design of an effective simulation game-based assignment. At the time of writing, a prototype simulation game had been developed based on this study.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or code generated or used during the study are proprietary or confidential in nature and may only be provided with restrictions. The survey data can only be shared in an anonymized and aggregated form.
Acknowledgments
This study is funded by the Singapore Ministry of Education FTier 1 (R-296-000-173-114). The contributions of Mr. K.C. Tan, Mr. Timothy Yen, Mr. John Yap, Mr. Alfred Lim, and Mr. Hendri Setia Wardana are acknowledged and greatly appreciated.
References
Abaza, M., and O. Steyn. 2008. “Role of computer serious games in education and training.” In Proc., Society for Information Technology and Teacher Education Int. Conf., edited by K. McFerrin, R. Weber, R. Carlsen, and D. A. Willis, 1592–1599. Las Vegas, NV: Association for the Advancement of Computing in Education.
Abdelhamid, T. S., and J. Everett. 2000. “Identifying root causes of construction accidents.” J. Constr. Manage. 126 (1): 52–60. https://doi.org/10.1061/(ASCE)0733-9364(2000)126:1(52).
Albert, A., and M. R. Hallowel. 2013. “Revamping occupational safety and health training: Integrating andragogical principles for the adult learner.” Aust. J. Constr. Econ. Build. 13 (3): 128–140. https://doi.org/10.5130/AJCEB.v13i3.3178.
Alessi, S. M. 1988. “Fidelity in the design of instructional simulations.” J. Comput.-Based Instruction 15 (2): 40–47.
Amory, A. 2014. “Tool-mediated authentic learning in an educational technology course: A designed-based innovation.” Interact. Learn. Environ. 22 (4): 497–513. https://doi.org/10.1080/10494820.2012.682584.
Archer, K. J., and R. V. Kimes. 2008. “Empirical characterization of random forest variable importance measures.” Comput. Stat. Data Anal. 52 (4): 2249–2260. https://doi.org/10.1016/j.csda.2007.08.015.
Barab, S. A., K. D. Squire, and W. Dueber. 2000. “A co-evolutionary model for supporting the emergence of authenticity.” Educ. Technol. Res. Dev. 48 (2): 37–62. https://doi.org/10.1007/BF02313400.
Barrett, K. A., and W. L. Johnson. 2011. “Developing serious games for learning language-in-culture.” In Gaming and simulations: Concepts, methodologies, tools and applications, 281–311. Hershey, PA: IGI Global.
Boyle, E. A., E. W. MacArthur, T. M. Connolly, T. Hainey, M. Manea, A. Kärki, and P. van Rosmalen. 2014. “A narrative literature review of games, animations and simulations to teach research methods and statistics.” Comput. Educ. 74 (May): 1–14. https://doi.org/10.1016/j.compedu.2014.01.004.
Breiman, L. 2001. “Random forests.” Mach. Learn. 45 (1): 5–32. https://doi.org/10.1023/A:1010933404324.
Breiman, L., J. Friedman, R. Olshen, and C. Stone. 1984. Classification and regression trees. Monterey, CA: Wadsworth & Brooks.
Brian, F., and K. Lisa. 2009. “Using online simulation to engage users in an authentic learning environment.” In Handbook of research on effective electronic gaming in education, 315–330. Hershey, PA: IGI Global.
Brown, I., and C. Mues. 2012. “An experimental comparison of classification algorithms for imbalanced credit scoring data sets.” Expert Syst. Appl. 39 (3): 3446–3453. https://doi.org/10.1016/j.eswa.2011.09.033.
Burdea Grigore, C., and P. Coiffet. 1994. Virtual reality technology. London: Wiley-Interscience.
Cannon-Bowers, J. 2010. “The way ahead for serious games.” In Serious game design and development: Technologies for training and learning, 305–310. Hershey, PA: IGI Global.
Chen, X., and H. Ishwaran. 2012. “Random forests for genomic data analysis.” Genomics 99 (6): 323–329. https://doi.org/10.1016/j.ygeno.2012.04.003.
Cherrett, T., G. Wills, J. Price, S. Maynard, and I. E. Dror. 2009. “Making training more cognitively effective: Making videos interactive.” Br. J. Educ. Technol. 40 (6): 1124–1134. https://doi.org/10.1111/j.1467-8535.2009.00985.x.
Corradi, J. P., S. Thompson, J. F. Mather, C. M. Waszynski, and R. S. Dicks. 2018. “Prediction of incident delirium using a random forest classifier.” J. Med. Syst. 42 (12): 261. https://doi.org/10.1007/s10916-018-1109-0.
Cunningham, D., and T. Duffy. 1996. “Constructivism: Implications for the design and delivery of instruction.” In Vol. 51 of Handbook of research for educational communications and technology edited by D. H. Jonassen, 170–198. New York: Macmillan Library Reference USA.
Dale, E. 1946. “The cone of experience.” In Audio-visual methods in teaching, edited by E. Dale, 37–52. New York: Dryden Press.
Dawood, N., G. Miller, J. Patacas, and M. Kassem. 2014. “Construction health and safety training: The utilisation of 4D enabled serious games.” J. Inf. Technol. Constr. 19: 326–335.
Dewey, J. 1962. The relation of theory to practice in education. Cedar Falls, IA: Association for Student Teaching.
Dörner, R., and U. Spierling. 2014. “Serious games development as a vehicle for teaching entertainment technology and interdisciplinary teamwork: Perspectives and pitfalls.” In Proc., 2014 ACM Int. Workshop on Serious Games, 3–8. New York: Association for Computing Machinery.
Du, W., and Z. Zhan. 2002. “Building decision tree classifier on private data.” In Proc., IEEE Int. Conf. on Privacy, Security and Data Mining-Volume 14, 1–8. Maebashi City, Japan: Australian Computer Society.
Gambatese, J. A. 2003. Safety emphasis in university engineering and construction programs. Gainesville, FL: Univ. of Florida:.
Genuer, R., J.-M. Poggi, and C. Tuleau-Malot. 2010. “Variable selection using random forests.” Pattern Recognit. Lett. 31 (14): 2225–2236. https://doi.org/10.1016/j.patrec.2010.03.014.
Gilbertson, A., J. Kappia, L. Bosher, and A. Gibb. 2011. Preventing catastrophic events in construction. London: Health and Safety Executive.
Goh, Y. M., and N. F. Binte Sa’Adon. 2015. “Cognitive factors influencing safety behavior at height: A multimethod exploratory study.” J. Constr. Eng. Manage. 141 (6): 40150031–40150038. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000972.
Guo, H., H. Li, G. Chan, and M. Skitmore. 2012. “Using game technologies to improve the safety of construction plant operations.” Accid. Anal. Prev. 48 (Sep): 204–213. https://doi.org/10.1016/j.aap.2011.06.002.
Hair, J., W. Black, B. Babin, and R. Anderson. 2010. Multivariate data analysis: A global perspective. Upper Saddle River, NJ: Pearson Education.
Hamari, J., D. J. Shernoff, E. Rowe, B. Coller, C. J. Asbell, and T. Edwards. 2016. “Challenging games help students learn: An empirical study on engagement, flow and immersion in game-based learning.” Compu. Hum. Behav. 54 (Jan): 170–179. https://doi.org/10.1016/j.chb.2015.07.045.
Harteveld, C., R. Guimarães, I. Mayer, and R. Bidarra. 2007. Balancing pedagogy, game and reality components within a unique serious game for training levee inspection, 128–139. Berlin: Springer.
Hays, R. T., and M. J. Singer. 1989. “Simulation fidelity as an organizing concept.” In Simulation fidelity in training system design, 47–75. New York: Springer.
He, H., and E. A. Garcia. 2009. “Learning from imbalanced data.” IEEE Trans. Knowl. Data Eng. 21 (9): 1263–1284. https://doi.org/10.1109/TKDE.2008.239.
Herrington, A., and J. Herrington. 2006. “What is an authentic learning environment?” In Authentic learning environments in higher education, 1–14. Hershey, PA: IGI Global.
Herrington, H. and A. Herrington. 2006. What is an authentic learning environment. Hershey, PA: IGI Global.
Herrington, J., and L. Kervin. 2007. “Authentic learning supported by technology: Ten suggestions and cases of integration in classrooms.” Educ. Media Int. 44 (3): 219–236. https://doi.org/10.1080/09523980701491666.
Herrington, J., T. C. Reeves, and R. Oliver. 2007. “Immersive learning technologies: Realism and online authentic learning.” J. Comput. Higher Educ. 19 (1): 80–99. https://doi.org/10.1007/BF03033421.
Ho, C. L., and R. J. Dzeng. 2010. “Construction safety training via e-Learning: Learning effectiveness and user satisfaction.” Comput. Educ. 55 (2): 858–867. https://doi.org/10.1016/j.compedu.2010.03.017.
Ho, T. K. 1995. “Random decision forests.” In Proc., 3rd Int. Conf. on Document Analysis and Recognition, 278–282. New York: IEEE.
Jaeger, M., and D. Adair. 2012. “Communication simulation in construction management education: Evaluating learning effectiveness.” Aust. J. Eng. Educ. 18 (1): 1–14. https://doi.org/10.7158/D11-133.2012.18.1.
James, G., D. Witten, T. Hastie, and R. Tibshirani. 2015. An introduction to statistical learning with applications in R. New York: Springer.
Jeelani, I., A. Albert, R. Azevedo, and E. J. Jaselskis. 2017. “Development and testing of a personalized hazard-recognition training intervention.” J. Constr. Eng. Manage. 143 (5): 040161201–0401612011. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001256.
Laamarti, F., M. Eid, and A. El Saddik. 2014. “An overview of serious games.” Int. J. Comput. Games Technol. 2014: 1. https://doi.org/10.1155/2014/358152.
Lancaster, R. J. 2014. “Serious game simulation as a teaching strategy in pharmacology.” Clin. Simul. Nursing 10 (3): 129–137. https://doi.org/10.1016/j.ecns.2013.10.005.
Lateef, F. 2010. “Simulation-based learning: Just like the real thing.” J. Emergencies Trauma Shock 3 (4): 348. https://doi.org/10.4103/0974-2700.70743.
Lave, J., and W. Etienne. 1991 Situated learning: Legitimate peripheral participation. Cambridge, UK: Cambridge Univ. Press.
Le, Q. T., A. Pedro, and C. S. Park. 2014. “A social virtual reality based construction safety education system for experiential learning.” J. Intell. Rob. Syst. 79 (3): 1–20. https://doi.org/10.1007/s10846-014-0112-z.
Le, Q. T., A. Pedro, and C. S. Park. 2015. “A social virtual reality based construction safety education system for experiential learning.” J. Intell. Rob. Syst. 79 (3–4): 487–506. https://doi.org/10.1007/s10846-014-0112-z.
Li, H., G. Chan, and M. Skitmore. 2012. “Visualizing safety assessment by integrating the use of game technology.” Autom. Constr. 22 (Mar): 498–505. https://doi.org/10.1016/j.autcon.2011.11.009.
Lin, K.-Y., J. W. Son, and E. M. Rojas. 2011. “A pilot study of a 3D game environment for construction safety education.” J. Inf. Technol. Constr. (ITcon) 16 (5): 69–84.
Loosemore, M., and N. Andonakis. 2007. “Barriers to implementing OHS reforms—The experiences of small subcontractors in the Australian Construction Industry.” Int. J. Project Manage. 25 (6): 579–588. https://doi.org/10.1016/j.ijproman.2007.01.015.
Michael Toole, P. E. 2005. “Increasing engineer’s role in construction safety—Opportunities and barriers.” J. Prof. Issues Eng. Educ. Pract. 131 (3): 199–207. https://doi.org/10.1061/(ASCE)1052-3928(2005)131:3(199).
Mitgutsch, K., and N. Alvarado. 2012. “Purposeful by design?: A serious game design assessment framework.” In Proc., Int. Conf. on the Foundations of Digital Games, 121–128. New York: Association for Computing Machinery.
Mouaheb, H., A. Fahli, M. Moussetad, and S. Eljamali. 2012. “The serious game: What educational benefits?” Procedia-Soc. Behav. Sci. 46 (Jan): 5502–5508. https://doi.org/10.1016/j.sbspro.2012.06.465.
Nakai, A., Y. Kaihata, and K. Suzuki. 2014. “The experience-based safety training system using VR technology for chemical plant.” Editorial Preface 5 (11): 63–67.
Olson, R., A. Varga, A. Cannon, J. Jones, I. Gilbert-Jones, and E. Zoller. 2016. “Toolbox talks to prevent construction fatalities: Empirical development and evaluation.” Saf. Sci. 86 (Jul): 122–131. https://doi.org/10.1016/j.ssci.2016.02.009.
Parr, T., K. Turgutlu, C. Csiszar, and J. Howard. 2018. “Beware default random forest importances.” Accessed March 20, 2019. https://explained.ai/rf-importance/.
Pedro, A., Q. T. Le, and C. S. Park. 2016. “Framework for integrating safety into construction methods education through interactive virtual reality.” J. Prof. Issues Eng. Educ. Pract. 142 (2): 04015011. https://doi.org/10.1061/(ASCE)EI.1943-5541.0000261.
Petraglia, J. 1998. “The real world on a short leash: The (mis) application of constructivism to the design of educational technology.” Educ. Technol. Res. Dev. 46 (3): 53–65. https://doi.org/10.1007/BF02299761.
Poh, C. Q. X., C. U. Ubeynarayana, and Y. M. Goh. 2018. “Safety leading indicators for construction sites: A machine learning approach.” Autom. Constr. 93 (Sep): 375–386. https://doi.org/10.1016/j.autcon.2018.03.022.
Qian, M., and K. R. Clark. 2016. “Game-based learning and 21st century skills: A review of recent research.” Comput. Hum. Behav. 63 (Oct): 50–58. https://doi.org/10.1016/j.chb.2016.05.023.
Reddy, K., P. Ankiewicz, and A. De Swardt. 2005. “Learning theories: A conceptual framework for learning and instruction in technology education.” S. Afr. J. Higher Educ. 19 (3): 14–34. https://doi.org/10.4314/sajhe.v19i3.25502.
Rooney, P. 2012. “A theoretical framework for serious game design.” Int. J. Game-Based Learn. 2 (4): 41–60. https://doi.org/10.4018/ijgbl.2012100103.
Sacks, R., A. Perlman, and R. Barak. 2013. “Construction safety training using immersive virtual reality.” Constr. Manage. Econ. 31 (9): 1005–1017. https://doi.org/10.1080/01446193.2013.828844.
Sarkar, D., R. Bali, and T. Sharma. 2018. “Building, tuning, and deploying models.” In Practical machine learning with python: A problem-solver’s guide to building real-world intelligent systems, 255–304. Berkeley, CA: Apress.
Sauve, L., L. Renaund, and D. Kaufman. 2010. “Games, simulations, and simulations games for learning: Definitions and directions in educational game play and simulation environments.” In Educational gameplay and simulation environments: Case studies and lessons learned, 1–26. Hershey, PA: IGI Global.
Suttie, N., S. Louchart, T. Lim, A. Macvean, W. Westera, D. Brown, and D. Djaouti. 2012. “Introducing the ‘serious games mechanics’ a theoretical framework to analyse relationships between ‘game’ and ‘pedagogical aspects’ of serious games.” Procedia Comput. Sci. 15 (Jan): 314–315. https://doi.org/10.1016/j.procs.2012.10.091.
Swanson, M. A., and D. Ornelas. 2001. “Health Jeopardy: A game to market school health services.” J. School Nurs. 17 (3): 166–169.
Takala, J., et al. 2014. “Global estimates of the burden of injury and illness at work in 2012.” J. Occup. Environ. Hyg. 11 (5): 326–337. https://doi.org/10.1080/15459624.2013.863131.
Vinodkumar, M. N., and M. Bhasi. 2009. “Safety climate factors and its relationship with accidents and personal attributes in the chemical industry.” Saf. Sci. 47 (5): 659–667. https://doi.org/10.1016/j.ssci.2008.09.004.
Yu, C., J.-Y. Wu, and A. Johnson. 2012. “Serious games: Issues and challenges for teaching and training.” In Handbook of research on serious games as educational, business and research tools, 559–577. Hershey, PA: IGI Global.
Zhao, D., and Y. Ye. 2012. “Using virtual environments simulation to improve construction safety: An application of 3d online-game based training.” In Future control and automation, 26–277. Berlin: Springer.
Zhou, Z., Y. M. Goh, and Q. Li. 2015. “Overview and analysis of safety management studies in the construction industry.” Saf. Sci. 72 (Feb): 337–350. https://doi.org/10.1016/j.ssci.2014.10.006.
Information & Authors
Information
Published In
Journal of Construction Engineering and Management
Volume 146 • Issue 3 • March 2020
Copyright
©2020 American Society of Civil Engineers.
History
Received: Mar 20, 2019
Accepted: Aug 8, 2019
Published online: Jan 2, 2020
Published in print: Mar 1, 2020
Discussion open until: Jun 2, 2020
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.