Usability Evaluation of a Web-Based Platform for Connecting Professional and Educational Communities: Instructors’ Perspective
Publication: Construction Research Congress 2024
ABSTRACT
Equitable access to communities of practice for future workforce development has been challenging for construction education instructors. This has been identified as one of the triggers of deficiencies and disparities in the skills and competence of new construction engineering graduates and consequently, dissatisfaction of employers. To address this challenge, a web-based collaborative platform was designed and developed to integrate both communities. This study presents a usability evaluation of the web-based platform from instructors’ perspective using quantitative and qualitative analyses. The results from semi-structured interview, ratings of system usability scale, and trust scale were used to infer users’ acceptance of the platform. The results reveal high acceptance of the platform by end users as a tool to connect with practitioners for workforce development collaborations. The results also show required improvements to enhance users’ experience. The study provides a guide for the usability evaluation of similar matching platforms.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Abuhlfaia, K., and Quincey, E. (2018). “The Usability of E-learning Platforms in Higher Education: A Systematic Mapping Study”. Proceedings of the 32nd International BCS Human Computer Interaction Conference (HCI), BCS L & D Ltd, Belfast, UK. 1–13.
Ahmad, N. A. N., Hamid, N. I. M., and Lokman, A. M. (2021). “Performing Usability Evaluation on Multi-Platform Based Application for Efficiency Effectiveness and Satisfaction Enhancement”. International Journal of Interactive Mobile Technologies, (15)10, 103–117.
Ahmad, N. A. N., and Sazali, P. N. N. A. M. (2021). “Performing User Acceptance Test with System Usability Scale for Graduation Application”. In 2021 International Conference on Software Engineering & Computer Systems (ICSECS-ICOCSIM). IEEE, 86–91.
Bangor, A., Kortum, P., and Miller, J. (2009). “Determining what individual SUS scores mean: Adding an adjective rating scale”. Journal of usability studies, 4(3), 114–123.
Barnum, C. M. (2011). Usability Testing Essentials. Morgan Kaufmann, Elsevier Inc.
Bart, I. Y., Shankar, V., Sultan, F., and Urban, G. L. (2005). “Are the drivers and role of online trust the same for all web sites and consumers? A large scale exploratory empirical study”. Journal of Marketing, 69(4), 133–152.
Beldad, A., de Jong, M., and Steehouder, M. (2010). “How shall I trust the faceless and the intangible? A literature review on the antecedents of online trust”. Computers in Human Behavior, 26(5), 857–869.
Brooke, J. (1996). “SUS-A quick and dirty usability scale”. Usability evaluation in industry, 189(194), 4–7.
Chandrasekaran, S., Littlefair, G., and Stojcevski, A. (2015). “Staff and Students Views on Industry University Collaboration in Engineering”. International Journal of Advanced Corporate Learning, 8(2), 13–19.
Creswell, J. W. (2013). Qualitative inquiry and research design: choosing among five approaches, 3rd edition. SAGE Publications, Inc., United States of America.
Christo-Baker, E. A., Sindone, A., and Roper, C. (2017). “Addressing the skills gap: A regional Analysis”. The Journal of Applied Business and Economics, 19(8), 10–21.
Davis, F. D. (1993). “User acceptance of information technology: system characteristics, user perceptions and behavioural impacts”. Int. Journal of Man-Machine Studies, 38(3), 475–487.
Gonzalez-Holland, E., Whitmer, D., Moralez, L., and Mouloua, M. (2017). Examination of the use of Nielsen’s 10 usability heuristics & outlooks for the future. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting. Sage, Los Angeles, CA, 1472–1475.
Gould, J. D., and Lewis, C. (1985). “Designing for usability: key principles and what designers think”. Communications of the ACM, 28(3), 300–311.
Harrati, N., Bouchrika, I., Tari, A., and Ladjailia, A. (2016). “Exploring user satisfaction for e-learning systems via usage-based metrics and system usability scale analysis”. Computers in Human Behavior, 61, 463–471.
Hartson, R., and Pyla, P. S. (2012). The UX Book: Process and guidelines for ensuring a quality user experience. Elsevier.
Hwang, W., and Salvendy, G. (2010). “Number of people required for usability evaluation: the 10±2 rule”. Communications of the ACM, 53(5), 130–133.
Jacobs, F., Cain, W., Lu, R., and Daugherty, A. (2022). “Case Study: Teaching with Industry (TWI) Using New Videoconferencing Technology and Innovative Classroom Setups”. Education Sciences, 12(2), 1–18.
Jeffries, R., Miller, J. R., Wharton, C., and Uyeda, K. M. (1991). “User interface evaluation in the real world: a comparison of four techniques”. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, New York, 119–124.
Jian, J. Y., Bisantz, A. M., and Drury, C. G. (2000). “Foundations for an empirically determined scale of trust in automated systems”. Int. Journal of Cognitive Ergonomics, 4(1), 53–71.
Kohn, S. C., Visser, E. J., Wiese1, E., Lee, Y. C., and Shaw, T. H. (2021). “Measurement of Trust in Automation: A Narrative Review and Reference Guide”. Frontiers in Psychology, 12, 1–23.
Lu, R., and Jacobs, F. (2022). “An Innovative Teaching Model: Involvement of Industry Practitioners in the Teaching of Construction Management Curriculum”. In 2022 ASEE Annual Conference & Exposition. <https://peer.asee.org/40578>. (Feb. 01, 2023).
Nielsen J. (1994). “10 Usability Heuristics for User Interface Design”. <https://www.nngroup.com/articles/ten-usability-heuristics/>. (April 23, 2023).
Rizvi, I. A., and Aggarwal, A. (2005, January). “Enhancing student employability: Higher education and workforce development”. In Proceedings of the 9th Quality in Higher Education Seminar, Birmingham, UK. Retrieved from <https://www.qualityresearchinternational.com/esecttools/eseconferencepapers/aggarwal.doc>. (Feb. 08, 2023).
Saldaña, J. (2009). The Coding Manual for Qualitative Researchers, Sage.
Sharp, W. H., Jackson, K. M., and Shaw, T. H. (2023). “The frequency of positive and negative interactions influences relationship equity and trust in automation”. Applied Ergonomics, 108. https://10.1016/j.apergo.2022.103961.
Sultan, F., Urban, G., Shankar, V., and Bart, I. (2003). “Determinants and role of trust in e-business: a large-scale empirical study”. Massachusetts Institute of Technology (MIT), Sloan School of Management. Working Paper: 4282-02. 1–44.
Tan, W., Liu, D., and Bishu, R. (2009). “Web evaluation: Heuristic evaluation vs. user testing”. Int. Journal of Industrial Ergonomics, 39(4), 621–627.
Vlachogianni, P., and Tselios, N. (2022). “Perceived usability evaluation of educational technology using the System Usability Scale (SUS): A systematic review”. Journal of Research on Technology in Education, 54(3), 392–409.
Urban, G. L., Sultan, F., and Qualls, W. (2000). “Placing Trust at the Center of Your Internet Strategy,” Sloan Management Review, 42(1), 39–48.
Information & Authors
Information
Published In
Construction Research Congress 2024
Pages: 293 - 303
History
Published online: Mar 18, 2024
ASCE Technical Topics:
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.