Development of a Design Quality Indicators Toolkit for Campus Facilities Using the Delphi Approach
Publication: Journal of Architectural Engineering
Volume 28, Issue 2
Abstract
The lack of standardized design quality indicators (DQIs) has hindered the proliferation of Post-Occupancy Evaluations (POEs) as a standard process in the property sector. This research aims to develop a standardized set of DQIs and further propose a DQI toolkit to facilitate its implementation. This research will use an in-depth review of the extant literature and will consult campus facility maintenance records at a case study university. Therefore, the identified DQIs will be consolidated and formulated to be representative of various campus facilities that include academic, research, and residential buildings. Subsequently, the DQIs will be standardized through three rounds of a Delphi survey, where 23 professionals will participate in the first round, and 19 and 18 will participate in the second and third rounds, respectively. The results of the Delphi survey will be analyzed based on the Relative Importance Index (RII), where an RII of 3.0 will be used to determine the experts’ agreement on the DQI’s significance. Finally, the standardized DQIs will be presented in the form of a survey toolkit. The implication of this research is to fulfill the need for standardized forms of POEs in the property sector and to enhance the design quality of campus facilities that are required by the higher-education sector. The value of the proposed toolkit is characterized by the ease of use, comparison between various facilities, inclusion in the procurement process for contractors, and promoting the designer’s review as a standard process in the delivery of facilities.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or codes that support the findings of this study are available from the corresponding author upon reasonable request.
Acknowledgments
The authors acknowledge the support provided by the Deanship of Scientific Research at King Fahd University of Petroleum and Minerals for funding this work through Project No. SB191051.
References
Abbaszadeh, S., L. Zagreus, D. Lehrer, and C. Huizenga. 2006. “Occupant satisfaction with indoor environmental quality in green buildings.” In Vol. 3 of Proc., 8th Int. Conf. and Exhibition on Healthy Buildings, 365–370. Lisbon, Portugal: International Society of Indoor Air Quality and Climate.
Abend, A., S. W. Ornstein, E. Baltas, J. de la Garza, C. Watson, K. Lange, and H. von Ahlefeld. 2006. Evaluating quality in educational facilities. Paris: PEB Exchange, Programme on Educational Building, OECD Publishing.
Abisuga, A. O., C. C. Wang, and R. Y. Sunindijo. 2019. “A holistic framework with user-centred facilities performance attributes for evaluating higher education buildings.” Facilities 38 (1/2): 132–160. https://doi.org/10.1108/F-07-2018-0083.
Akins, R. B., H. Tolson, and B. R. Cole. 2005. “Stability of response characteristics of a Delphi panel: Application of bootstrap data expansion.” BMC Med. Res. Method. 5 (1): 37. https://doi.org/10.1186/1471-2288-5-37.
Alborz, N., and U. Berardi. 2015. “A post occupancy evaluation framework for LEED certified U.S. higher education residence halls.” Procedia Eng. 118: 19–27. https://doi.org/10.1016/j.proeng.2015.08.399.
Amole, D. 2009. “Residential satisfaction in students’ housing.” J. Environ. Psychol. 29 (1): 76–85. https://doi.org/10.1016/j.jenvp.2008.05.006.
Anderson, A., A. Cheung, and M. Lei. 2014. Evaluation of Hong Kong’s indoor air quality management programme: Certification scheme, objectives, and technology. Report. Worcester, MA: Worcester Polytechnic Institute.
Arthur, C., T. Levett-Jones, and A. Kable. 2013. “Quality indicators for the design and implementation of simulation experiences: A Delphi study.” Nurse Educ. Today 33 (11): 1357–1361. https://doi.org/10.1016/j.nedt.2012.07.012.
ASHRAE (American Society of Heating, Refrigerating and Air-conditioning Engineers). 2004. Thermal environmental conditions for human occupancy. ASHRAE 55-2004. Atlanta: ASHRAE.
ASHRAE (American Society of Heating, Refrigerating and Air-conditioning Engineers). 2004. Ventilation for acceptable indoor air quality. ASHRAE 62.1-2004. Atlanta: ASHRAE.
AUDE (Association of University Directors of Estates). 2006. Guide to post occupancy evaluation. London: AUDE and the Univ. of Westminster.
Baird, G., N. Isaacs, D. Kernohan, and G. McIndoe. 1996. Building evaluation techniques. New York: McGraw-Hill. Professional Publishing.
Beatham, S., C. Anumba, T. Thorpe, and I. Hedges. 2004. “KPIs: A critical appraisal of their use in construction.” Benchmarking 11 (1): 93–117. https://doi.org/10.1108/14635770410520320.
Blyth, A., A. Gilby, and M. Barlex. 2006. Guide to post occupancy evaluation. Bristol, UK: Higher Education Funding Council for England (HEFCE), Univ. of Westminster.
Boulkedid, R., H. Abdoul, M. Loustau, O. Sibony, and C. Alberti. 2011. “Using and reporting the Delphi method for selecting healthcare quality indicators: A systematic review.” PLoS One 6 (6): e20476. https://doi.org/10.1371/journal.pone.0020476.
Brown, S. K. 1997. Indoor air quality. Canberra, Australia: Environment Australia.
Dall, G. 2013. Green energy audit of buildings, a guide for a sustainable energy audit of buildings. London: Springer.
Fatoye, E. O., and K. T. Odusami. 2009. “Occupants’ satisfaction approach to housing performance evaluation: The case of Nigeria.” In Vol. 10 of Proc., RICS COBRA Research Con., 1–10. Cape Town, South Africa: Univ. of Cape Town, Royal Institute of Chartered Surveyors.
Forbes, L. H., and S. M. Ahmed. 2010. Modern construction: Lean project delivery and integrated practices. New York: CRC Press, Taylor and Francis Group.
Frontczak, M., S. Schiavon, J. Goins, E. Arens, H. Zhang, and P. Wargocki. 2012. “Quantitative relationships between occupant satisfaction and satisfaction aspects of indoor environmental quality and building design.” Indoor Air 22 (2): 119–131. https://doi.org/10.1111/j.1600-0668.2011.00745.x.
Gou, Z., S. S.-Y. Lau, and Z. Zhang. 2012. “A comparison of indoor environmental satisfaction between two green buildings and a conventional building in China.” J. Green Build. 7 (2): 89–104. https://doi.org/10.3992/jgb.7.2.89.
Grisham, T. 2009. “The Delphi technique: A method for testing complex and multifaceted topics.” Int. J. Manag. Proj. Bus. 2 (1): 112–130. https://doi.org/10.1108/17538370910930545.
Hartkopf, V. H., V. E. Loftness, and P. A. Mill. 1986. “The concept of total building performance and building diagnostics.” In Building performance: Function, preservation, and rehabilitation, ASTM STP 901, edited by G. Davis, 5–22. Philadelphia, PA: American Society for Testing and Materials.
Hassanain, M. A. 2008. “On the performance evaluation of sustainable student housing facilities.” J. Facil. Manage. 6 (3): 212–225. https://doi.org/10.1108/14725960810885989.
Hassanain, M. A., M. O. Sanni-Anibire, A. S. Mahmoud, and W. Ahmed. 2019. “Post-occupancy evaluation of research and academic laboratory facilities.” Int. J. Build. Pathol. Adapt. 38 (5): 797–810. https://doi.org/10.1108/IJBPA-12-2018-0097.
Hassanain, M. A., A. Sedky, Z. A. Adamu, and A.-W. Saif. 2010. “A framework for quality evaluation of university housing facilities.” J. Build. Appraisal 5 (3): 213–221. https://doi.org/10.1057/jba.2009.15.
Hershberger, R. G. 2011. Programming. New York: American Institute of Architects.
Holt, G. D. 2014. “Asking questions, analysing answers: Relative importance revisited.” Constr. Innovation 14 (1): 2–16. https://doi.org/10.1108/CI-06-2012-0035.
Hoyle, D. 2018. ISO 9000: Quality systems handbook. New York: Routledge.
Hwang, T., and J. T. Kim. 2011. “Effects of indoor lighting on occupants’ visual comfort and eye health in a green building.” Indoor Built Environ. 20 (1): 75–90. https://doi.org/10.1177/1420326X10392017.
Ibem, E. O. 2011. “Evaluation of public housing in Ogun State, Nigeria.” Ph.D. thesis, Dept. of Architecture, Covenant Univ.
IESNA (Illuminating Engineering Society of North America). 2000. The IESNA lighting handbook: Reference and application. 9th ed. New York: IESNA.
Ilesanmi, A. O. 2010. “Post-occupancy evaluation and residents’ satisfaction with public housing in Lagos, Nigeria.” J. Build. Appraisal 6 (2): 153–169. https://doi.org/10.1057/jba.2010.20.
Khalil, N., and A. H. Nawawi. 2008. “Performance analysis of government and public buildings via post occupancy evaluation.” Asian Soc. Sci. 4 (9): 103–112.
Khamidi, M. F., S. N. A. Wahab, and N. M. Zahari. 2013. “Post occupancy evaluation (POE) and indoor environmental quality (IEQ) assessment: A case study of Universiti Teknologi Petronas new academic complex.” J. Des. Built 6: 1–21.
Kim, S.-S., I.-H. Yang, M.-S. Yeo, and K.-W. Kim. 2005. “Development of a housing performance evaluation model for multi-family residential buildings in Korea.” Build. Environ. 40 (8): 1103–1116. https://doi.org/10.1016/j.buildenv.2004.09.014.
Lai, A. C. K., K. W. Mui, L. T. Wong, and L. Y. Law. 2009. “An evaluation model for indoor environmental quality (IEQ) acceptance in residential buildings.” Energy Build. 41 (9): 930–936. https://doi.org/10.1016/j.enbuild.2009.03.016.
Leaman, A. 2003. Post-occupancy evaluation, benchmarking sustainable building performance. London: RIBA Publication.
Leaman, A., and B. Bordass. 2007. “Are users more tolerant of ‘green’ buildings?” Build. Res. Inf. 35 (6): 662–673. https://doi.org/10.1080/09613210701529518.
Lee, Y. S., and D. A. Guerin. 2009. “Indoor environmental quality related to occupant satisfaction and performance in LEED-certified buildings.” Indoor Built Environ. 18 (4): 293–300. https://doi.org/10.1177/1420326X09105455.
Leifer, D. 1998. “Evaluating user satisfaction: Case studies in Australasia.” Facilities 16 (5/6): 138–142. https://doi.org/10.1108/02632779810211812.
Leitner, D. S., N. C. Sotsek, and A. D. P. L. Santos. 2020. “Postoccupancy evaluation in buildings: Systematic literature review.” J. Perform. Constr. Facil 34 (1): 03119002. https://doi.org/10.1061/(ASCE)CF.1943-5509.0001389.
Lesbirel, M. 2012. Post-occupancy surveys: Designing a survey for maximum return. Atlanta: Green Building Education Services.
Li, P., T. M. Froese, and G. Brager. 2018. “Post-occupancy evaluation: State-of-the-art analysis and state-of-the-practice review.” Build. Environ. 133: 187–202. https://doi.org/10.1016/j.buildenv.2018.02.024.
Lindsay, P., M. Schull, S. Bronskill, and G. Anderson. 2002. “The development of indicators to measure the quality of clinical care in emergency departments following a modified-Delphi approach.” Acad. Emergency Med. 9 (11): 1131–1139. https://doi.org/10.1197/aemj.9.11.1131.
Liu, A. M. M. 1999. “Residential satisfaction in housing estates: A Hong Kong perspective.” Autom. Constr. 8 (4): 511–524. https://doi.org/10.1016/S0926-5805(98)00098-3.
Mahmoud, A. S., M. O. Sanni-Anibire, M. A. Hassanain, and W. Ahmed. 2019. “Key performance indicators for the evaluation of academic and research laboratory facilities.” Int. J. Build. Pathol. Adapt. 37 (2): 208–230. https://doi.org/10.1108/IJBPA-08-2018-0066.
Manning, P. 1968. “Appraisals of building performance: Their use in the design process.” The Architect’s Journal, October 6, 1968.
Menzies, G. F., and J. R. Wherrett. 2005. “Windows in the workplace: Examining issues of environmental sustainability and occupant comfort in the selection of multi-glazed windows.” Energy Build. 37 (6): 623–630. https://doi.org/10.1016/j.enbuild.2004.09.012.
Moezzi, M., and J. Goins. 2010. “Using text analysis to listen to building users.” In Indoor Environmental Quality, Conf. Proc., Adapting to Change: New Thinking on Comfort, 1–15. Windsor, UK: Network for Comfort and Energy in Buildings.
Neuman, D. J. 2013. Building type basics for college and university facilities. Hoboken, NJ: Wiley.
Nooraei, M., J. R. Littlewood, and N. I. Evans. 2013. “Feedback from occupants in ‘as designed’ low-carbon apartments, a case study in Swansea, UK.” Energy Procedia 42: 446–455. https://doi.org/10.1016/j.egypro.2013.11.045.
Noraini, Y., N. Z. Abidin, and N. U. M. Najib. 2013. “Performance of housing maintenance in public housing.” J. Econ. Sustainable Dev. 4 (6): 156–163.
Preiser, W., and A. Hardy. 2015. “Historical review of building performance evaluation.” In Chap. 14 in Architecture beyond criticism: Expert judgment and performance evaluation, edited by W. F. E. Preiser, A. T. Davis, A. M. Salama, A. Hardy, 147–159. London: Routledge.
Preiser, W. F. 1982. Behavioral design criteria in student housing: The measurement of verbalized response to physical environment. Saint Paul, MN: Institute for Environmental Education.
Preiser, W. F. 1995. “Post-occupancy evaluation: How to make buildings work better.” Facilities 13 (11): 19–28. https://doi.org/10.1108/02632779510097787.
Preiser, W. F. E., A. T. Davis, and A. M. Salama. 2015. Architecture beyond criticism: Expert judgment and performance evaluation. Abingdon, UK: Routledge.
Preiser, W. F. E., H. Z. Rabinowitz, and E. T. White. 1988. Post-occupancy evaluation. New York: Van Nostrand Reinhold.
Riley, M., N. Kokkarinen, and M. Pitt. 2010. “Assessing post occupancy evaluation in higher education facilities.” J. Facil. Manage. 8 (3): 202–213. https://doi.org/10.1108/14725961011058839.
Sanni-Anibire, M. O. 2015. “A holistic framework for the post occupancy evaluation of campus residential housing facilities–case study of Al-Marooj courts at KFUPM.” Master thesis, Dept. of Architectural Engineering, King Fahd Univ. of Petroleum and Minerals.
Sanni-Anibire, M. O., and M. A. Hassanain. 2016. “Quality assessment of student housing facilities through post-occupancy evaluation.” Archit. Eng. Des. Manage. 12 (5): 367–380. https://doi.org/10.1080/17452007.2016.1176553.
Sanni-Anibire, M. O., M. A. Hassanain, and A. M. Al-Hammad. 2016a. “Post-occupancy evaluation of housing facilities: Overview and summary of methods.” J. Perform. Constr. Facil 30 (5): 04016009. https://doi.org/10.1061/(ASCE)CF.1943-5509.0000868.
Sanni-Anibire, M. O., M. A. Hassanain, and A. M. Al-Hammad. 2016b. “Holistic postoccupancy evaluation framework for campus residential housing facilities.” J. Perform. Constr. Facil 30 (5): 04016026. https://doi.org/10.1061/(ASCE)CF.1943-5509.0000875.
Sanoff, H. 1968. Evaluation techniques for designers. Raleigh, NC: North Carolina State Univ.
Shawahna, R. 2020. “Quality indicators of pharmaceutical care for integrative healthcare: A scoping review of indicators developed using the Delphi technique.” Evid. Based Complement. Alternat. Med. 2020:9131850.
Sylvester, I., A. Margaret, A. Emmanuel, and U. Daniel. 2014. “Residential housing satisfaction of the urban poor in Calabar Metropolis, Nigeria.” Archit. Res. 4: 1–8.
Temple, P. 2014. The physical university: Contours of space and place in higher education. New York: Routledge.
Turpin-Brooks, S., and G. Viccars. 2006. “The development of robust methods of post occupancy evaluation.” Facilities 24 (5/6): 177–196. https://doi.org/10.1108/02632770610665775.
Ukoha, O. M., and J. O. Beamish. 1997. “Assessment of residents’ satisfaction with public housing in Abuja, Nigeria.” Habitat Int. 21 (4): 445–460. https://doi.org/10.1016/S0197-3975(97)00017-9.
Van der Ryn, S., and M. Silverstein. 1967. Dorms at Berkeley: An environmental analysis. Los Angeles: Center for Planning and Development Research, Univ. of California.
Van Mossel, H. J., and S. J. Jansen. 2010. “Maintenance services in social housing: What do residents find important?” Struct. Surv. 28 (3): 215–229. https://doi.org/10.1108/02630801011058942.
Vuk, T. 2012. “Quality indicators: A tool for quality monitoring and improvement.” ISBT Sci. Ser.s 7 (1): 24–28. https://doi.org/10.1111/j.1751-2824.2012.01584.x.
Xu, X., R. Y. Sunindijo, and E. Mussi. 2020. “Comparing user satisfaction of older and newer on-campus accommodation buildings in Australia.” Facilities 39 (5–6): 389–410. https://doi.org/10.1108/F-11-2018-0133.
Zengel, R., and I. S. Kaya. 2011. “A post occupancy evaluation of shared circulation spaces of the faculty of arts and sciences of Dokuz Eylul University.” Int. J. Archit. Res. 5 (3): 58–80.
Zimmerman, A., and M. Martin. 2001. “Post-occupancy evaluation: Benefits and barriers.” Build. Res. Inf. 29 (2): 168–174. https://doi.org/10.1080/09613210010016857.
Information & Authors
Information
Published In
Journal of Architectural Engineering
Volume 28 • Issue 2 • June 2022
Copyright
© 2022 American Society of Civil Engineers.
History
Received: Nov 18, 2020
Accepted: Dec 28, 2021
Published online: Feb 23, 2022
Published in print: Jun 1, 2022
Discussion open until: Jul 23, 2022
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited by
- Ricardo Martín, Víctor Yepes, Assessing the Relationship between Landscape and Management within Marinas: The Managers’ Perception, Land, 10.3390/land11070961, 11, 7, (961), (2022).
- Muizz Oladapo Sanni-Anibire, Yusuf A. Adenle, Residential satisfaction of vertical urban settlements in Hong Kong, Journal of Engineering, Design and Technology, 10.1108/JEDT-06-2022-0323, (2022).
- Mohammad A. Hassanain, Omar H. Daghistani, Muizz O. Sanni-Anibire, Development of design quality indicators for public school facilities, Facilities, 10.1108/F-09-2021-0084, 40, 9/10, (594-616), (2022).