Supplier Performance Evaluation in Construction Projects: Challenges and Possible Solutions
Publication: Journal of Construction Engineering and Management
Volume 145, Issue 4
Abstract
Supplier performance analysis can enlighten a construction company about improvement possibilities for better project outcomes. However, for systematic evaluation of a supplier across projects, changing the operating environment between projects should be addressed. Therefore, we first elaborate how supplier evaluation is challenged due to differences between projects in three characteristic groups: project product and location characteristics, project organization characteristics, and buyer–supplier transaction characteristics. We next discuss the possibility of applying data envelopment analysis (DEA) for supplier evaluation in construction, and argue how changing the operating environment can lead to nonhomogenous decision-making units in DEA. Building on these, we propose the process for supplier evaluation in the presence of a changing operating environment and different input–output profiles. Characteristics of 12 projects and supplier evaluations in 44 projects are used to illustrate evaluation challenges. The research extends current knowledge on supplier evaluation in construction by underlining how changing the operating environment across projects challenges systematic performance evaluation and by suggesting the process which further research could develop toward practical applications.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Data generated or analyzed during the study are available from the corresponding author by request. Information about the Journal’s data-sharing policy can be found here: http://ascelibrary.org/doi/10.1061/(ASCE)CO.1943-7862.0001263.
Acknowledgments
The authors thank the journal’s editor and the two anonymous reviewers for their valuable and constructive comments. The first author would also like to thank Mahdi Mahdiloo and Hylton Olivieri for the helpful discussions and remarks.
References
AIA (American Institute of Architects). 2014. “Integrated project delivery: An updated working definition.” California Council. Accessed January 7, 2018. http://www.aiacc.org/wp-content/uploads/2014/07/AIACC_IPD.pdf.
Aggelopoulos, E., and A. Georgopoulos. 2017. “Bank branch efficiency under environmental change: A bootstrap DEA on monthly profit and loss accounting statements of Greek retail branches.” Eur. J. Oper. Res. 261 (3): 1170–1188. https://doi.org/10.1016/j.ejor.2017.03.009.
Akinsola, A. O., K. F. Potts, I. Ndekugri, and F. C. Harris. 1997. “Identification and evaluation of factors influencing variations on building projects.” Int. J. Project Manage. 15 (4): 263–267. https://doi.org/10.1016/S0263-7863(96)00081-6.
Anderson, E., and S. D. Jap. 2005. “The dark side of close relationships.” MIT Sloan Manage. Rev. 46 (3): 75–82.
Aretoulis, G. N., G. P. Kalfakakou, and F. Z. Striagka. 2010. “Construction material supplier selection under multiple criteria.” Oper. Res. 10 (2): 209–230. https://doi.org/10.1007/s12351-009-0065-3.
Avkiran, N. K. 2009. “Removing the impact of environment with units-invariant efficient frontier analysis: An illustrative case study with intertemporal panel data.” Omega 37 (3): 535–544. https://doi.org/10.1016/j.omega.2007.10.002.
Azambuja, M., and W. O’Brien. 2009. “Construction supply chain modeling: Issues and perspectives.” In Construction supply chain management handbook, edited by W. O’Brien, C. T. Formoso, R. Vrijhoef, and K. A. London. New York: Taylor and Francis.
Baiden, B. K., A. D. F. Price, and A. R. J. Dainty. 2006. “The extent of team integration within construction projects.” Int. J. Project Manage. 24 (1): 13–23. https://doi.org/10.1016/j.ijproman.2005.05.001.
Banker, R. D., A. Charnes, and W. W. Cooper. 1984. “Some models for estimating technical and scale inefficiencies in data envelopment analysis.” Manage. Sci. 30 (9): 1078–1092. https://doi.org/10.1287/mnsc.30.9.1078.
Banker, R. D., and R. C. Morey. 1986. “Efficiency analysis for exogenously fixed inputs and outputs.” Oper. Res. 34 (4): 513–521. https://doi.org/10.1287/opre.34.4.513.
Belassi, W., and O. I. Tukel. 1996. “A new framework for determining critical success/failure factors in projects.” Int. J. Project Manage. 14 (3): 141–151. https://doi.org/10.1016/0263-7863(95)00064-X.
Bendoly, E., R. Croson, P. Goncalves, and K. Schultz. 2010. “Bodies of knowledge for research in behavioral operations.” Prod. Oper. Manage. 19 (4): 434–452. https://doi.org/10.1111/j.1937-5956.2009.01108.x.
Bildsten, L. 2014. “Buyer-supplier relationships in industrialized building Buyer-supplier relationships in industrialized building.” Constr. Manage. Econ. 32 (1–2): 146–159. https://doi.org/10.1080/01446193.2013.812228.
Brown, D. C., M. J. Ashleigh, M. J. Riley, and R. D. Shaw. 2001. “New project procurement process.” J. Manage. Eng. 17 (4): 192–201. https://doi.org/10.1061/(ASCE)0742-597X(2001)17:4(192).
Carr, A. S., and J. N. Pearson. 1999. “Strategically managed buyer-seller relationships and performance outcomes.” J. Oper. Manage. 17 (5): 497–519. https://doi.org/10.1016/S0272-6963(99)00007-8.
Chan, A. P. C., D. Scott, and A. P. L. Chan. 2004. “Factors affecting the success of a construction project.” J. Constr. Eng. Manage. 130 (1): 153–155. https://doi.org/10.1061/(ASCE)0733-9364(2004)130:1(153).
Chapman, C., and S. Ward 2003. Project risk management: Processes, techniques and insights. 2nd ed. London: Wiley.
Charnes, A., W. W. Cooper, and E. Rhodes. 1978. “Measuring the efficiency of decision making units.” Eur. J. Oper. Res. 2 (6): 429–444. https://doi.org/10.1016/0377-2217(78)90138-8.
Coelli, T. J., P. Rao, C. J. O’Donnell, and G. E. Battese 2005. An introduction to efficiency and productivity analysis. 2nd ed. New York: Springer.
Cohen, J. 2010. “Integrated project delivery: Case studies.” Accessed January 7, 2018. https://www.ipda.ca/site/assets/files/1111/aia-2010-ipd-case-studies.pdf.
Cook, W. D., J. Harrison, R. Imanirad, P. Rouse, and J. Zhu. 2013. “Data envelopment analysis with nonhomogeneous DMUs.” Oper. Res. 61 (3): 666–676. https://doi.org/10.1287/opre.2013.1173.
Cook, W. D., K. Tone, and J. Zhu. 2014. “Data envelopment analysis: Prior to choosing a model.” Omega 44: 1–4. https://doi.org/10.1016/j.omega.2013.09.004.
Dell’Isola, M. D. 2002. “Impact of delivery systems on cost management.” AACE Int. Trans. PM31–PM36.
Deng, F., and H. Smyth. 2013. “Nature of firm performance in construction.” J. Constr. Eng. Manage. 140 (2): 1–14. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000778.
Eccles, R. G. 1981. “The quasifirm in the construction industry.” J. Econ. Behav. Organ. 2 (4): 335–357. https://doi.org/10.1016/0167-2681(81)90013-5.
Egan, J. 1998. Rethinking construction, The report of the construction task force to the deputy prime minister. London: Dept. of the Environment, Transport and the Region.
El-Mashaleh, M. S., S. M. Rababeh, and K. H. Hyari. 2010. “Utilizing data envelopment analysis to benchmark safety performance of construction contractors.” Int. J. Project Manage. 28 (1): 61–67. https://doi.org/10.1016/j.ijproman.2009.04.002.
El-Sayegh, M. S. 2009. “Multi-criteria decision support model for selecting the appropriate construction management at risk firm.” Constr. Manage. Econ. 27 (4): 385–398. https://doi.org/10.1080/01446190902759009.
Eom, C. S. J., S. H. Yun, and J. H. Paek. 2008. “Subcontractor evaluation and management framework for strategic partnering.” J. Constr. Eng. Manage. 134 (11): 842–851. https://doi.org/10.1061/(ASCE)0733-9364(2008)134:11(842).
Eriksson, P. E. 2010. “Improving construction supply chain collaboration and performance: A lean construction pilot project.” Supply Chain Manage. Int. J. 15 (5): 394–403. https://doi.org/10.1108/13598541011068323.
Eriksson, P. E., and M. Westerberg. 2011. “Effects of cooperative procurement procedures on construction project performance: A conceptual framework.” Int. J. Project Manage. 29 (2): 197–208. https://doi.org/10.1016/j.ijproman.2010.01.003.
Farrell, M. J. 1957. “The measurement of productive efficiency.” J. R. Stat. Soc. 120 (3): 253–282.
Fearne, A., and N. Fowler. 2006. “Efficiency versus effectiveness in construction supply chains: The dangers of ‘lean’ thinking in isolation.” Supply Chain Manage. Int. J. 11 (4): 283–287. https://doi.org/10.1108/13598540610671725.
Fried, H. O., and C. A. K. Lovell. 1996. “Searching the zeds.” In Proc., II Georgia Productivity Workshop. Athens, GA.
Fried, H. O., C. A. K. Lovell, S. S. Schmidt, and S. Yaisawarng. 2002. “Accounting for environmental effects and statistical noise in data envelopment analysis.” J. Prod. Anal. 17 (1): 157–174. https://doi.org/10.1023/A:1013548723393.
Fried, H. O., S. S. Schmidt, and S. Yaisawarng. 1999. “Incorporating the operating environment into a nonparametric measure of technical efficiency.” J. Prod. Anal. 12 (3): 249–267. https://doi.org/10.1023/A:1007800306752.
Friedlander, M. C. 2015. “Seven legal issues unique to design-build.” Accessed January 17, 2018. http://www.schiffhardin.com/Templates/media/files/publications/PDF/construction_060515.pdf.
Gadde, L. E., and A. Dubois. 2010. “Partnering in the construction industry-problems and opportunities.” J. Purchasing Supply Manage. 16 (4): 254–263. https://doi.org/10.1016/j.pursup.2010.09.002.
Grandinetti, R. 2017. “Exploring the dark side of cooperative buyer-seller relationships.” J. Bus. Ind. Marketing 32 (2): 326–336. https://doi.org/10.1108/JBIM-04-2016-0066.
Haas, D. A., and F. H. Murphy. 2003. “Compensating for non-homogeneity in decision-making units in data envelopment analysis.” Eur. J. Oper. Res. 144 (3): 530–544. https://doi.org/10.1016/S0377-2217(02)00139-X.
Hale, D. R., P. P. Shrestha, G. E. Gibson, and G. C. Migliaccio. 2009. “Empirical comparison of design/build and design/bid/build project delivery methods.” J. Constr. Eng. Manage. 135 (7): 579–587. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000017.
Hanna, A. S. 2016. “Benchmark performance metrics for integrated project delivery.” J. Constr. Eng. Manage. 142 (9): 04016040. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001151.
Hatami-Marbini, A., P. J. Agrell, M. Tavana, and P. Khoshnevis. 2017. “A flexible cross-efficiency fuzzy data envelopment analysis model for sustainable sourcing.” J. Cleaner Prod. 142: 2761–2779. https://doi.org/10.1016/j.jclepro.2016.10.192.
Ho, W., X. Xu, and P. K. Dey. 2010. “Multi-criteria decision making approaches for supplier evaluation and selection: A literature review.” Eur. J. Oper. Res. 202 (1): 16–24. https://doi.org/10.1016/j.ejor.2009.05.009.
Horta, I. M., A. S. Camanho, J. Johnes, and G. Johnes. 2013. “Performance trends in the construction industry worldwide: An overview of the turn of the century.” J. Prod. Anal. 39 (1): 89–99. https://doi.org/10.1007/s11123-012-0276-0.
Hu, K., H. Rahmandad, T. Smith-Jackson, and W. Winchester. 2011. “Factors influencing the risk of falls in the construction industry: A review of the evidence.” Constr. Manage. Econ. 29 (4): 397–416. https://doi.org/10.1080/01446193.2011.558104.
Hu, X., and C. Liu. 2016. “Profitability performance assessment in the Australian construction industry: A global relational two-stage DEA method.” Constr. Manage. Econ. 34 (3): 147–159. https://doi.org/10.1080/01446193.2016.1180415.
Huguenin, J. 2015. “Adjusting for the environment in DEA: A comparison of alternative models based on empirical data.” Socio-Econ. Plann. Sci. 52: 41–54. https://doi.org/10.1016/j.seps.2015.10.004.
Ibbs, C. W., Y. Kwak, and A. Odabasi. 2003. “Project delivery system and project change: A quantitative analysis.” J. Constr. Eng. Manage. 129 (4): 382–387. https://doi.org/10.1061/(ASCE)0733-9364(2003)129:4(382).
Iyer, K. C., and P. S. Banerjee. 2016. “Measuring and benchmarking managerial efficiency of project execution schedule performance.” Int. J. Project Manage. 34 (2): 219–236. https://doi.org/10.1016/j.ijproman.2015.10.008.
Johnson, A. L., and T. Kuosmanen. 2011. “One-stage estimation of the effects of operational conditions and practices on productive performance: Asymptotically normal and efficient, root-n consistent StoNEZD method.” J. Prod. Anal. 36 (2): 219–230. https://doi.org/10.1007/s11123-011-0231-5.
Johnson, A. L., and J. Ruggiero. 2014. “Nonparametric measurement of productivity and efficiency in education.” Ann. Oper. Res. 221 (1): 197–210. https://doi.org/10.1007/s10479-011-0880-9.
Kahneman, D. 2011. Thinking, fast and slow. New York: Farrar, Straus and Giroux.
Kaming, P. F., P. O. Olomolaiye, G. D. Holt, and F. C. Harris. 1997. “Factors influencing construction time and cost overruns on high-rise projects in Indonesia.” Constr. Manage. Econ. 15 (1): 83–94. https://doi.org/10.1080/014461997373132.
Kapelko, M., I. M. Horta, A. S. Camanho, and A. O. Lansink. 2015. “Measurement of input-specific productivity growth with an application to the construction industry in Spain and Portugal.” Int. J. Prod. Econ. 166: 64–71. https://doi.org/10.1016/j.ijpe.2015.03.030.
Karim, K., M. Marosszeky, and S. Davis. 2006. “Managing subcontractor supply chain for quality in construction.” Eng. Constr. Archit. Manage. 13 (1): 27–42. https://doi.org/10.1108/09699980610646485.
Kärnä, S., and J. M. Junnonen. 2017. “Designers’ performance evaluation in construction projects.” Eng. Constr. Archit. Manage. 24 (1): 154–169. https://doi.org/10.1108/ECAM-06-2015-0101.
Kumar, A., V. Jain, and S. Kumar. 2014. “A comprehensive environment friendly approach for supplier selection.” Omega 42 (1): 109–123. https://doi.org/10.1016/j.omega.2013.04.003.
Kwak, Y. H., H. Sadatsafavi, J. Walewski, and N. L. Williams. 2015. “Evolution of project based organization: A case study.” Int. J. Project Manage. 33 (8): 1652–1664. https://doi.org/10.1016/j.ijproman.2015.05.004.
Lahdenperä, P. 2012. “Making sense of the multi-party contractual arrangements of project partnering, project alliancing and integrated project delivery.” Constr. Manage. Econ. 30 (1): 57–79. https://doi.org/10.1080/01446193.2011.648947.
Lampe, H. W., and D. Hilgers. 2015. “Trajectories of efficiency measurement: A bibliometric analysis of DEA and SFA.” Eur. J. Oper. Res. 240 (1): 1–21. https://doi.org/10.1016/j.ejor.2014.04.041.
Lavikka, R. H., R. Smeds, and M. Jaatinen. 2015. “Coordinating collaboration in contractually different complex construction projects.” Supply Chain Manage. Int. J. 20 (2): 205–217. https://doi.org/10.1108/SCM-10-2014-0331.
Li, W., L. Liang, W. D. Cook, and J. Zhu. 2016. “DEA models for non-homogeneous DMUs with different input configurations.” Eur. J. Oper. Res. 254 (3): 946–956. https://doi.org/10.1016/j.ejor.2016.04.063.
Liu, J., F. Y. Ding, and V. Lall. 2000. “Using data envelopment analysis to compare suppliers for supplier selection and performance improvement.” Supply Chain Manage. Int. J. 5 (3): 143–150. https://doi.org/10.1108/13598540010338893.
Love, P. E. D. 2002. “Influence of project type and procurement method on rework costs in building construction projects.” J. Constr. Eng. Manage. 128 (1): 18–29. https://doi.org/10.1061/(ASCE)0733-9364(2002)128:1(18).
Mahdiloo, M., R. F. Saen, and K. H. Lee. 2015. “Technical, environmental and eco-efficiency measurement for supplier selection: An extension and application of data envelopment analysis.” Int. J. Prod. Econ. 168: 279–289. https://doi.org/10.1016/j.ijpe.2015.07.010.
Mesa, H. A., K. R. Molenaar, and L. F. Alarcón. 2016. “Exploring performance of the integrated project delivery process on complex building projects.” Int. J. Project Manage. 34 (7): 1089–1101. https://doi.org/10.1016/j.ijproman.2016.05.007.
Min, H., and S. J. Joo. 2006. “Benchmarking the operational efficiency of third party logistics providers using data envelopment analysis.” Supply Chain Manage. Int. J. 11 (3): 259–265. https://doi.org/10.1108/13598540610662167.
Muñiz, M. A. 2002. “Separating managerial inefficiency and external conditions in data envelopment analysis.” Eur. J. Oper. Res. 143 (3): 625–643. https://doi.org/10.1016/S0377-2217(01)00344-7.
Narasimhan, R., S. Talluri, and D. Mendez. 2001. “Supplier evaluation and rationalization via data envelopment analysis: An empirical examination.” J. Supply Chain Manage. 37 (2): 28–37. https://doi.org/10.1111/j.1745-493X.2001.tb00103.x.
Noorizadeh, A., K. Rashidi, and A. Peltokorpi. 2018. “Categorizing suppliers for development investments in construction: Application of DEA and RFM concept.” Constr. Manage. Econ. 36 (9): 487–506. https://doi.org/10.1080/01446193.2017.1416151.
O’Brien, W. J., C. T. Formoso, R. Vrijhoef, and K. A. London. 2009. Construction supply chain management handbook. New York: Taylor and Francis.
Pabor, E. J., and R. Pennington. 2012. “The growth (and growing pains) of design-build construction.” Government Product News. Accessed January 4, 2018. http://americancityandcounty.com/contracts/growth-and-growing-pains-design-build-construction.
Peltokorpi, A., O. Seppänen, and A. Noorizadeh. 2016. “Project lifecycle approach to the perceived value of suppliers: A study of a Finnish contractor.” In Proc., 24th Annual Conf. of the International Group for Lean Construction, Section 8, 3–12. Boston: International Group for Lean Construction.
Pheng, L. S., and Q. T. Chuan. 2006. “Environmental factors and work performance of project managers in the construction industry.” Int. J. Project Manage. 24 (1): 24–37. https://doi.org/10.1016/j.ijproman.2005.06.001.
Ramanathan, R. 2003. An introduction to data envelopment analysis. New Delhi, India: Sage.
Ray, S. C., and L. Chen. 2015. “Data envelopment analysis for performance evaluation: A child’s guide.” In Chap. 2 of Benchmarking for performance evaluation: A production frontier approach, edited by S. C. Ray, S. C. Kumbhakar, and P. Dua, 75–116. New Delhi, India: Springer.
Saen, F. R., A. Memariani, and F. Hosseinzadeh Lotfi. 2005. “Determining relative efficiency of slightly non-homogeneous decision making units by data envelopment analysis: A case study in IROST.” Appl. Math. Comput. 165 (2): 313–328. https://doi.org/10.1016/j.amc.2004.04.050.
Segerstedt, A., and T. Olofsson. 2010. “Supply chains in the construction industry.” Supply Chain Manage. Int. J. 15 (5): 347–353. https://doi.org/10.1108/13598541011068260.
Shabani, A., S. M. R. Torabipour, and R. F. Saen. 2011. “Container selection in the presence of partial dual-role factors.” Int. J. Phys. Distrib. Logist. Manage. 41 (10): 991–1008. https://doi.org/10.1108/09600031111185257.
Shash, A. A. 1998. “Subcontractors’ bidding decisions.” J. Constr. Eng. Manage. 124 (2): 101–106. https://doi.org/10.1061/(ASCE)0733-9364(1998)124:2(101).
Sun, M., and X. Meng. 2009. “Taxonomy for change causes and effects in construction projects.” Int. J. Project Manage. 27 (6): 560–572. https://doi.org/10.1016/j.ijproman.2008.10.005.
Tadelis, S. 2012. “Public procurement design: Lessons from the private sector.” Int. J. Ind. Organ. 30 (3): 297–302. https://doi.org/10.1016/j.ijindorg.2012.02.002.
Talluri, S., T. Kull, H. Yildiz, and J. Yoon. 2013. “Assessing the efficiency of risk mitigation strategies in supply chains.” J. Bus. Logistics 34 (4): 253–269. https://doi.org/10.1111/jbl.12025.
Thanassoulis, E., M.C.A.S. Portela, and O. Despic. 2008. “DEA—The mathematical programming approach to efficiency analysis.” In The measurement of productive efficiency and productivity growth. New York: Oxford University Press.
Tsolas, I. E. 2013. “Construction project monitoring by means of RAM-based composite indicators.” J. Oper. Res. Soc. 64 (8): 1291–1297. https://doi.org/10.1057/jors.2012.147.
Uher, T. H. E., and P. H. Davenport. 2010. Fundamentals of building contract management, 2nd ed. Kensington, Australia: UNSW Press.
Villena, V. H., E. Revilla, and T. Y. Choi. 2011. “The dark side of buyer-supplier relationships: A social capital perspective.” J. Oper. Manage. 29 (6): 561–576. https://doi.org/10.1016/j.jom.2010.09.001.
Vrijhoef, R., and L. Koskela. 2000. “The four roles of supply chain management in construction.” Eur. J. Purchasing Supply Manage. 6 (3–4): 169–178. https://doi.org/10.1016/S0969-7012(00)00013-7.
Walewski, J., G. E. Gibson, and J. Jasper. 2001. Project delivery methods and contracting approaches available for implementation by the Texas department of transportation. Austin, TX: Texas Dept. of Transportation, Center for Transportation Research, Univ. of Texas at Austin.
Weber, C. A. 1996. “A data envelopment analysis approach to measuring vendor performance.” Supply Chain Manage. Int. J. 1 (1): 28–39. https://doi.org/10.1108/13598549610155242.
Xia, B., and A. P. C. Chan. 2012. “Measuring complexity for building projects: A Delphi study.” Eng. Constr. Archit. Manage. 19 (1): 7–24. https://doi.org/10.1108/09699981211192544.
Yang, H., and M. Pollitt. 2009. “Incorporating both undesirable outputs and uncontrollable variables into DEA: The performance of Chinese coal-fired power plants.” Eur. J. Oper. Res. 197 (3): 1095–1105. https://doi.org/10.1016/j.ejor.2007.12.052.
Zhu, J., and A. Mostafavi. 2017. “Discovering complexity and emergent properties in project systems: A new approach to understanding project performance.” Int. J. Project Manage. 35 (1): 1–12. https://doi.org/10.1016/j.ijproman.2016.10.004.
Zhu, W., Y. Yu, and P. Sun. 2018. “Data envelopment analysis cross-like efficiency model for non-homogeneous decision-making units: The case of United States companies’ low-carbon investment to attain corporate sustainability.” Eur. J. Oper. Res. 269 (1): 99–110. https://doi.org/10.1016/j.ejor.2017.08.007.
Information & Authors
Information
Published In
Journal of Construction Engineering and Management
Volume 145 • Issue 4 • April 2019
Copyright
©2019 American Society of Civil Engineers.
History
Received: Feb 20, 2018
Accepted: Sep 4, 2018
Published online: Jan 17, 2019
Published in print: Apr 1, 2019
Discussion open until: Jun 17, 2019
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.