Performance Evaluation for Cost Estimators by Reliability Interval Method
Publication: Journal of Construction Engineering and Management
Volume 131, Issue 1
Abstract
Most consultant selection models stress the importance of past performance. However, there are so far very few studies on evaluating consultant’s performance. It hampers the whole process of the selection model. This paper tries to establish a systematic approach in developing a consultant’s performance evaluation model for the evaluation of the performance of cost estimators in the construction industry of Hong Kong. Nominal group technique is adopted in identifying the decision criteria for the evaluation, and a reliability interval method (RIM) is developed to assess the importance weighting of each criterion. The RIM allows statistical analysis and fuzzy assessment of the weight. The results report the weights of each decision criterion and its subcriterion in evaluating cost estimator’s performance. Interestingly, the results show that traditional functions of cost estimator are the least treasured from the clients. Proactive and professional advice is considered to be much more important. The study is highly relevant to industry practitioners in assessing performance of costs estimators, as well as to researchers in further developing the consultant selection model.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowlegments
The work described in this paper was fully supported by a grant from the City U Strategic Research Grant A/C No. 7001116 and the RGC Competitive Earmarked Research Grant No. City U 1112/99E.
References
Adler, M., and Ziglio, E. (1996). Grazing into the oracle, The Delphi method and its application to social policy and public health, Cromwell Press, U.K.
Aguaron, L., and Moreno-Jimenez, J. M. (2000). “Local stability intervals in the analytic hierarchy process.” Eur. J. Oper. Res., 125(1), 113–132.
Arbel, A. (1987). “Approximate articulation of preference and priority derivation.” Eur. J. Oper. Res., 43(3), 317–326.
Atkinson, R. (1999). “Project management: Cost, time and quality, two best guesses and a phenomenon, it’s time to accept other success criteria.” Int. J. Proj. Manage., 17(6), 337–342.
Baker, J. A., and Lamb, C. W. (1993). “Measuring architectural design service quality.” J. Prof. Services Marketing, 24, 253–268.
Banks, J., and Barrett, P. (1992). “A synthesis of client’s criteria for the assessment of professional firms.” Proc., Architectural Management International Symp., M. P. Nicholson, ed., Univ. of Nottingham, Nottingham, U.K.
Belassi, W., and Tukel, O. I. (1996). “A new framework for determining critical success/failure factors in projects.” Int. J. Proj. Manage., 14(3), 141–151.
Belton, V. (1986). “A comparison of the analytic hierarchy process as a simple multiattribute value function.” Eur. J. Oper. Res., 26(1), 7–21.
Belton, V., and Gear, T. (1983). “On a short-coming of Saaty’s method of analytic hierarchies,” Omega, 11(3), 228–230.
Bojanic, D. C. (1991). “Quality measurement in professional services firms,” J. Prof. Services Marketing, 7(2), 27–36.
Buckley, J. J. (1985). “Fuzzy hierarchical analysis,” Fuzzy Sets Syst., 17, 233–247.
Chan, A. P. C., Scott, D., and Lam, E. W. M. (2002). “Framework of Success Criteria for Design/Build Projects,” J. Manage. Eng., 18(3), 120–128.
Cheng, C. H. (1996). “Evaluating naval tactical missile systems by fuzzy AHP based on the grade value of membership function,” Eur. J. Oper. Res., 96(2), 343–350.
Dalkey, N. C. (1968). The Delphi method: An experimental study of group opinion, The RAND Corporation, Santa Monica, Calif.
Delbecq, A. L., Van de Ven, A. H., and Gustafson, D. H. (1986). Group techniques for program planning, A guide to nominal group and Delphi processes, Green Briar Press, Wis.
Edwards, W. (1997). “How to use multiattribute utility measurement for social decision making,” IEEE Trans. Syst. Man Cybern., 7, 326–340.
Edwards, W., and Barron, F. H. (1994). “SMARTS and SMARTER: Improved simple methods for multiattribute utility measurement,” Org. Behav. Human Decision Processes, 60, 306–325.
Gustafson, D. H., Shukla, R. M., Delbecq, A. L., and Walster, G. W. (1973). “A comparative study of differences in subjective likelihood estimates made by individuals, interacting groups, Delphi groups and nominal groups,” Org. Behav. Human Perf., 9, 280–291.
Haines, L. M. (1998). “A statistical approach to the analytic hierarchy bprocess with interval judgments (I) Distributions on feasible regions.” Eur. J. Oper. Res., 110(1), 112–125.
Hatush, Z., and Skitmore, M. (1997). “Evaluating contractor prequalification data: selection criteria and project success factors.” Constr. Manage. Econom., 15(1), 129–147.
Holt, G. D. (1998). “Which contractor selection methodology?” Int. J. Proj. Manage., 16(3), 153–164.
Holt, G. D., Olomolaiye, P. O., and Frank, C. H. (1994). “Factors influencing UK construction clients’ choice of contractor.” Build. Environ., 29(2), 241–248.
Hong Kong Housing Authority, (HKHA), (1997). System for selection of architectural consultants, Hong Kong.
Hoxley, M. (1994). “Assessment of building surveying service quality: Process or outcome?” RICS Research Rep., Royal Institution of Chartered Surveyors, London.
Hoxley, M. (1998). “Value for money? The impact of competitive fee tendering on construction professional service quality.” RICS Research Rep., Royal Institution of Chartered Surveyors, London.
Hunt, H. W., Logan, D. H., Corbetta, R. H., Crimmins, A. H., Bayard, R. P., Lore, H. E., and Bogen, S. A. (1966). “Contract award practices.” J. Constr. Eng. Div., 92(1), 1–16.
Jang, Y., and Lee, J. (1998). “Factors influencing the success of management consulting projects.” Int. J. Proj. Manage., 16(2), 67–72.
Keeney, R. L., and Raiffa, H. (1993). Decision with multiple objectives: Preferences and value trade-offs, Cambridge University Press, Cambridge, United Kingdom.
Kuo, R. J., Chi, S. C., and Kao, S. S. (2002). “A decision support system for selecting convenience store location through integration of fuzzy AHP and artificial neural network.” Comput Ind., 47(2), 199–214.
Laarhoven, P. J. M., and Pedrycz, W. (1983). “A fuzzy extension of Saaty’s priority theory.” Fuzzy Sets Syst., 11, 229–241.
Leung, J. F. K., Cheung, F. K. T., and Skitmore, M. (2002). “Multi-criteria evaluation model for selection of architectural consultants.” Constr. Manage. Econom., 20(7), 569–580.
Lipovetsssky, S., and Tishler, A. (1999). “Interval estimation of priorities in the AHP.” Eur. J. Oper. Res., 114(1), 153–164.
Lo, S. M. (1999). “A fire safety assessment system for existing buildings.” Fire Technol., 35(2), 131–152.
Lo, S. M., and Lu, J. A. (2001). “Incorporating reliability and variance into the weighting function of fire risk assessment for high rise buildings.” China Safety Sci. J., 11(5), 11–13 (Chinese).
Moore, R. E. (1979). Method and application of interval analysis, SIAM, Philadelphia.
New Jersey Turnpike Authority (NJTA). (1997). Engineering consultant prequalification, N.J.
Ohio Department of Transport (ODT). (1997). Consultant prequalification requirements and procedures, Ohio.
Orkoroh, M. I., and Torrance, V. B. (1999). “A model for subcontractor selection in refurbishment projects.” Constr. Manage. Econom., 17(3), 315–327.
Pendharkar, P. C. (2003). “Characterization of aggregate fuzzy membership functions using Saaty’s eigenvalue approach.” Comput. Oper. Res., 30(2), 199–212.
Pillai, A. S., Joshi, A., and Rao, K. S. (2002). “Performance measurement of R&D projects in a multi-project, concurrent engineering environment.” Int. J. Proj. Manage., 20(2), 165–177.
Poyhonen, M., and Hamalainen, R. P. (2001). “On the convergence of multiattribute weighting methods.” Eur. J. Oper. Res., 129(3), 569–585.
Queensland Government (1997). “PQC: Prequalification criteria for consultant selection.” Rep. Prepared for the Department of Public Works and Housing, Australia.
Russell, J. S. (1990). “Model for owner prequalification of contractors.” J. Manage. Eng., 6(1), 59–75.
Russell, J. S., Hancher, D. E., and Skibniewski, M. J. (1992). “Contractor prequalification data for construction owners.” Constr. Manage. Econom., 10(2), 1170–1135.
Russell, J S., and Skibniewski, M. J. (1988). “Decision criteria in contractor prequalification.” J. Constr. Eng. Manage., 4(2), 148–164.
Saaty, T. L. (1980). The analytic hierarchy process, McGraw–Hill, New York.
Saaty, T. L. (1994). “Highlights and critical points in the theory and application of the analytic hierarchy process.” Eur. J. Oper. Res., 74(3), 426–447.
Saaty, T. L. (2000). Fundamental of decision making and priority theory with the analytic hierarchy process, Vol. VI, RWS Publications.
Saaty, T. L., and Vargas, L. G. (1987). “Uncertainty and rank order in the analytic hierarchy process.” Eur. J. Oper. Res., 32(1), 107–117.
Schoemaker, P. J., and Waid, C. C. (1982). “An experimental comparison of different approaches to determining weights in additive utility models.” Manage. Sci., 28(2), 182–196.
von Winterfeldt, D., and Edwards, W. (1986). Decision analysis and behavioral research, Cambridge University Press, Cambridge, United Kingdom.
Watts, J. M. (1997). “Fire risk assessment using multiattribute evaluation,” Fire Safety Science: Proc., 5th Int. Symp., Y. Hasemi, ed., The International Association for Fire Safety, the World Congress Centre, Melbourne, Australia, 679–690.
Zadeh, L. A. (1965). Fuzzy Sets, Inf. Control, 8, 338–353.
Zimmermann, H. J. (1991). Fuzzy set theory and its applications, 2nd Ed., Kluwer Academic, Dordrecht, The Netherlands.
Information & Authors
Information
Published In
Journal of Construction Engineering and Management
Volume 131 • Issue 1 • January 2005
Pages: 108 - 116
Copyright
© 2004 ASCE.
History
Received: Feb 20, 2003
Accepted: Jan 12, 2004
Published online: Jan 1, 2005
Published in print: Jan 2005
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.