Abstract
A variety of building information modeling (BIM) performance evaluation initiatives have been proposed to quantify BIM utilization capacity of enterprises. These initiatives were designed for evaluating, instead of benchmarking, an organization’s performance in BIM utilization. Unlike evaluation that mainly focuses on ascertaining the achievement of BIM utilization within an organization, benchmarking is more interested in comparing one organization’s BIM performance to their industry peers. By identifying gaps in specific areas, decisions to make improvements can be facilitated. This paper proposes a cloud-based BIM performance benchmarking application called building information modeling cloud score (BIMCS) to automatically collect BIM performance data from a wide range of BIM users nationwide. It utilizes the software as a service (SaaS) model of cloud computing to make the collection, aggregation, and presentation of benchmarking data autonomous and interactive. Based on the big data collected from the BIMCS database, an overall view of the industry status quo of BIM utilization may be obtained, and ultimately, a protocol for BIM performance can be developed on the basis of a better knowledge discovery process. Furthermore, BIMCS data will help individual companies compare and improve their performance in BIM utilization with respect to their industry competitors.
Get full access to this article
View all available purchase options and get full access to this article.
References
Achtert, E., Böhm, C., Kriegel, H.-P., Kröger, P., Müller-Gorman, I., and Zimek, A. (2007). “Detection and visualization of subspace cluster hierarchies.” Advances in databases: Concepts, systems and applications, Springer, Berlin, Germany, 152–163.
Aggarwal, C. C., Wolf, J. L., Yu, P. S., Procopiuc, C., and Park, J. S. (1999). “Fast algorithms for projected clustering.” Proc., Association for Computing Machinery Special Interest Group on Management of Data (ACM SIGMOD) Record, Association for Computing Machinery, New York, 61–72.
Agrawal, R., Gehrke, J., Gunopulos, D., and Raghavan, P. (1998). “Automatic subspace clustering of high dimensional data for data mining applications.” Proc., Association for Computing Machinery Special Interest Group on Management of Data (ACM SIGMOD) Record, Asoociation for Computing Machinery, New York.
Anderberg, M. R. (1973). “Cluster analysis for applications.” Defense technical information center (DTIC) document, Academic Press, New York.
Autodesk. (2014). “Revit overview.” 〈http://www.autodesk.com/products/autodesk-revit-family/overview〉 (Jan. 15, 2014).
Barber, E. (2004). “Benchmarking the management of projects: A review of current thinking.” Int. J. Project Manage., 22(4), 301–307.
Bartholomew, D. J., Knott, M., and Moustaki, I. (2011). Latent variable models and factor analysis: A unified approach, Wiley, West Susses, U.K.
Bendell, T., Boulter, L., and Kelly, J. (1993). Benchmarking for competitive advantage, Financial Times/Pitman, London.
Beyer, K., Goldstein, J., Ramakrishnan, R., and Shaft, U. (1999). “When is ‘nearest neighbor’ meaningful?” Database Theory—Int. Conf. on Database Theory (ICDT)’99, Springer, Jerusalem, Israel, 217–235.
Bogan, C. E., and English, M. J. (1994). Benchmarking for best practices: Winning through innovative adaptation, McGraw-Hill, New York.
Borthakur, D. (2007). “The hadoop distributed file system: Architecture and design.” 〈http://www.lhelper.org/dev/hadoop-0.12.2/docs/hdfs_design.pdf〉 (Jan. 15, 2014).
Camp, R. C., and Camp Robert, C. (1995). Business process benchmarking: Finding and implementing best practices, American Society for Quality Control (ASQC) Quality, Milwaukee, WI.
Center for Integrated Facility Engineering (CIFE). (2013). “VDC and BIM scorecard.” 〈https://vdcscorecard.stanford.edu/home〉 (Jan. 15, 2014).
Chen, Z., Chen, J., Shen, F., and Lee, Y. (2013). “Collaborative mobile-cloud computing for civil infrastructure condition inspection.” J. Comput. Civ. Eng., 04014066.
Chuang, T.-H., Lee, B.-C., and Wu, I.-C. (2011). “Applying cloud computing technology to BIM visualization and manipulation.” Proc., 28th Int. Symp. on Automation and Robotics in Construction, International Association for Automation and Robotics in Construction (IAARC), Bratislava, Slovakia, 144–149.
Construction Excellence. (2013). “Construction best practice programme.” 〈http://www.constructingexcellence.org.uk〉 (Jan. 15, 2014).
Construction Industry Institute. (2013). “CII benchmarking and metrics.” 〈https://www.construction-institute.org/nextgen/index.cfm〉 (Jan. 15, 2014).
Costa, D., Formoso, C., Kagioglou, M., Alarcón, L., and Caldas, C. (2006). “Benchmarking initiatives in the construction industry: Lessons learned and improvement opportunities.” J. Manage. Eng., 158–167.
Datta, S., Nandi, G., Bandyopadhyay, A., and Pal, P. K. (2009). “Application of PCA-based hybrid Taguchi method for correlated multicriteria optimization of submerged arc weld: A case study.” Int. J. Adv. Manuf. Technol., 45(3–4), 276–286.
Diakoulaki, D., Mavrotas, G., and Papayannakis, L. (1995). “Determining objective weights in multiple criteria problems: The critic method.” Comput. Oper. Res., 22(7), 763–770.
Domeniconi, C., Papadopoulos, D., Gunopulos, D., and Ma, S. (2004). “Subspace clustering of high dimensional data.” Proc., 2004 SIAM (Society for Industrial and Applied Mathematics) Int. Conf. on Data Mining, SIAM, Philadelphia, PA.
Fornell, C. (1982). A second generation of multivariate analysis. 2. Measurement and evaluation, Praeger Publishers, Westport, CT.
Friedman, J. H., and Meulman, J. J. (2004). “Clustering objects on subsets of attributes.” J. R. Stat. Soc. Series B (Stat. Method.), 66(4), 815–849.
Garvin, D. A. (1993). “Building a learning organization.” Harv. Bus. Rev., 71, 78–91.
Gong, J., and Azambuja, M. (2013). “Visualizing construction supply chains with google cloud computing tools.” Proc., ICSDEC 2012: Developing the Frontier of Sustainable Design, Engineering, and Construction, ASCE, Reston, VA, 671–678.
Gracia, J., and Bayo, E. (2013). “Integrated 3D web application for structural analysis software as a service.” J. Comput. Civ. Eng., 159–166.
Greco, S., Matarazzo, B., and Slowinski, R. (2001). “Rough sets theory for multicriteria decision analysis.” Eur. J. Oper. Res., 129(1), 1–47.
Hagerty, M. R., and Land, K. C. (2007). “Constructing summary indices of quality of life a model for the effect of heterogeneous importance weights.” Socio. Meth. Res., 35(4), 445–496.
Handfield, R., Walton, S. V., Sroufe, R., and Melnyk, S. A. (2002). “Applying environmental criteria to supplier assessment: A study in the application of the analytical hierarchy process.” Eur. J. Oper. Res., 141(1), 70–87.
International Organization for Standardization (ISO). (2008). “Information technology—Database languages—SQL—Part 1: Framework (SQL/framework).”, Nederlands Normalisatie Institute, ISO, Geneva, Switzerland.
Issa, R. R., and Suermann, P. (2009). “Evaluating industry perceptions of building information modeling (BIM) impact on construction.” J. Inf. Technol. Constr., 14(2009), 574–594.
Karamouz, M., Zahmatkesh, Z., and Saad, T. (2013). “Cloud computing in urban flood disaster management.” Proc., World Environmental and Water Resources Congress 2013, ASCE, Reston, VA.
Kendall, M. G. (1938). “A new measure of rank correlation.” Biometrika, 30(1–2), 81–93.
Krasner, G. E., and Pope, S. T. (1988). “A description of the model-view-controller user interface paradigm in the smalltalk-80 system.” J. Object Oriented Program., 1(3), 26–49.
Kumar, B., Cheng, J. C., and McGibbney, L. (2010). “Cloud computing and its implications for construction IT.” Proc., Int. Conf. in Computing in Civil and Building Engineering, W. Tizani, ed., International Society for Computing in Civil and Building Engineering, Nottingham, U.K.
Latu, K., Swain, N., Christensen, S., Jones, N., Nelson, E., and Williams, G. (2013). “Essential GIS technologies for hydrologic simulation applications in cloud computing.” Proc., World Environmental and Water Resources Congress 2013, ASCE, Reston, VA.
Liang, F., and Luo, Y. (2013). “A framework of the civil engineering CAD experimental platform based on cloud computing.” Proc., Int. Conf. on Construction and Real Estate Management 2013: Construction and Operation in the Context of Sustainability, ASCE, Reston, VA.
Linstone, H. A., and Turoff, M. (1975). The delphi method, Addison-Wesley Reading, Boston, MA.
Liu, J., Wang, H., Ge, Y., and Huang, J. (2013). “Application of multi-source information fusion technology in the construction of a secure and emergent transportation platform.” Proc., Int. Conf. on Transportation Information and Safety 2013: Improving Multimodal Transportation Systems—Information, Safety, and Integration, ASCE, Reston, VA, 237–243.
Liu, R. (2012). “BIM-based life cycle information management: Integrating knowledge of facility management into design.” Ph.D. thesis, Univ. of Florida, Gainesville, FL.
Lohuis, M. M., Dekkers, J., and Smith, C. (1992). “Probability of success and predicted returns of sires in progeny test programs.” J. Dairy Sci., 75(6), 1660–1671.
Marinescu, D. C. (2013). Cloud computing: Theory and practice, Elsevier, Philadelphia, PA.
Marosszekey, M., and Karim, K. (1997). “Benchmarking—A tool for lean construction.” Proc., 5th Int. Conf. of the International Group for Lean Construction, International Group for Lean Construction (IGLC), Gold Coast, Australia, 157–167.
Mell, P., and Grance, T. (2011). “The NIST definition of cloud computing.” National Institute of Standards and Technology (NIST) special publication, Vol. 800, Gaithersburg, MD, 7.
Moore, D. S. (1978). “Chi-square tests.” Studies in statistics, R. V. Hogg, ed., Vol. 19, Mathematical Association of America, Washington, DC.
Mulaik, S. A. (1987). “A brief history of the philosophical foundations of exploratory factor analysis.” Multivariate Behav. Res., 22(3), 267–305.
National Institute of Building Sciences (NIBS). (2007). “National building information modeling standard—Version 1.0.”, Washington, DC.
National Institute of Building Sciences (NIBS). (2012). “National building information modeling standard—Version 2.0—Chapter 5.2 minimum BIM.”, Washington, DC.
Nieh, J., Yang, S. J., and Novik, N. (2000). “A comparison of thin-client computing architectures.”, Dept. of Computer Science, Columbia Univ., New York.
Procopiuc, C. M., Jones, M., Agarwal, P. K., and Murali, T. (2002). “A Monte Carlo algorithm for fast projective clustering.” Proc., 2002 Association for Computing Machinery Special Interest Group on Management of Data (ACM SIGMOD) Int. Conf. on Management of Data, Association for Computing Machinery (ACM), New York, 418–427.
Ramírez, R. R., Alarcón, L. F. C., and Knights, P. (2004). “Benchmarking system for evaluating management practices in the construction industry.” J. Manage. Eng., 110–117.
Redmond, A., Hore, A., Alshawi, M., and West, R. (2012). “Exploring how information exchanges can be enhanced through cloud BIM.” Autom. Constr., 24(2012), 175–183.
Rossi, P. H., Lipsey, M. W., and Freeman, H. E. (2004). Evaluation: A systematic approach, Sage, Thousand Oaks, CA.
Sargent, R. (2005). “Verification and validation of simulation models.” Winter Simulation Conf., WSC, 130–143.
Sebastian, R., and van Berlo, L. (2010). “Tool for benchmarking BIM performance of design, engineering and construction firms in the Netherlands.” Archit. Eng. Des. Manage., 6(4), 254–263.
Senescu, R., Haymaker, J., Meza, S., and Fischer, M. (2014). “Design process communication methodology: Improving the effectiveness and efficiency of collaboration, sharing, and understanding.” J. Archit. Eng., 05013001.
Shannon, C. (1948). “A mathematical theory of communication.” Bell Syst. Tech. J., 27(3), 379–423.
Sheng, Z., Sun, S., Wang, J., and Chu, W. (2007). “Comprehensive evaluation of river water environmental quality based on the principal component analysis.” Environ. Sci. Manage., 32(12), 172–175.
Srdjevic, B., Medeiros, Y., and Faria, A. (2004). “An objective multi-criteria evaluation of water management scenarios.” Water Resour. Manage., 18(1), 35–54.
Subashini, S., and Kavitha, V. (2011). “A survey on security issues in service delivery models of cloud computing.” J. Network Comput. Appl., 34(1), 1–11.
Succar, B. (2009). “Building information modelling framework: A research and delivery foundation for industry stakeholders.” Autom. Constr., 18(3), 357–375.
Succar, B. (2010). “Building information modelling maturity matrix.” Handbook of research on building information modelling and construction informatics: Concepts and technologies, J. Underwood and U. Isikdag, eds., IGI, Hershey, PA, 65–103.
Succar, B., Sher, W., and Williams, A. (2012). “Measuring BIM performance: Five metrics.” Archit. Eng. Des. Manage., 8(2), 120–142.
Succar, B., Sher, W., and Williams, A. (2013). “An integrated approach to BIM competency assessment, acquisition and application.” Autom. Constr., 35(2013), 174–189.
Suermann, P., Issa, R., and McCuen, T. (2008). “Validation of the U.S. national building information modeling standard interactive capability maturity model.” Proc., 12th Int. Conf. on Computing in Civil and Building Engineering, International Society for Computing in Civil and Building Engineering, Nottingham, U.K.
Suermann, P. C. (2009). “Evaluating the impact of building information modeling (BIM) on construction.” Ph.D. dissertation, Univ. of Florida, Gainesville, FL.
Underwood, J., and Isikdag, U. (2010). Handbook of research on building information modeling and construction informatics: Concepts and technologies, Information Science Reference.
Unicode Consortium. (2011). “Unicode 6.0.0.” 〈http://www.unicode.org/versions/Unicode6.0.0/〉 (Jan. 15, 2014).
Var, I. (1998). “Multivariate data analysis.” Vectors, 8(2), 125–136.
Welch, B., et al. (2008). “Scalable performance of the panasas parallel file system.” Proc., File and Storage Technologies, USENIX (Advanced Computing Systems Association), Berkeley, CA, 1–17.
Yang, Y. (2006). “Weighting methods in multivariate evaluation.” Stat. Decis., 2006(13), 17–19.
Zeleny, M., and Cochrane, J. L. (1982). Multiple criteria decision making, McGraw-Hill, New York.
Zhang, L., and Issa, R. (2012). “Comparison of BIM cloud computing frameworks.” Proc., Computing in Civil Engineering (2012), ASCE, Reston, VA, 389–396.
Information & Authors
Information
Published In
Journal of Construction Engineering and Management
Volume 140 • Issue 11 • November 2014
Copyright
© 2014 American Society of Civil Engineers.
History
Received: Jan 31, 2014
Accepted: May 1, 2014
Published online: Jul 3, 2014
Published in print: Nov 1, 2014
Discussion open until: Dec 3, 2014
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.