Research Validation: Challenges and Opportunities in the Construction Domain
Publication: Journal of Construction Engineering and Management
Volume 136, Issue 1
Abstract
Validation of the research methodology and its results is a fundamental element of the process of scholarly endeavor. Approaches used for construction engineering and management research have included experiments, surveys and observational studies, modeling and simulation, theory building, case studies, and various subtypes thereof. Some studies use more than one approach. A particular contribution of this paper is that it reviews different types of validation using examples of studies, analyzes the specific challenges that were found to be significant, and presents how they were successfully overcome in each case. Another contribution is that it describes new opportunities for research validation that are emerging at the horizon as well as ongoing collaborative efforts to enhance the access of construction researchers to validation tools. This paper increases the awareness of the paramount role that validation techniques play in scholarly work by providing readers with recommendations to properly validate their own research efforts.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
The writers thank Ms. Kathleen M. Mahoney, Graduate Library Pre-Professional at the UNSPECIFIEDEngineering/Architecture/Mathematics Library of The Catholic University of America, for her kind support in obtaining library materials for this study.
References
AbouRizk, S. M., Halpin, D. W., and Wilson, J. R. (1994). “Fitting beta distributions based on sample data.” J. Constr. Eng. Manage., 120(2), 288–305.
Akin, O., and Garrett, J. H. (2006). “Final report: NSF-NIST workshop on advanced building infrastructure testbed (NABIT).” Division of Civil and Mechanical Systems, National Science Foundation, Arlington, Va.
Anderson, S. D., Patil, S. S., Gibson, G. E., and Sullivan, G. R. (2004). “Owner-contractor work structures: Process approach.” J. Constr. Eng. Manage., 130(5), 680–690.
Babbie, E. (1990). Survey research methods, Wadsworth, Belmont, Calif., ⟨http://www.cengage.com/wadsworth⟩.
Bartlett, J. E., Kotrlik, J. W., and Higgins, C. C. (2001). “Organizational research: Determining appropriate sample size in survey research.” Business Education Index, 19(1), 43–50.
Barton, R. R. and Schruben, L. W., and (2001). “Resampling methods for input modeling.” Proc., 2001 Winter Simulation Conf., B. A. Peters, J. S. Smith, D. J. Medeiros, and M. W. Rohrer, eds., IEEE, Piscataway, N.J., 372–378.
Blayse, A. M., and Manley, J. (2004). “Key influences on construction innovation.” Constr. Innovation, 4(3), 143–154.
Chantaravarapan, S., Gunal, A., and Williams, E. J., and (2004). “On using Monte Carlo methods for scheduling.” Proc., 2004 Winter Simulation Conf., R. G. Ingalls, M. D. Rossetti, J. S. Smith, and B. A. Peters, eds., IEEE, Piscataway, N.J., 1870–1975.
Chua, D. K. H., Li, D. Z., and Chan, W. T. (2001). “Case-based reasoning approach in bid decision making.” J. Constr. Eng. Manage., 127(1), 35–45.
Col Debella, D., and Ries, R. (2006). “Construction delivery systems: A comparative analysis of their performance within school districts.” J. Constr. Eng. Manage., 132(11), 1131–1138.
Cresswell, J. W. (1994). Research design: Qualitative and quantitative approaches, SAGE, Thousand Oaks, Calif., ⟨http://www.sagepub.com/home.nav⟩.
Cronbach, L. J. (1951). “Coefficient alpha and the internal structure of tests.” Psychometrika, 16(3), 297–335.
Davis, K. A. (2004). “Information technology change in the architecture, engineering, and construction industry: An investigation of individuals’ resistance.” Ph.D. dissertation, Virginia Polytechnic Institute and State Univ., Blacksburg, Va.
Davis, K. A. and Songer, A. D., and (2003). “Individuals’ resistance to technological change in the AEC industry.” Proc., 2003 Construction Research Congress, K. R. Molenaar and P. S. Chinowsky, eds., ASCE, Reston, Va., 8.
del Cano, A., and de la Cruz, M. P. (2002). “Integrated methodology for project risk management.” J. Constr. Eng. Manage., 128(6), 473–485.
Elazouni, A. M., and Metwally, F. G. (2007). “Expanding finance-based scheduling to devise overall-optimized project schedules.” J. Constr. Eng. Manage., 133(1), 86–90.
El-Diraby, T. E., and O’Connor, J. T. (2004). “Lessons learned in designing research methodology in field-based construction research.” J. Profl. Issues Eng. Educ. Pract., 130(2), 109–114.
Elmaghraby, S. E. (2000). “On criticality and sensitivity in activity networks.” Eur. J. Oper. Res., 127, 220–238.
FIATECH. (2004). Capital Projects Technology Roadmapping Initiative: Element 4 Tactical Plan, Intelligent and Automated Construction Job Site (IACJS), Fully Integrated and Automated Technologies for Construction, Austin, Tex.
Gay, L. R., Mills, G. E., and Ariasian, P. (2006). Educational research: Competencies for analysis and applications, 8th Ed., Prentice-Hall, Upper Saddle River, N.J.
Gibson, G. E., Kaczmarowski, J. H., and Lore, H. E. (1995). “Preproject-planning process for capital facilities.” J. Constr. Eng. Manage., 121(3), 312–318.
González-Quevedo, A., AbouRizk, S. M., Iseley, D. T., and Halpin, D. W. (1993). “Comparison of two simulation methodologies in construction.” J. Constr. Eng. Manage., 119(3), 573–589.
González-Quevedo, A. A. (1995). “Sensitivity analysis of construction simulation.” Proc., 2nd Congress on Computing in Civil Engineering, J. P. Mohsen, ed., ASCE, Reston, Va., 1427–1434.
Gujarati, D. N. (1995). Basic econometrics, 3rd Ed., McGraw-Hill, New York.
Hsueh, M. -C., Tsai, T. K., and Iyer, R. K. (1997). “Fault injection techniques and tools.” Computer, 30(4), 75–82.
Ioannou, P. G. and Martínez, J. C., and (1996). “Animation of complex construction simulation models.” Proc., 3rd Congress on Computing in Civil Engineering, J. A. Vanegas and P. S. Chinowsky, eds., ASCE, Reston, Va., 620–626.
Isidore, L. J., and Back, W. E. (2002). “Multiple simulation analysis for probabilistic cost and schedule integration.” J. Constr. Eng. Manage., 128(3), 211–219.
Jaafari, A., Manivong, K. K., and Chaaya, M. (2001). “VIRCON: Interactive system for teaching construction management.” J. Constr. Eng. Manage., 127(1), 66–75.
Kallantzis, A., Soldatos, J., and Lambropoulos, S. (2007). “Linear versus network scheduling: A critical path comparison.” J. Constr. Eng. Manage., 133(7), 483–491.
Kamat, V. R. and Martínez, J. C., and (2003). “Interactive discrete-event simulation of construction processes in dynamic immersive 3D virtual worlds.” Proc., 2003 Conf. on Construction Applications of Virtual Reality, W. Y. Thabet and D. A. Bowman, eds., Virginia Polytechnic Institute and State University, Blacksburg, Va., 197–201.
Karam, K. S., Karam, J. S., and Einstein, H. H. (2007). “Decision analysis applied to tunnel exploration planning. I: Principles and case study.” J. Constr. Eng. Manage., 133(5), 344–353.
Kelton, W. D. and Barton, R. R., and (2003). “Experimental design for simulation.” Proc., 2003 Winter Simulation Conf., S. Chick, P. J. Sánchez, D. Ferrin, and D. J. Morrice, eds., IEEE, Piscataway, N.J., 59–65.
Kolisch, R., and Sprecher, A. (1996). “PSPLIB—A project scheduling problem library.” Eur. J. Oper. Res., 96(1), 205–216.
Krejcie, R. V., and Morgan, D. W. (1970). “Determining sample size for research activities.” Educ. Psychol. Meas., 30, 607–610.
Law, A. M. (2007). Simulation modeling and analysis, 4th Ed., McGraw-Hill, New York.
Lee, D. -E. (2005). “Probability of project completion using stochastic project scheduling simulation.” J. Constr. Eng. Manage., 131(3), 310–318.
Leedy, P. D., and Ormrod, J. E. (2001). Practical research planning and design, 7th Ed., Prentice-Hall, Upper Saddle River, N.J.
Ling, Y. Y. (2002). “Model for predicting performance of architects and engineers.” J. Constr. Eng. Manage., 128(5), 446–455.
Lucko, G. (2007). “Flexible modeling of linear schedules for integrated mathematical analysis.” Proc., 2007 Winter Simulation Conf., S. G. Henderson, B. Biller, M. -H. Hsieh, J. Shortle, J. D. Tew, and R. R. Barton, eds., IEEE, Piscataway, N.J.
Lucko, G., Anderson-Cook, C. M., and Vorster, M. C. (2006). “Statistical considerations for predicting residual value of heavy equipment.” J. Constr. Eng. Manage., 132(7), 723–732.
Menches, C. L., and Hanna, A. S. (2006). “Quantitative measurement of successful performance from the project manager’s perspective.” J. Constr. Eng. Manage., 132(12), 1284–1293.
Montgomery, D. C., Peck, E. A., and Vining, G. G. (2001). Introduction to linear regression analysis, 3rd Ed., Wiley, New York.
Navon, R., and Berkovich, O. (2005). “Development and on-site evaluation of an automated materials management and control model.” J. Constr. Eng. Manage., 131(12), 1328–1336.
Neuman, W. L. (2000). Social research methods: Qualitative and quantitative approaches, 4th Ed., Allyn and Bacon, Needham Heights, Mass.
Ozorovskaja, R., Voordijk, J. T., and Wilderom, C. P. M. (2007). “Leadership and cultures of Lithuanian and Dutch construction firms.” J. Constr. Eng. Manage., 133(11), 900–911.
Price, A. D. F., and Chahal, K. (2006). “A strategic framework for change management.” Constr. Manage. Econom., 24(3), 237–251.
Rekapalli, P. V. and Martínez, J. C., and (2007). “A message-based architecture to enable runtime user interaction on concurrent simulation-animations of construction operations.” Proc., 2007 Winter Simulation Conf., S. G. Henderson, B. Biller, M. -H. Hsieh, J. Shortle, J. D. Tew, and R. R. Barton, eds., IEEE, Piscataway, N.J., 2028–2031.
Rojas, E. M., and Aramvareekul, P. (2003). “Is construction labor productivity really declining?” J. Constr. Eng. Manage., 129(1), 41–46.
Rojas, E. M., and Dossick, C. S. (2008). “Developing a state-of-the-art facility to support construction research and education: A case study.” J. Profl. Issues Eng. Educ. Pract., 134(1), 67–74.
Rojas, E. M., and Kell, I. (2008). “Comparative analysis of project delivery systems cost performance in Pacific Northwest public schools.” J. Constr. Eng. Manage., 134(6), 387–397.
Rojas, E. M., and Mukherjee, A. (2006). “A multi-agent framework for general-purpose situational simulations in the construction management domain.” J. Comput. Civ. Eng., 20(3), 165–176.
Roschke, P. N. (1994). “Validation of knowledge-based system with multiple bridge rail experts.” J. Transp. Eng., 120(5), 787–806.
Sargent, R. G. (1991). “Simulation model verification and validation.” Proc., 1991 Winter Simulation Conf., W. D. Kelton, G. M. Clark, and B. L. Nelson, eds., IEEE, Piscataway, N.J., 37–47.
Snee, R. D. (1977). “Validation of regression models: Methods and examples.” Technometrics, 19(4), 415–428.
Telem, D., Shapira, A., Goren, Y. D., and Schexnayder, C. J. (2006). “Moving a reinforced-concrete building: Case study.” J. Constr. Eng. Manage., 132(2), 115–124.
Thomas, H. R., Riley, D. R., and Sanvido, V. E. (1999). “Loss of labor productivity due to delivery methods and weather.” J. Constr. Eng. Manage., 125(1), 39–46.
Vanhoucke, M. (2006). “Work continuity constraints in project scheduling.” J. Constr. Eng. Manage., 132(1), 14–25.
Wu, J. Y. (2005). “Soil-based flowable fill for pipeline construction.” Proc., 2005 Pipeline Division Specialty Conf., C. Vipulanandan and R. Ortega, eds., ASCE, Reston, Va., 925–938.
Yu, A. T. W., Shen, Q., Kelly, J., and Hunter, K. (2006). “Investigation of critical success factors in construction project briefing by way of content analysis.” J. Constr. Eng. Manage., 132(11), 1178–1186.
Zayed, T. M., and Halpin, D. W. (2005a). “Pile construction productivity assessment.” J. Constr. Eng. Manage., 131(6), 705–714.
Zayed, T. M., and Halpin, D. W. (2005b). “Productivity and cost regression models for pile construction.” J. Constr. Eng. Manage., 131(7), 779–789.
Zhang, H., Shi, J. J., and Tam, C. M. (2002). “Iconic animation for activity-based construction simulation.” J. Comput. Civ. Eng., 16(3), 157–164.
Information & Authors
Information
Published In
Journal of Construction Engineering and Management
Volume 136 • Issue 1 • January 2010
Pages: 127 - 135
Copyright
© 2010 ASCE.
History
Received: Jul 23, 2008
Accepted: Dec 29, 2008
Published online: Mar 17, 2009
Published in print: Jan 2010
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.