Predicting Cost Impacts of Nonconformances in Construction Projects Using Interpretable Machine Learning
Publication: Journal of Construction Engineering and Management
Volume 150, Issue 1
Abstract
Nonconformance (NCR) has long been a subject of research interest for its potential to extrapolate information leading to a more productive environment in construction projects. Despite a variety of traditional attempts, a systematic understanding of how machine learning (ML) approaches can contribute to proactively detecting the severity of NCRs remains limited. This study aims to develop a data-driven ML framework to predict the cost impacts of NCRs (high severity versus low severity) in construction projects. To accomplish this aim, the random forest (RF) algorithm reinforced with a metaheuristic hyperparameter-tuning strategy, namely the gravitational search algorithm (GSA), is adopted for the binary classification problem. Furthermore, this study incorporates the Shapley additive explanations (SHAP) ensuring transparent interpretations into the GSA-RF predictive framework to tackle the inherent black-box nature of the ML rationale. The results reveal that the proposed model detects the severity of NCRs in terms of their cost impact with an overall AUROC value of 0.776 for the preseparated and blinded testing set. This indicates that the proposed model can be used confidently for newly introduced datasets from real-life cases. In addition, the SHAP analysis results emphasized the role of season, inadequate application procedure, and NCR type in detecting the severity of NCRs. Overall, this research not only makes an important contribution through its novel data-driven approaches but also provides insights for project managers concerning productivity improvements in the sector.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or codes that support the findings of this study are available from the corresponding author upon reasonable request.
References
Abdelsalam, H. M. E., and M. M. Gad. 2009. “Cost of quality in Dubai: An analytical case study of residential construction projects.” Int. J. Project Manage. 27 (5): 501–511. https://doi.org/10.1016/j.ijproman.2008.07.006.
Abdul-Rahman, H. 1995. “The cost of non-conformance during a highway project: A case study.” Constr. Manage. Econ. 13 (1): 23–32. https://doi.org/10.1080/01446199500000004.
Abdul-Rahman, H., P. A. Thompson, and I. L. Whyte. 1996. “Capturing the cost of non-conformance on construction sites.” Int. J. Qual. Reliab. Manage. 13 (1): 48–60. https://doi.org/10.1108/02656719610108314.
Al-Janabi, A. M., M. S. Abdel-Monem, and K. M. El-Dash. 2020. “Factors causing rework and their impact on projects’ performance in Egypt.” J. Civ. Eng. Manage. 26 (7): 666–689. https://doi.org/10.3846/jcem.2020.12916.
Alsinglawi, B., O. Alshari, M. Alorjani, O. Mubin, F. Alnajjar, M. Novoa, and O. Darwish. 2022. “An explainable machine learning framework for lung cancer hospital length of stay prediction.” Sci. Rep. 12 (1): 607. https://doi.org/10.1038/s41598-021-04608-7.
Balouchi, M., M. Gholhaki, and A. Niousha. 2019. “Reworks causes and related costs in construction: Case of Parand mass housing project in Iran.” Int. J. Qual. Reliab. Manage. 36 (8): 1392–1408. https://doi.org/10.1108/IJQRM-06-2018-0155.
Banadkooki, F. B., M. Ehteram, F. Panahi, S. Sammen, F. B. Othman, and A. EL-Shafie. 2020. “Estimation of total dissolved solids (TDS) using new hybrid machine learning models.” J. Hydrol. 587 (Feb): 124989. https://doi.org/10.1016/j.jhydrol.2020.124989.
Başakın, E. E., Ö. Ekmekcioğlu, H. Çıtakoğlu, and M. Özger. 2022. “A new insight to the wind speed forecasting: Robust multi-stage ensemble soft computing approach based on pre-processing uncertainty assessment.” Neural Comput. Appl. 34 (1): 783–812. https://doi.org/10.1007/s00521-021-06424-6.
Battikha, M. G. 2008. “Reasoning mechanism for construction nonconformance root-cause analysis.” J. Constr. Eng. Manage. 134 (4): 280–288. https://doi.org/10.1061/(ASCE)0733-9364(2008)134:4(280).
Benbouras, M. A. 2022. “Hybrid meta-heuristic machine learning methods applied to landslide susceptibility mapping in the Sahel-Algiers.” Int. J. Sediment Res. 37 (5): 601–618. https://doi.org/10.1016/j.ijsrc.2022.04.003.
Białek, J., W. Bujalski, K. Wojdan, M. Guzek, and T. Kurek. 2022. “Dataset level explanation of heat demand forecasting ANN with SHAP.” Energy 261 (Dec): 125075. https://doi.org/10.1016/j.energy.2022.125075.
Bigos, D. 2017. From reactive to proactive quality management with IoT. New York: International Business Machines.
Breiman, L. 2001. “Random forests.” Mach. Learning 45 (Oct): 5–32. https://doi.org/10.1023/A:1010933404324.
Chakraborty, D., H. Elhegazy, H. Elzarka, and L. Gutierrez. 2020. “A novel construction cost prediction model using hybrid natural and light gradient boosting.” Adv. Eng. Inf. 46 (Apr): 101201. https://doi.org/10.1016/j.aei.2020.101201.
Cheng, Y., W. Der Yu, and Q. Li. 2015. “GA-based multi-level association rule mining approach for defect analysis in the construction industry.” Autom. Constr. 51 (3): 78–91. https://doi.org/10.1016/j.autcon.2014.12.016.
Choi, J., B. Gu, S. Chin, and J. S. Lee. 2020. “Machine learning predictive model based on national data for fatal accidents of construction workers.” Autom. Constr. 110 (Sep): 102974. https://doi.org/10.1016/j.autcon.2019.102974.
Cui, Z., B. Huang, H. Dou, G. Tan, S. Zheng, and T. Zhou. 2022. “GSA-ELM: A hybrid learning model for short-term traffic flow forecasting.” IET Intell. Transp. Syst. 16 (1): 41–52. https://doi.org/10.1049/itr2.12127.
Dietrich, B., J. Walther, M. Weigold, and E. Abele. 2020. “Machine learning based very short term load forecasting of machine tools.” Appl. Energy 276 (Feb): 115440. https://doi.org/10.1016/j.apenergy.2020.115440.
Doğan, N. B., B. U. Ayhan, G. Kazar, M. Saygili, Y. E. Ayözen, and O. B. Tokdemir. 2022. “Predicting the cost outcome of construction quality problems using case-based reasoning (CBR).” Buildings 12 (11): 1946. https://doi.org/10.3390/buildings12111946.
Ekmekcioğlu, Ö., and K. Koc. 2022. “Explainable step-wise binary classification for the susceptibility assessment of geo-hydrological hazards.” Catena 216 (Feb): 106379. https://doi.org/10.1016/j.catena.2022.106379.
Ekmekcioğlu, Ö., K. Koc, M. Özger, and Z. Işık. 2022. “Exploring the additional value of class imbalance distributions on interpretable flash flood susceptibility prediction in the Black Warrior River basin, Alabama, United States.” J. Hydrol. 610 (Mar): 127877. https://doi.org/10.1016/j.jhydrol.2022.127877.
El-Hamrawy, S. A. K., A. E. A. El-Maaty, and A. Y. Akal. 2017. “Proposed models to measure the quality of highway projects regression analysis vs statistical–Fuzzy approach.” Eng. Constr. Archit. Manage. 24 (6): 988–1003. https://doi.org/10.1108/ECAM-06-2016-0134.
Elsherbiny, A. 2021. Prediction of design error rework cost in EPC industrial projects. Washington, DC: George Washington Univ.
Fan, C.-L. 2020. “Defect risk assessment using a hybrid machine learning method.” J. Constr. Eng. Manage. 146 (9): 04020102. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001897.
Fatahi, R., H. Nasiri, E. Dadfar, and S. Chehreh Chelgani. 2022. “Modeling of energy consumption factors for an industrial cement vertical roller mill by SHAP-XGBoost: A ‘conscious lab’ approach.” Sci. Rep. 12 (1): 7543. https://doi.org/10.1038/s41598-022-11429-9.
Forcada, N., M. Gangolells, M. Casals, and M. Macarulla. 2017. “Factors affecting rework costs in construction.” J. Constr. Eng. Manage. 143 (8): 04017032. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001324.
Fryer, D., I. Strumke, and H. Nguyen. 2021. “Shapley values for feature selection: The good, the bad, and the axioms.” IEEE Access 9 (Mar): 144352–144360. https://doi.org/10.1109/ACCESS.2021.3119110.
Garg, S., and S. Misra. 2021. “Causal model for rework in building construction for developing countries.” J. Build. Eng. 43 (Aug): 103180. https://doi.org/10.1016/j.jobe.2021.103180.
Garg, S., and S. Misra. 2022. “Understanding the components and magnitude of the cost of quality in building construction.” Eng. Constr. Archit. Manage. 29 (1): 26–48. https://doi.org/10.1108/ECAM-08-2020-0642.
Ghorbani, R., and R. Ghousi. 2020. “Comparing different resampling methods in predicting students’ performance using machine learning techniques.” IEEE Access 8 (Dec): 67899–67911. https://doi.org/10.1109/ACCESS.2020.2986809.
Hengl, T., M. Nussbaum, M. N. Wright, G. B. M. Heuvelink, and B. Gräler. 2018. “Random forest as a generic framework for predictive modeling of spatial and spatio-temporal variables.” PeerJ 6 (Jul): e5518. https://doi.org/10.7717/peerj.5518.
Heravi, G., and A. Jafari. 2014. “Cost of quality evaluation in mass-housing projects in developing countries.” J. Constr. Eng. Manage. 140 (5): 4014004. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000837.
Jaafari, A., M. A. Chan, and R. Cassab. 1994. “Quality management in the Australian construction industry.” In Proc., National Construction and Management Conf., 89–112. Kensington, NSW, Australia: Institution of Engineers, Australia.
Ji, W., and S. M. AbouRizk. 2018. “Data-driven simulation model for quality-induced rework cost estimation and control using absorbing Markov chains.” J. Constr. Eng. Manage. 144 (8): 04018078. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001534.
Jingmond, M., and R. Ågren. 2015. “Unravelling causes of defects in construction.” Constr. Innov. 15 (2): 198–218. https://doi.org/10.1108/CI-04-2014-0025.
Josephson, P.-E., and Y. Hammarlund. 1999. “The causes and costs of defects in construction.” Autom. Constr. 8 (6): 681–687. https://doi.org/10.1016/S0926-5805(98)00114-9.
Kang, K., and H. Ryu. 2019. “Predicting types of occupational accidents at construction sites in Korea using random forest model.” Saf. Sci. 120 (Jun): 226–236. https://doi.org/10.1016/j.ssci.2019.06.034.
Kazar, G., N. B. Doğan, B. U. Ayhan, and O. B. Tokdemir. 2022. “Quality failures–Based critical cost impact factors: Logistic regression analysis.” J. Constr. Eng. Manage. 148 (12): 04022138. https://doi.org/10.1061/(ASCE)CO.1943-7862.0002412.
Kazaz, A., M. T. Birgonul, and S. Ulubeyli. 2005. “Cost-based analysis of quality in developing countries: A case study of building projects.” Build. Environ. 40 (10): 1356–1365. https://doi.org/10.1016/j.buildenv.2004.11.010.
Khajehzadeh, M., M. R. Taha, and M. Eslami. 2013. “Efficient gravitational search algorithm for optimum design of retaining walls.” Struct. Eng. Mech. 45 (1): 111–127. https://doi.org/10.12989/sem.2013.45.1.111.
Koc, K. 2023. “Role of Shapley additive explanations and resampling algorithms for contract failure prediction of public–private partnership projects.” J. Manage. Eng. 39 (5): 04023031. https://doi.org/10.1061/JMENEA.MEENG-5492.
Koc, K., Ö. Ekmekcioğlu, and A. P. Gurgun. 2021. “Integrating feature engineering, genetic algorithm and tree-based machine learning methods to predict the post-accident disability status of construction workers.” Autom. Constr. 131 (Jul): 103896. https://doi.org/10.1016/j.autcon.2021.103896.
Koc, K., Ö. Ekmekcioğlu, and A. P. Gurgun. 2022. “Prediction of construction accident outcomes based on an imbalanced dataset through integrated resampling techniques and machine learning methods.” Eng. Constr. Archit. Manage. 2022 (Jun): 23. https://doi.org/10.1108/ECAM-04-2022-0305.
Koc, K., Ö. Ekmekcioğlu, and A. P. Gurgun. 2023. “Developing a national data-driven construction safety management framework with interpretable fatal accident prediction.” J. Constr. Eng. Manage. 149 (4): 04023010. https://doi.org/10.1061/JCEMD4.COENG-12848.
Koc, K., and A. P. Gurgun. 2022. “Scenario-based automated data preprocessing to predict severity of construction accidents.” Autom. Constr. 140 (May): 104351. https://doi.org/10.1016/j.autcon.2022.104351.
Kumar, Y., and G. Sahoo. 2014. “A review on gravitational search algorithm and its applications to data clustering & classification.” Int. J. Intell. Syst. Appl. 6 (6): 79–93. https://doi.org/10.5815/ijisa.2014.06.09.
Lalwani, P., M. K. Mishra, J. S. Chadha, and P. Sethi. 2022. “Customer churn prediction system: A machine learning approach.” Computing 104 (2): 271–294. https://doi.org/10.1007/s00607-021-00908-y.
Lin, C. L., and C. L. Fan. 2019. “Evaluation of CART, CHAID, and QUEST algorithms: A case study of construction defects in Taiwan.” J. Asian Archit. Build. Eng. 18 (6): 539–553. https://doi.org/10.1080/13467581.2019.1696203.
Lin, Y., K. Zhou, and J. Li. 2018. “Prediction of slope stability using four supervised learning methods.” IEEE Access 6 (8): 31169–31179. https://doi.org/10.1109/ACCESS.2018.2843787.
Liu, Q., G. Ye, Y. Feng, C. Wang, and Y. Peng. 2020. “Case-based insights into rework costs of residential building projects in China.” Int. J. Constr. Manage. 20 (4): 347–355. https://doi.org/10.1080/15623599.2018.1484856.
Love, P., and D. J. Edwards. 2004. “Forensic project management: The underlying causes of rework in construction projects.” Civ. Eng. Environ. Syst. 21 (3): 207–228. https://doi.org/10.1080/10286600412331295955.
Love, P. E. D., D. J. Edwards, H. Watson, and P. Davis. 2010. “Rework in civil infrastructure projects: Determination of cost predictors.” J. Constr. Eng. Manage. 136 (3): 275–282. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000136.
Love, P. E. D., and H. Li. 2000. “Quantifying the causes and costs of rework in construction.” Constr. Manage. Econ. 18 (4): 479–490. https://doi.org/10.1080/01446190050024897.
Love, P. E. D., J. Matthews, M. C. P. Sing, S. R. Porter, and W. Fang. 2022. “State of science: Why does rework occur in construction? What are its consequences? And what can be done to mitigate its occurrence?” Engineering 18 (Nov): 246–258 https://doi.org/10.1016/j.eng.2022.05.010.
Love, P. E. D., and J. Smith. 2018. “Unpacking the ambiguity of rework in construction: Making sense of the literature.” Civ. Eng. Environ. Syst. 35 (1–4): 180–203. https://doi.org/10.1080/10286608.2019.1577396.
Love, P. E. D., and P. Teo. 2017. “Statistical analysis of injury and nonconformance frequencies in construction: Negative binomial regression model.” J. Constr. Eng. Manage. 143 (8): 05017011. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001326.
Love, P. E. D., P. Teo, and J. Morrison. 2018. “Revisiting quality failure costs in construction.” J. Constr. Eng. Manage. 144 (2): 05017020. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001427.
Mikkelsen, M. F. 2021. “Perceived project complexity: A survey among practitioners of project management.” Int. J. Manage. Project Bus. 14 (3): 680–698. https://doi.org/10.1108/IJMPB-03-2020-0095.
Mostofi, F., V. Toğan, Y. E. Ayözen, and O. Behzat Tokdemir. 2022. “Predicting the impact of construction rework cost using an ensemble classifier.” Sustainability 14 (22): 14800. https://doi.org/10.3390/su142214800.
Ning, Y., M. E. H. Ong, B. Chakraborty, B. A. Goldstein, D. S. W. Ting, R. Vaughan, and N. Liu. 2022. “Shapley variable importance cloud for interpretable machine learning.” Patterns 3 (4): 100452. https://doi.org/10.1016/j.patter.2022.100452.
Niu, W., Z. Feng, Y. Chen, H. Zhang, and C. Cheng. 2020. “Annual streamflow time series prediction using extreme learning machine based on gravitational search algorithm and variational mode decomposition.” J. Hydrol. Eng. 25 (5): 04020008. https://doi.org/10.1061/(ASCE)HE.1943-5584.0001902.
Özger, M., U. Serencam, Ö. Ekmekcioğlu, and E. E. Başakın. 2022. “Determining the water level fluctuations of Lake Van through the integrated machine learning methods.” Int. J. Global Warming 27 (2): 123. https://doi.org/10.1504/IJGW.2022.123278.
Pal, M. 2005. “Random forest classifier for remote sensing classification.” Int. J. Remote Sens. 26 (1): 217–222. https://doi.org/10.1080/01431160412331269698.
Park, J., W. H. Lee, K. T. Kim, C. Y. Park, S. Lee, and T.-Y. Heo. 2022. “Interpretation of ensemble learning to predict water quality using explainable artificial intelligence.” Sci. Total Environ. 832 (5): 155070. https://doi.org/10.1016/j.scitotenv.2022.155070.
Project Management Institute. 2017. A guide to the project management body of knowledge (PMBOK guide). Newton Square, PA: Project Management Institute.
Ransom, K. M., B. T. Nolan, P. E. Stackelberg, K. Belitz, and M. S. Fram. 2021. “Machine learning predictions of nitrate in groundwater used for drinking supply in the conterminous United States.” Sci. Total Environ. 40 (Jun): 151065. https://doi.org/10.1016/j.scitotenv.2021.151065.
Rashedi, E., H. Nezamabadi-pour, and S. Saryazdi. 2009. “GSA: A gravitational search algorithm.” Inf. Sci. 179 (13): 2232–2248. https://doi.org/10.1016/j.ins.2009.03.004.
Sarafrazi, S., H. Nezamabadi-pour, M. Barahman, N. Barsoum, J. F. Webb, and P. Vasant. 2011. “A GSA-SVM hybrid system for classification of binary problems.” In Proc., 4th Global Conf. Power Control Opination, 198–203. Melville, NY: American Institute of Physics.
Sarkar, S., and J. Maiti. 2020. “Machine learning in occupational accident analysis: A review using science mapping approach with citation network analysis.” Saf. Sci. 131 (Jun): 104900. https://doi.org/10.1016/j.ssci.2020.104900.
Schultz, C. S., K. Jørgensen, S. Bonke, and G. M. G. Rasmussen. 2015. “Building defects in Danish construction: Project characteristics influencing the occurrence of defects at handover.” Archit. Eng. Des. Manage. 11 (6): 423–439. https://doi.org/10.1080/17452007.2014.990352.
Shapley, L. S. 1953. “A value for n-person games.” In Contributions to the theory of games, 307–317. Wuhan, China: Scientific Research Publishing.
Sharma, V., M. Zaki, K. N. Jha, and N. M. A. Krishnan. 2022. “Machine learning-aided cost prediction and optimization in construction operations.” Eng. Constr. Archit. Manage. 29 (3): 1241–1257. https://doi.org/10.1108/ECAM-10-2020-0778.
Trach, R., M. Lendo-Siwicka, K. Pawluk, and M. Połoński. 2021. “Analysis of direct rework costs in Ukrainian construction.” Arch. Civ. Eng. 67 (2): 397–411. https://doi.org/10.24425/ace.2021.137175.
Wanberg, J., C. Harper, M. R. Hallowell, and S. Rajendran. 2013. “Relationship between construction safety and quality performance.” J. Constr. Eng. Manage. 139 (10): 04013003. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000732.
Wang, D., J. Fan, H. Fu, and B. Zhang. 2018. “Research on optimization of big data construction engineering quality management based on RnN-LSTM.” Complexity 2018 (Jul): 5. https://doi.org/10.1155/2018/9691868.
Wang, Q., Z. Luo, J. Huang, Y. Feng, and Z. Liu. 2017. “A novel ensemble method for imbalanced data learning: Bagging of extrapolation-SMOTE SVM.” Comput. Intell. Neurosci. 1 (Jul): 1–11. https://doi.org/10.1155/2017/1827016.
Yap, J. B. H., P. L. Low, and C. Wang. 2017. “Rework in Malaysian building construction: Impacts, causes and potential solutions.” J. Eng. Des. Technol. 15 (5): 591–618. https://doi.org/10.1108/JEDT-01-2017-0002.
Ye, G., Z. Jin, B. Xia, and M. Skitmore. 2015. “Analyzing causes for reworks in construction projects in China.” J. Manage. Eng. 31 (6): 04014097. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000347.
Yue, X., and H. Zhang. 2020. “Modified hybrid bat algorithm with genetic crossover operation and smart inertia weight for multilevel image segmentation.” Appl. Soft Comput. J. 90 (Aug): 106157. https://doi.org/10.1016/j.asoc.2020.106157.
Information & Authors
Information
Published In
Journal of Construction Engineering and Management
Volume 150 • Issue 1 • January 2024
Copyright
© 2023 American Society of Civil Engineers.
History
Received: Apr 10, 2023
Accepted: Sep 8, 2023
Published online: Oct 24, 2023
Published in print: Jan 1, 2024
Discussion open until: Mar 24, 2024
ASCE Technical Topics:
- Algorithms
- Artificial intelligence and machine learning
- Benefit cost ratios
- Business management
- Computer programming
- Computing in civil engineering
- Construction costs
- Construction engineering
- Construction equipment
- Construction management
- Engineering fundamentals
- Equipment and machinery
- Financial management
- Mathematics
- Personnel management
- Practice and Profession
- Productivity
- Project management
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited by
- Fatemeh Mostofi, Onur Behzat Tokdemir, Vedat Toğan, David Arditi, Predicting the Cost of Rework in High-Rise Buildings Using Graph Convolutional Networks, Journal of Construction Engineering and Management, 10.1061/JCEMD4.COENG-14739, 150, 8, (2024).