Estimating Output Variance of a Regressing Tree Model: A Case Study of Concrete Strength Prediction
Publication: Computing in Civil Engineering 2023
ABSTRACT
Model trees combine the strengths of two interpretable models—namely, decision trees and multiple linear regression—to handle complex nonlinear problems, making them a popular machine learning strategy in civil engineering. Analyzing the error terms between predicted and target outputs is the standard method for evaluating the model’s accuracy. However, the model does not explain the variance associated with the predicted output for a given set of inputs, which may be deemed insufficient in many civil engineering applications. This research proposes a framework that combines error propagation theory with the model tree algorithm to quantify the variance of the model predicted output and provide explainable artificial intelligence (XAI) for engineering applications. A metric based on the variance estimate is proposed to decide whether the model predicted output is acceptable. A concrete strength prediction model is presented to demonstrate the application of the proposed methodology.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Alexander, M. (2020). “Probability and Statistics for Data Sciences: Math + R + Data.” J. of Qual. Tech., 52(4), 428–430.
Belle, V., and Papantonis, I. (2021). Principles and Practice of Explainable Machine Learning. Frontiers in Big Data. Frontiers Media S.A.
Deepa, C., SathiyaKumari, K., and Sudha, V. P. (2010). “Prediction of the compressive strength of high performance concrete mix using tree based modeling.” Int. J. of Com. Appl., 6(5), 18–24.
Frank, E., Wang, Y., Inglis, S., Holmes, G., and Witten, I. H. (1998). “Using model trees for classification.” Machine Learning, 32(1), 63–76.
Frank, E., Hall, M. A., and Witten, I. H. (2016). The WEKA Workbench. Online Appendix for Data Mining: Practical Machine Learning Tools and Techniques, Morgan Kaufmann, Fourth Edition, 2016.
Hasan, M., and Lu, M. (2022). “Variance Analysis on Regression Models for Estimating Labor Costs of Prefabricated Components.” J. of Com. in Civil Eng., 36(5), 04022019.
Huang, Y., Li, J., and Fu, J. (2019). Review on application of artificial intelligence in civil engineering. CMES – Comp. Model. in Eng. and Scien. Tech Science Press.
Kasperkiewicz, J., Racz, J., and Dubrawski, A. (1995). “HPC Strength Prediction Using Artificial Neural Network.” J. of Comp. in Civil Eng., 9(4), 279–284.
Mohsenijam, A., Lu, M., and Naumets, S. (2022). “Integrating model tree and modified stepwise regression in concrete slump prediction and steel fabrication estimating.” Can. J. of Civil Eng., 49(4), 478–486.
Najafzadeh, M., Laucelli, D. B., and Zahiri, A. (2017). “Application of model tree and evolutionary polynomial regression for evaluation of sediment transport in pipes.” KSCE J. of Civil Eng., 21, 1956–1963.
Quinlan, J. R. (1992). “Learning with continuous classes. Learning with Continuous Classes.” In: 5th Australian Joint Conference on Artificial Intelligence, Singapore, 343–348.
Taghi Sattari, M., Pal, M., Apaydin, H., and Ozturk, F. (2013). “M5 model tree application in daily river flow forecasting in Sohu Stream, Turkey.” Water Resources, 40(3), 233–242.
UCI (University of California, Irvine). (2020). “Concrete compressive strength data set.” Accessed March 2, 2023. https://archive.ics.uci.edu/ml/datasets/Concrete+Compressive+Strength.
Yu, L., Lai, K. K., Wang, S., and Huang, W. (2006). A bias-variance-complexity trade-off framework for complex system modeling. In Lec.Notes in Comp. Sci. 3980, 518–527. Springer Verlag.
Information & Authors
Information
Published In
Computing in Civil Engineering 2023
Pages: 908 - 916
History
Published online: Jan 25, 2024
ASCE Technical Topics:
- Artificial intelligence and machine learning
- Case studies
- Computer programming
- Computing in civil engineering
- Concrete
- Ecosystems
- Engineering fundamentals
- Engineering materials (by type)
- Environmental engineering
- Errors (statistics)
- Linear functions
- Material mechanics
- Material properties
- Materials engineering
- Mathematical functions
- Mathematics
- Methodology (by type)
- Model accuracy
- Models (by type)
- Research methods (by type)
- Statistics
- Strength of materials
- Trees
- Vegetation
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.