Technical Papers
Jan 24, 2023

Ensemble Learning Methods for Shear Strength Prediction of Fly Ash-Amended Soils with Lignin Reinforcement

Publication: Journal of Materials in Civil Engineering
Volume 35, Issue 4

Abstract

For industrial applications in cold regions, a fly ash-amended soil with lignin reinforcement is introduced here. Predictive models were developed for soil shear strength based on two ensemble learning algorithms, to facilitate understanding soil properties with limited prior knowledge. First, over 270 unconsolidated undrained triaxial tests were conducted on the stabilized soil with varying soil moisture contents, percent lignin fiber, confining pressures, and curing conditions (uncured, 15 days curing, and 15 days curing along with freeze-thaw actions). Extreme gradient boosting (XGBoost) and random forest (RF) were then applied to develop the predictive models for the specimens. A parallel genetic algorithm optimized the hyperparameters of both the XGBoost- and RF-based models. Next, monotonicity and sensitivity analyses were carried out with these models, to compare and assess their generalization capabilities. Finally, the peak shear strengths of the specimens finally correlated across different curing conditions. Given different training sample sizes, the XGBoost-based model consistently outperformed the RF-based model, particularly when half of the samples were fed as input. The root-mean-squared error (RMSE), mean absolute percentage error (MAPE), and coefficient of determination (R2) values of the XGBoost-based model on the test set are approximately 105135, 5%7%, and 0.85, respectively. Some essential features that are overlooked by conventional analysis have been identified with ensemble learning. This study demonstrates the potential of ensemble methods to tackle regression and prediction issues arising in civil engineering with less experimental data.

Get full access to this article

View all available purchase options and get full access to this article.

Data Availability Statement

All data, models, and code generated or used during the study appear in the published article.

Acknowledgments

This work was supported by the National Natural Science Foundation of China (Grant Nos. 41901073 and 52078435), the Sichuan Science and Technology Program (Grant No. 2021YJ0001), and the Key Laboratory of Mechanical Behavior Evolution and Control of Traffic Engineering Structures in Hebei (Grant No. SZ2022-03).

References

Alibrahim, H., and S. A. Ludwig. 2021. “Hyperparameter optimization: Comparing genetic algorithm against grid search and Bayesian optimization.” In Proc., 2021 IEEE Congress on Evolutionary Computation, 551–559. New York: IEEE.
Andersland, O. B., and B. Ladanyi. 2003. Frozen ground engineering. Hoboken, NJ: Wiley.
ASTM. 2011. Standard practice for classification of soils for engineering purposes (unified soil classification system). ASTM D2487. West Conshohocken, PA: ASTM.
Bin-Shafique, S., K. Rahman, and I. Azfar. 2012. “The effect of freezing-thawing cycles on performance of fly ash stabilized expansive soil subbases.” In Proc., Geo-Frontiers 2011: Advances in Geotechnical Engineering, 697–706. Reston, VA: ASCE. https://doi.org/10.1061/41165(397)72.
Breiman, L. 1996. “Bagging predictors.” Mach. Learn. 24 (2): 123–140. https://doi.org/10.1007/BF00058655.
Breiman, L. 2001. “Random forests.” Mach. Learn. 45 (1): 5–32. https://doi.org/10.1023/A:1010933404324.
Chen, Q., B. Indraratna, J. Carter, and C. Rujikiatkamjorn. 2014. “A theoretical and experimental study on the behaviour of lignosulfonate-treated sandy silt.” Comput. Geotech. 61 (Sep): 316–327. https://doi.org/10.1016/j.compgeo.2014.06.010.
Chen, T., and C. Guestrin. 2016. “XGBoost: A scalable tree boosting system.” In Proc., 22nd ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining, 785–794. New York: Association for Computing Machinery.
Dietterich, T. G. 2000. “An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization.” Mach. Learn. 40 (2): 139–157. https://doi.org/10.1023/A:1007607513941.
Franklin, J. 2005. “The elements of statistical learning: Data mining, inference and prediction.” Math. Intelligencer 27 (2): 83–85. https://doi.org/10.1007/BF02985802.
Goldberg, D. E., and J. H. Holland. 1988. “Genetic algorithms and machine learning.” Mach. Learn. 3 (2): 95–99. https://doi.org/10.1023/A:1022602019183.
Ho, T. K. 1998. “The random subspace method for constructing decision forests.” IEEE Trans. Pattern Anal. Mach. Intell. 20 (8): 832–844. https://doi.org/10.1109/34.709601.
Indraratna, B., R. Athukorala, and J. Vinod. 2013. “Estimating the rate of erosion of a silty sand treated with lignosulfonate.” J. Geotech. Geoenviron. Eng. 139 (5): 701–714. https://doi.org/10.1061/(ASCE)GT.1943-5606.0000766.
Jiang, H., Z. He, G. Ye, and H. Zhang. 2020. “Network intrusion detection based on PSO-Xgboost model.” IEEE Access 8 (Apr): 58392–58401. https://doi.org/10.1109/ACCESS.2020.2982418.
Kohavi, R. 1995. “A study of cross-validation and bootstrap for accuracy estimation and model selection.” In Proc., Int. Joint Conf. on Artificial Intelligence, 1137–1143. San Mateo, CA: Morgan Kaufmann.
Lessmann, S., B. Baesens, H.-V. Seow, and L. C. Thomas. 2015. “Benchmarking state-of-the-art classification algorithms for credit scoring: An update of research.” Eur. J. Oper. Res. 247 (1): 124–136. https://doi.org/10.1016/j.ejor.2015.05.030.
Lin, S., H. Zheng, B. Han, Y. Li, C. Han, and W. Li. 2022. “Comparative performance of eight ensemble learning approaches for the development of models of slope stability prediction.” Acta Geotech. 17 (4): 1477–1502. https://doi.org/10.1007/s11440-021-01440-1.
Lu, Z., S. Xian, H. Yao, R. Fang, and J. She. 2019. “Influence of freeze-thaw cycles in the presence of a supplementary water supply on mechanical properties of compacted soil.” Cold Reg. Sci. Technol. 157 (Jan): 42–52. https://doi.org/10.1016/j.coldregions.2018.09.009.
Lumb, P. 1970. “Safety factors and the probability distribution of soil strength.” Can. Geotech. J. 7 (3): 225–242. https://doi.org/10.1139/t70-032.
Marinov, D., and D. Karapetyan. 2019. “Hyperparameter optimisation with early termination of poor performers.” In Proc., 2019 11th Computer Science and Electronic Engineering, 160–163. Piscataway, NJ: IEEE.
Olgun, M. 2013. “The effects and optimization of additives for expansive clays under freeze–thaw conditions.” Cold Reg. Sci. Technol. 93 (Sep): 36–46. https://doi.org/10.1016/j.coldregions.2013.06.001.
Orakoglu, M. E., J. Liu, R. Lin, and Y. Tian. 2017. “Performance of clay soil reinforced with fly ash and lignin fiber subjected to freeze-thaw cycles.” J. Cold Reg. Eng. 31 (4): 04017013. https://doi.org/10.1061/(ASCE)CR.1943-5495.0000139.
Rosa, M. G., B. Cetin, T. B. Edil, and C. H. Benson. 2017. “Freeze-thaw performance of fly ash-stabilized materials and recycled pavement materials.” J. Mater. Civ. Eng. 29 (6): 04017015. https://doi.org/10.1061/(ASCE)MT.1943-5533.0001844.
Roustaei, M., A. Eslami, and M. Ghazavi. 2015. “Effects of freeze–thaw cycles on a fiber reinforced fine grained soil in relation to geotechnical parameters.” Cold Reg. Sci. Technol. 120 (Dec): 127–137. https://doi.org/10.1016/j.coldregions.2015.09.011.
Sahlabadi, S. H., M. Bayat, M. Mousivand, and M. Saadat. 2021. “Freeze-thaw durability of cement-stabilized soil reinforced with polypropylene/basalt fibers.” J. Mater. Civ. Eng. 33 (9): 04021232. https://doi.org/10.1061/(ASCE)MT.1943-5533.0003905.
Schapire, R. E., and Y. Singer. 1999. “Improved boosting algorithms using confidence-rated predictions.” Mach. Learn. 37 (3): 297–336. https://doi.org/10.1023/A:1007614523901.
Shen, K., T. De Pessemier, L. Martens, and W. Joseph. 2021. “A parallel genetic algorithm for multi-objective flexible flowshop scheduling in pasta manufacturing.” Comput. Ind. Eng. 161 (Nov): 107659. https://doi.org/10.1016/j.cie.2021.107659.
Stone, M. 1974. “Cross-validatory choice and assessment of statistical predictions.” J. R. Stat. Soc. B 36 (2): 111–133. https://doi.org/10.1111/j.2517-6161.1974.tb00994.x.
Vidal, H. 1969. “The principle of reinforced earth.” Highway Res. Rec. 282 (Jan): 1–16.
Wang, H.-L., and Z.-Y. Yin. 2020. “High performance prediction of soil compaction parameters using multi expression programming.” Eng. Geol. 276 (Oct): 105758. https://doi.org/10.1016/j.enggeo.2020.105758.
Wang, T., Q. Luo, Z. Li, W. Zhang, W. Chen, and L. Wang. 2022a. “System safety assessment with efficient probabilistic stability analysis of engineered slopes along a new rail line.” Bull. Eng. Geol. Environ. 81 (1): 68. https://doi.org/10.1007/s10064-021-02555-1.
Wang, T., H. Ma, K. Liu, Q. Luo, and S. Xiao. 2022b. “Load transfer and performance evaluation of piled beam-supported embankments.” Acta Geotech. https://doi.org/10.1007/s11440-022-01519-3.
Wong, T.-T. 2015. “Performance evaluation of classification algorithms by k-fold and leave-one-out cross validation.” Pattern Recognit. 48 (9): 2839–2846. https://doi.org/10.1016/j.patcog.2015.03.009.
Wu, J., D. Wang, and H. Chen. 2000. “Study on geosynthetic reinforced sand by triaxial compression test.” Chin. J. Geotech. Eng. 22 (2): 199–204.
Wu, Y., Y. Li, and B. Niu. 2014. “Assessment of the mechanical properties of sisal fiber-reinforced silty clay using triaxial shear tests.” Sci. World J. 2014 (Apr): 436231. https://doi.org/10.1155/2014/436231.
Xu, J., Z. Wu, H. Chen, L. Shao, X. Zhou, and S. Wang. 2021. “Triaxial shear behavior of basalt fiber-reinforced loess based on digital image technology.” KSCE J. Civ. Eng. 25 (10): 3714–3726. https://doi.org/10.1007/s12205-021-2034-1.
Yu, Y., and M. Zhang. 2021. “Control chart recognition based on the parallel model of CNN and LSTM with GA optimization.” Expert Syst. Appl. 185 (Dec): 115689. https://doi.org/10.1016/j.eswa.2021.115689.
Zhang, P., Y.-F. Jin, Z.-Y. Yin, and Y. Yang. 2020a. “Random forest based artificial intelligent model for predicting failure envelopes of caisson foundations in sand.” Appl. Ocean Res. 101 (Aug): 102223. https://doi.org/10.1016/j.apor.2020.102223.
Zhang, P., Z.-Y. Yin, Y.-F. Jin, T. H. T. Chan, and F.-P. Gao. 2021a. “Intelligent modelling of clay compressibility using hybrid meta-heuristic and machine learning algorithms.” Geosci. Front. 12 (1): 441–452. https://doi.org/10.1016/j.gsf.2020.02.014.
Zhang, P., Z.-Y. Yin, Y.-F. Jin, and X.-F. Liu. 2022a. “Modelling the mechanical behaviour of soils using machine learning algorithms with explicit formulations.” Acta Geotech. 17 (4): 1403–1422. https://doi.org/10.1007/s11440-021-01170-4.
Zhang, R., C. Wu, A. T. C. Goh, T. Böhlke, and W. Zhang. 2021b. “Estimation of diaphragm wall deflections for deep braced excavation in anisotropic clays using ensemble learning.” Geosci. Front. 12 (1): 365–373. https://doi.org/10.1016/j.gsf.2020.03.003.
Zhang, T., G. Cai, and S. Liu. 2018. “Reclaimed lignin-stabilized silty soil: Undrained shear strength, Atterberg limits, and microstructure characteristics.” J. Mater. Civ. Eng. 30 (11): 04018277. https://doi.org/10.1061/(ASCE)MT.1943-5533.0002492.
Zhang, W., A. Guo, and C. Lin. 2019. “Effects of cyclic freeze and thaw on engineering properties of compacted loess and lime-stabilized loess.” J. Mater. Civ. Eng. 31 (9): 04019205. https://doi.org/10.1061/(ASCE)MT.1943-5533.0002858.
Zhang, W., H. Li, L. Han, L. Chen, and L. Wang. 2022b. “Slope stability prediction using ensemble learning techniques: A case study in Yunyang County, Chongqing, China.” J. Rock Mech. Geotech. Eng. 14 (4): 1089–1099. https://doi.org/10.1016/j.jrmge.2021.12.011.
Zhang, W., Y. Li, C. Wu, H. Li, A. Goh, and H. Liu. 2022c. “Prediction of lining response for twin tunnels constructed in anisotropic clay using machine learning techniques.” Underground Space 7 (1): 122–133. https://doi.org/10.1016/j.undsp.2020.02.007.
Zhang, W., C. Wu, H. Zhong, Y. Li, and L. Wang. 2021c. “Prediction of undrained shear strength using extreme gradient boosting and random forest based on Bayesian optimization.” Geosci. Front. 12 (1): 469–477. https://doi.org/10.1016/j.gsf.2020.03.007.
Zhang, W., R. Zhang, C. Wu, A. T. C. Goh, S. Lacasse, Z. Liu, and H. Liu. 2020b. “State-of-the-art review of soft computing applications in underground excavations.” Geosci. Front. 11 (4): 1095–1106. https://doi.org/10.1016/j.gsf.2019.12.003.
Zhou, J., E. Li, H. Wei, C. Li, Q. Qiao, and D. J. Armaghani. 2019. “Random forests and cubist algorithms for predicting shear strengths of rockfill materials.” Appl. Sci. 9 (8): 1621. https://doi.org/10.3390/app9081621.

Information & Authors

Information

Published In

Go to Journal of Materials in Civil Engineering
Journal of Materials in Civil Engineering
Volume 35Issue 4April 2023

History

Received: Apr 18, 2022
Accepted: Jul 13, 2022
Published online: Jan 24, 2023
Published in print: Apr 1, 2023
Discussion open until: Jun 24, 2023

Permissions

Request permissions for this article.

Authors

Affiliations

Weihang Chen [email protected]
Ph.D. Candidate, School of Civil Engineering, Southwest Jiaotong Univ., Chengdu 610031, China. Email: [email protected]
Graduate Student, School of Civil Engineering, Southwest Jiaotong Univ., Chengdu 610031, China. Email: [email protected]
Lecturer, College of Civil Engineering, Fujian Univ. of Technology, Fuzhou 350118, China. Email: [email protected]
Professor, School of Civil Engineering, Southwest Jiaotong Univ., Chengdu 610031, China; Key Laboratory of High-Speed Railway Engineering, Ministry of Education, Chengdu 610031, China. Email: [email protected]
Associate Professor, School of Civil Engineering, Southwest Jiaotong Univ., 111 1st Section N, 2nd Ring Rd., Chengdu 610031, China; Key Laboratory of High-Speed Railway Engineering, Ministry of Education, Chengdu 610031, China (corresponding author). ORCID: https://orcid.org/0000-0003-4079-0687. Email: [email protected]

Metrics & Citations

Metrics

Citations

Download citation

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

View Options

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share