Applying Knowledge-Guided Machine Learning to Slope Stability Prediction
This article has a reply.
VIEW THE REPLYThis article has a reply.
VIEW THE REPLYPublication: Journal of Geotechnical and Geoenvironmental Engineering
Volume 149, Issue 10
Abstract
Slope stability prediction is an important task in geotechnical engineering which can be achieved through physics-based or data-driven approaches. Physics-based approaches rely on geotechnical knowledge from soil mechanics, such as limit equilibrium analysis and shear strength theories, to evaluate the stability condition of slopes, and they are often limited to slope-specific analysis. Data-driven approaches predict slope stability conditions based on learned relationships between influencing factors and slope stability conditions from past observations of slope failures (i.e., case histories); they rely on big data which are difficult to obtain. This study examines three easy-to-implement and effective methods to integrate geotechnical engineering domain knowledge into data-driven models for slope stability prediction: hybrid knowledge-data model, knowledge-based model initiation, and knowledge-guided loss function. These models were benchmarked against pure data-driven models and domain knowledge–based models, including a physics-based solution chart and a physics-based empirical model. A compilation of slope stability case histories from the literature was used as the benchmark database, and five-fold cross-validation was employed to evaluate model performance. The model validation results demonstrated that machine learning models outperformed domain knowledge–based models in terms of several evaluation metrics. The three proposed methods were found to outperform both domain knowledge–based models and pure data-driven models. Additionally, the hybrid knowledge-data models and knowledge-guided loss function were found to reduce discrepancies in the predicted slope stability conditions compared with reported factor-of-safety values, leading to a better alignment with the underlying physics related to slope stability. This study provides an initial assessment of the value of coupling domain knowledge and data-driven methods in geotechnical engineering applications using slope stability prediction as an example.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some data, models, or codes that support the findings of this study are available from the corresponding author upon reasonable request. These data include the source code for the present study and the results used to generate all figures and tables.
Acknowledgments
This research was partially supported by Google AI Impacts Challenge Grant 1904-57775. The second and third authors were supported by the US National Science Foundation under Award No. ICER-2022444. This support is gratefully acknowledged.
References
Abimbola, O. P., G. E. Meyer, A. R. Mittelstet, D. R. Rudnick, and T. E. Franz. 2021. “Knowledge-guided machine learning for improving daily soil temperature prediction across the United States.” Vadose Zone J. 20 (5): e20151. https://doi.org/10.1002/vzj2.20151.
Bishop, A. W. 1955. “The use of the slip circle in the stability analysis of slopes.” Géotechnique 5 (1): 7–17. https://doi.org/10.1680/geot.1955.5.1.7.
Bishop, A. W., and N. R. Morgenstern. 1960. “Stability coefficients for earth slopes.” Géotechnique 10 (4): 129–153. https://doi.org/10.1680/geot.1960.10.4.129.
Bolton, M. D. 1986. “The strength and dilatancy of sands.” Géotechnique 36 (1): 65–78. https://doi.org/10.1680/geot.1986.36.1.65.
Bowles, J. E. 1979. Physical and geotechnical properties of soils. New York: McGraw-Hill.
Breiman, L. 2001. “Random forest.” Mach. Learn. 45 (1): 5–32. https://doi.org/10.1023/A:1010933404324.
Bui, M., J. Gör, and K. Foong. 2019. “Predicting slope stability failure through machine learning paradigms.” ISPRS Int. J. Geo-Inf. 8 (9): 395. https://doi.org/10.3390/ijgi8090395.
Burges, C. J. 1998. “A tutorial on support vector machines for pattern recognition.” Data Min. Knowl. Discovery 2 (2): 121–167. https://doi.org/10.1023/A:1009715923555.
Cortes, C., and V. Vapnik. 1995. “Support-vector networks.” Mach. Learn. 20 (3): 273–297. https://doi.org/10.1007/BF00994018.
Cox, D. R. 1958. “The regression analysis of binary sequences.” J. R. Stat. Soc. B 20 (2): 215–232. https://doi.org/10.1111/j.2517-6161.1958.tb00292.x.
Das, S. K., R. K. Biswal, N. Sivakugan, and B. Das. 2011. “Classification of slopes and prediction of factor of safety using differential evolution neural networks.” Environ. Earth Sci. 64 (1): 201–210. https://doi.org/10.1007/s12665-010-0839-1.
Daw, A., A. Karpatne, W. Watkins, J. Read, and V. Kumar. 2017. “Physics-guided neural networks (PGNN): An application in lake temperature modeling.” Preprint, submitted December 9, 2018. https://arxiv.org/abs/1710.11431.
Duncan, J. M. 1996. “State of the art: Limit equilibrium and finite-element analysis of slopes.” J. Geotech. Eng. 122 (7): 577–596. https://doi.org/10.1061/(ASCE)0733-9410(1996)122:7(577).
Erzin, Y., and T. Cetin. 2013. “The prediction of the critical factor of safety of homogeneous finite slopes using neural networks and multiple regressions.” Comput. Geosci. 51 (Feb): 305–313. https://doi.org/10.1016/j.cageo.2012.09.003.
Fang, K., D. Kifer, K. Lawson, and C. Shen. 2020. “Evaluating the potential and challenges of an uncertainty quantification method for long short-term memory models for soil moisture predictions.” Water Resour. Res. 56 (12): e2020WR028095. https://doi.org/10.1029/2020WR028095.
Feng, D., J. Liu, K. Lawson, and C. Shen. 2022. “Differentiable, learnable, regionalized process-based models with multiphysical outputs can approach state-of-the-art hydrologic prediction accuracy.” Water Resour. Res. 58 (10): e2022WR032404. https://doi.org/10.1029/2022WR032404.
Feng, X., S. Li, C. Yuan, P. Zeng, and Y. Sun. 2018. “Prediction of slope stability using naive Bayes classifier.” KSCE J. Civ. Eng. 22 (3): 941–950. https://doi.org/10.1007/s12205-018-1337-3.
Fischer, E. M., and R. Knutti. 2015. “Anthropogenic contribution to global occurrence of heavy precipitation and high-temperature extremes.” Nat. Clim. Change 5 (6): 560–564. https://doi.org/10.1038/nclimate2617.
Fisher, A., C. Rudin, and F. Dominici. 2019. “All models are wrong, but many are useful: Learning a variable’s importance by studying an entire class of prediction models simultaneously.” J. Mach. Learn. Res. 20 (177): 1–81.
Ford, E., K. Maneparambil, A. Kumar, G. Sant, and N. Neithalath. 2022. “Transfer (machine) learning approaches coupled with target data augmentation to predict the mechanical properties of concrete.” Mach. Learn. Appl. 8 (Jun): 100271. https://doi.org/10.1016/j.mlwa.2022.100271.
Gordan, B., D. Jahed Armaghani, M. Hajihassani, and M. Monjezi. 2016. “Prediction of seismic slope stability through combination of particle swarm optimization and neural network.” Eng. Comput. 32 (1): 85–97. https://doi.org/10.1007/s00366-015-0400-7.
Griffiths, D. V., and P. A. Lane. 1999. “Slope stability analysis by finite elements.” Géotechnique 49 (3): 387–403. https://doi.org/10.1680/geot.1999.49.3.387.
Grover, A., A. Kapoor, and E. Horvitz. 2015. “A deep hybrid model for weather forecasting.” In Proc., 21st ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining. New York: Association for Computing Machinery.
Hoang, N.-D., and A.-D. Pham. 2016. “Hybrid artificial intelligence approach based on metaheuristic and machine learning for slope stability assessment: A multinational data analysis.” Expert Syst. Appl. 46 (Mar): 60–68. https://doi.org/10.1016/j.eswa.2015.10.020.
Jia, X., J. Willard, A. Karpatne, J. S. Read, J. A. Zwart, M. Steinbach, and V. Kumar. 2021. “Physics-guided machine learning for scientific discovery: An application in simulating lake temperature profiles.” ACM/IMS Trans. Data Sci. 2 (3): 1–26. https://doi.org/10.1145/3447814.
Karpatne, A., G. Atluri, J. H. Faghmous, M. Steinbach, A. Banerjee, A. Ganguly, S. Shekhar, N. Samatova, and V. Kumar. 2017. “Theory-guided data science: A new paradigm for scientific discovery from data.” IEEE Trans. Knowl. Data Eng. 29 (10): 2318–2331. https://doi.org/10.1109/TKDE.2017.2720168.
Karpatne, A., R. Kannan, and V. Kumar. 2022. Knowledge guided machine learning: Accelerating discovery using scientific knowledge and data. Boca Raton, FL: CRC Press.
Kirschbaum, D. B., R. Adler, Y. Hong, S. Hill, and A. Lerner-Lam. 2010. “A global landslide catalog for hazard applications: Method, results, and limitations.” Nat. Hazards 52 (3): 561–575. https://doi.org/10.1007/s11069-009-9401-4.
Kuhn, M., and K. Johnson. 2013. Applied predictive modeling. New York: Springer.
LeCun, Y., Y. Bengio, and G. Hinton. 2015. “Deep learning.” Nature 521 (7553): 436–444. https://doi.org/10.1038/nature14539.
Li, J., and F. Wang. 2010. “Study on the forecasting models of slope stability under data mining.” In Proc., Earth and Space 2010: Engineering, Science, Construction, and Operations in Challenging Environments. Reston, VA: ASCE.
Lin, S., H. Zheng, B. Han, Y. Li, C. Han, and W. Li. 2022. “Comparative performance of eight ensemble learning approaches for the development of models of slope stability prediction.” Acta Geotech. 17 (4): 1477–1502. https://doi.org/10.1007/s11440-021-01440-1.
Lin, Y., K. Zhou, and J. Li. 2018. “Prediction of slope stability using four supervised learning methods.” IEEE Access 6 (Jun): 31169–31179. https://doi.org/10.1109/ACCESS.2018.2843787.
Liu, L., et al. 2022. “KGML-AG: A modeling framework of knowledge-guided machine learning to simulate agroecosystems: A case study of estimating emission using data from MESOCOSM experiments.” Geosci. Model Dev. 15 (7): 2839–2858. https://doi.org/10.5194/gmd-15-2839-2022.
Liu, X., X. Han, N. Zhang, and Q. Liu. 2020. “Certified monotonic neural networks.” In Vol. 33 of Proc., Advances in Neural Information Processing Systems, 15427–15438. Red Hook, NY: Curran Associates.
Liu, Z., J. Shao, W. Xu, H. Chen, and Y. Zhang. 2014. “An extreme learning machine approach for slope stability evaluation and prediction.” Nat. Hazards 73 (2): 787–804. https://doi.org/10.1007/s11069-014-1106-7.
Lu, N., B. Şener-Kaya, A. Wayllace, and J. W. Godt. 2012. “Analysis of rainfall-induced slope instability using a field of local factor of safety.” Water Resour. Res. 48 (9): W09524. https://doi.org/10.1029/2012WR011830.
Ma, K., D. Feng, K. Lawson, W.-P. Tsai, C. Liang, X. Huang, A. Sharma, and C. Shen. 2021. “Transferring hydrologic data across continents–leveraging data-rich regions to improve hydrologic prediction in data-sparse regions.” Water Resour. Res. 57 (5): e2020WR028600. https://doi.org/10.1029/2020WR028600.
Mahmoodzadeh, A., M. Mohammadi, H. Farid Hama Ali, H. Hashim Ibrahim, S. Nariman Abdulhamid, and H. R. Nejati. 2021. “Prediction of safety factors for slope stability: Comparison of machine learning techniques.” Nat. Hazards 111 (Nov): 1771–1799. https://doi.org/10.1007/s11069-021-05115-8.
Manouchehrian, A., J. Gholamnejad, and M. Sharifzadeh. 2014. “Development of a model for analysis of slope stability for circular mode failure using genetic algorithm.” Environ. Earth Sci. 71 (3): 1267–1277. https://doi.org/10.1007/s12665-013-2531-8.
Mentch, L., and G. Hooker. 2016. “Quantifying uncertainty in random forests via confidence intervals and hypothesis tests.” J. Mach. Learn. Res. 17 (1): 841–881.
Michalowski, R. L. 2002. “Stability charts for uniform slopes.” J. Geotech. Geoenviron. Eng. 128 (4): 351–355. https://doi.org/10.1061/(ASCE)1090-0241(2002)128:4(351).
Michalowski, R. L. 2010. “Limit analysis and stability charts for 3D slope failures.” J. Geotech. Geoenviron. Eng. 136 (4): 583–593. https://doi.org/10.1061/(ASCE)GT.1943-5606.0000251.
Morgenstern, N. R., and V. E. Price. 1965. “The analysis of the stability of general slip surfaces.” Géotechnique 15 (1): 79–93. https://doi.org/10.1680/geot.1965.15.1.79.
Natekin, A., and A. Knoll. 2013. “Gradient boosting machines, a tutorial.” Front. Neurorob. 7 (Dec): 21. https://doi.org/10.3389/fnbot.2013.00021.
Pan, S. J., and Q. Yang. 2010. “A survey on transfer learning.” IEEE Trans. Knowl. Data Eng. 22 (10): 1345–1359. https://doi.org/10.1109/TKDE.2009.191.
Paszke, A., et al. 2019. “PyTorch: An imperative style, high-performance deep learning library.” In Vol. 32 of Proc., Advances in Neural Information Processing Systems, 8024–8035. Red Hook, NY: Curran Associates.
Pawar, S., O. San, B. Aksoylu, A. Rasheed, and T. Kvamsdal. 2021. “Physics guided machine learning using simplified theories.” Phys. Fluids 33 (1): 011701. https://doi.org/10.1063/5.0038929.
Pedregosa, F., et al. 2011. “Scikit-learn: Machine learning in Python.” J. Mach. Learn. Res. 12 (85): 2825–2830.
Qi, C., and X. Tang. 2018. “A hybrid ensemble method for improved prediction of slope stability.” Int. J. Numer. Anal. Methods Geomech. 42 (15): 1823–1839. https://doi.org/10.1002/nag.2834.
Rackauckas, C., Y. Ma, J. Martensen, C. Warner, K. Zubov, R. Supekar, D. Skinner, A. Ramadhan, and A. Edelman. 2020. “Universal differential equations for scientific machine learning.” Preprint, submitted March 9, 2020. https://arxiv.org/abs/2001.04385.
Rai, R., and C. K. Sahu. 2020. “Driven by data or derived through physics? A review of hybrid physics guided machine learning techniques with cyber-physical system (CPS) focus.” IEEE Access 8 (Apr): 71050–71073. https://doi.org/10.1109/ACCESS.2020.2987324.
Read, J. S., et al. 2019. “Process-guided deep learning predictions of lake water temperature.” Water Resour. Res. 55 (11): 9173–9190. https://doi.org/10.1029/2019WR024922.
Sah, N. K., P. R. Sheorey, and L. N. Upadhyaya. 1994. “Maximum likelihood estimation of slope stability.” Int. J. Rock Mech. Min. Sci. Geomech. Abstr. 31 (1): 47–53. https://doi.org/10.1016/0148-9062(94)92314-0.
Sakellariou, M. G., and M. D. Ferentinou. 2005. “A study of slope stability prediction using neural networks.” Geotech. Geol. Eng. 23 (4): 419–445. https://doi.org/10.1007/s10706-004-8680-5.
Sokolova, M., and G. Lapalme. 2009. “A systematic analysis of performance measures for classification tasks.” Inf. Process. Manage. 45 (4): 427–437. https://doi.org/10.1016/j.ipm.2009.03.002.
Spencer, E. 1968. “A method of analysis of the stability of embankments assuming parallel inter-slice forces.” Géotechnique 18 (3): 384–386. https://doi.org/10.1680/geot.1968.18.3.384.
Stone, M. 1974. “Cross-validatory choice and assessment of statistical predictions.” J. R. Stat. Soc. B 36 (2): 111–133. https://doi.org/10.1111/j.2517-6161.1974.tb00994.x.
Sun, J., and Z. Zhao. 2013. “Stability charts for homogenous soil slopes.” J. Geotech. Geoenviron. Eng. 139 (12): 2212–2218. https://doi.org/10.1061/(ASCE)GT.1943-5606.0000938.
Tajbakhsh, N., J. Y. Shin, S. R. Gurudu, R. T. Hurst, C. B. Kendall, M. B. Gotway, and J. Liang. 2016. “Convolutional neural networks for medical image analysis: Full training or fine tuning?” IEEE Trans. Med. Imaging 35 (5): 1299–1312. https://doi.org/10.1109/TMI.2016.2535302.
Tan, C., F. Sun, T. Kong, W. Zhang, C. Yang, and C. Liu. 2018. “A survey on deep transfer learning.” In Proc., Artificial Neural Networks and Machine Learning–ICANN 2018: 27th Int. Conf. on Artificial Neural Networks, 270–279. Cham, Switzerland: Springer.
Taylor, D. W. 1937. “Stability of earth slopes.” J. Boston Soc. Civ. Eng. 24 (3): 197–246.
Tsai, W.-P., D. Feng, M. Pan, H. Beck, K. Lawson, Y. Yang, J. Liu, and C. Shen. 2021. “From calibration to parameter learning: Harnessing the scaling effects of big data in geoscientific modeling.” Nat. Commun. 12 (1): 5988. https://doi.org/10.1038/s41467-021-26107-z.
Vapnik, V. N. 1995. The nature of statistical learning theory. New York: Springer.
von Rueden, L., et al. 2021. “Informed machine learning—A taxonomy and survey of integrating prior knowledge into learning systems.” IEEE Trans. Knowl. Data Eng. 35 (1): 614–633. https://doi.org/10.1109/TKDE.2021.3079836.
Willard, J., X. Jia, S. Xu, M. Steinbach, and V. Kumar. 2022. “Integrating scientific knowledge with machine learning for engineering and environmental systems.” ACM Comput. Surv. 55 (4): 1–37. https://doi.org/10.1145/3514228.
Yang, C. X., L. G. Tham, X. T. Feng, Y. J. Wang, and P. K. K. Lee. 2004. “Two-stepped evolutionary algorithm and its application to stability analysis of slopes.” J. Comput. Civ. Eng. 18 (2): 145–153. https://doi.org/10.1061/(ASCE)0887-3801(2004)18:2(145).
Yang, T., F. Sun, P. Gentine, W. Liu, H. Wang, J. Yin, M. Du, and C. Liu. 2019. “Evaluation and machine learning improvement of global hydrological model-based flood simulations.” Environ. Res. Lett. 14 (11): 114027. https://doi.org/10.1088/1748-9326/ab4d5e.
Yosinski, J., J. Clune, Y. Bengio, and H. Lipson. 2014. “How transferable are features in deep neural networks?” In Vol. 27 of Proc., Advances in Neural Information Processing Systems. Red Hook, NY: Curran Associates.
Zhang, L., G. Wang, and G. B. Giannakis. 2019. “Real-time power system state estimation and forecasting via deep unrolled neural networks.” IEEE Trans. Signal Process. 67 (15): 4069–4077. https://doi.org/10.1109/TSP.2019.2926023.
Zhou, J., E. Li, S. Yang, M. Wang, X. Shi, S. Yao, and H. S. Mitri. 2019. “Slope stability prediction for circular mode failure using gradient boosting machine approach based on an updated database of case histories.” Saf. Sci. 118 (Oct): 505–518. https://doi.org/10.1016/j.ssci.2019.05.046.
Information & Authors
Information
Published In
Journal of Geotechnical and Geoenvironmental Engineering
Volume 149 • Issue 10 • October 2023
Copyright
© 2023 American Society of Civil Engineers.
History
Received: May 22, 2022
Accepted: Jun 7, 2023
Published online: Aug 9, 2023
Published in print: Oct 1, 2023
Discussion open until: Jan 9, 2024
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.