A Hierarchical Bayesian Similarity Measure for Geotechnical Site Retrieval
Publication: Journal of Engineering Mechanics
Volume 148, Issue 10
Abstract
Geotechnical site retrieval refers to the quantitative identification and extraction of sites similar to a given target site from predocumented generic sites in a database. This is known as the “site recognition challenge.” Recently, the second and third authors of this paper proposed a Bayesian similarity measure between a target site and generic records in the database. However, the proposed method can only retrieve “similar database records” but not “similar database sites”; that is, records are not grouped according to their test locations within a site boundary. The purpose of the current paper was to propose a novel Bayesian similarity measure between the target site and a database site to extract similar sites from a database. This “site retrieval” approach is more “explainable” to a geotechnical engineer because an engineer has an opportunity to accept or reject the identified “similar” sites based on his or her experiences and judgment. The human engineer can engage an explainable algorithm in a decision loop in a more meaningful way. Based on the hierarchical Bayesian model (HBM) previously developed by the second and third authors, this study further proposed a Bayesian method of measuring similarity between the target site and database sites for the purpose of geotechnical site retrieval. This hierarchical Bayesian measure elegantly reduces to the classical Kullback–Leibler divergence for complete multivariate data. The HBM was used to simultaneously model intrasite and intersite variability and construct the site-specific multivariate distribution for the database sites. Site retrieval was performed by measuring the similarity between the target and database sites in the form of a multivariate likelihood. It is shown that the proposed hierarchical Bayesian method can yield a meaningful interpretation of intersite similarity and can successfully be used for site retrieval. The proposed approach can also quantify the statistical uncertainty due to sparse (limited) and incomplete (missing) data.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
All models and computer codes that support the findings of this study are available from the corresponding author upon reasonable request.
Acknowledgments
The first author would like to acknowledge the generous funding support from the Ministry of Science and Technology of Taiwan (Project No. 110-2811-E-002-501). The authors would also like to thank the members of the TC304 Committee on Engineering Practice of Risk Assessment and Management of the International Society of Soil Mechanics and Geotechnical Engineering for developing the database 304dB (TC304 2018) used in this study and making it available for scientific inquiry.
References
Bhattacharyya, A. 1943. “On a measure of divergence between two statistical populations defined by their probability distributions.” Bull. Calcutta Math. Soc. 35 (Mar): 99–109.
Bjerrum, L. 1972. “Embankments on soft ground, performance of earth and earth-supported structures.” In Proc., ASCE Specialty Conf. on Performance of Earth and Earth-Supported Structures, 1–54. Reston, VA: ASCE.
Bozorgzadeh, N., J. P. Harrison, and M. D. Escobar. 2019. “Hierarchical Bayesian modelling of geotechnical data: Application to rock strength.” Geotechnique 69 (12): 1056–1070. https://doi.org/10.1680/jgeot.17.P.282.
Ching, J. 2020. “Value of geotechnical big data and its application in site-specific soil property estimation.” J. GeoEng. 15 (4): 173–182. https://doi.org/ 10.6310/jog.202012_15(4).1.
Ching, J., K.-H. Li, K.-K. Phoon, and M.-C. Weng. 2018. “Generic transformation models for some intact rock properties.” Can. Geotech. J. 55 (12): 1702–1741. https://doi.org/10.1139/cgj-2017-0537.
Ching, J., G.-H. Lin, J.-R. Chen, and K.-K. Phoon. 2017. “Transformation models for effective friction angle and relative density calibrated based on generic database of coarse-grained soils.” Can. Geotech. J. 54 (4): 481–501. https://doi.org/10.1139/cgj-2016-0318.
Ching, J., K. K. Phoon, Y. H. Ho, and M. C. Weng. 2021a. “Quasi-site-specific prediction for deformation modulus of rock mass.” Can. Geotech. J. 58 (7): 936–951. https://doi.org/10.1139/cgj-2020-0168.
Ching, J., K. K. Phoon, Z. Y. Yang, and A. W. Stuedlein. 2022. “Quasi-site-specific multivariate probability distribution model for sparse, incomplete, and three-dimensional spatially varying soil data.” Georisk: Assess. Manage. Risk Eng. Syst. Geohazards. 16 (1): 53–76. https://doi.org/10.1080/17499518.2021.1971256.
Ching, J., and K.-K. Phoon. 2014a. “Correlations among some clay parameters—The multivariate distribution.” Can. Geotech. J. 51 (6): 686–704. https://doi.org/10.1139/cgj-2013-0353.
Ching, J., and K.-K. Phoon. 2014b. “Transformations and correlations among some clay parameters—The global database.” Can. Geotech. J. 51 (6): 663–685. https://doi.org/10.1139/cgj-2013-0262.
Ching, J., and K.-K. Phoon. 2019. “Constructing site-specific multivariate probability distribution model using Bayesian machine learning.” J. Eng. Mech. 145 (1): 04018126. https://doi.org/10.1061/(ASCE)EM.1943-7889.0001537.
Ching, J., and K.-K. Phoon. 2020. “Measuring similarity between site-specific data and records from other sites.” J. Risk Uncertainty Eng. Syst. Part A: Civ. Eng. 6 (2): 04020011. https://doi.org/10.1061/AJRUA6.0001046.
Ching, J., and T. Schweckendiek. 2021. State-of-the-art review of inherent variability and uncertainty in geotechnical properties and models. London: International Society of Soil Mechanics and Geotechnical Engineering.
Ching, J., S. Wu, and K.-K. Phoon. 2021b. “Constructing quasi-site-specific multivariate probability distribution using hierarchical Bayesian model.” J. Eng. Mech. 147 (10): 04021069. https://doi.org/10.1061/(ASCE)EM.1943-7889.0001964.
D’Ignazio, M., K.-K. Phoon, S. A. Tan, and T. T. Länsivaaraa. 2016. “Correlations for undrained shear strength of Finnish soft clays.” Can. Geotech. J. 53 (10): 1628–1645. https://doi.org/10.1139/cgj-2016-0037.
Feng, W., S. Wu, Y. Yin, J. Zhang, and K. Zhang. 2017. “A training image evaluation and selection method based on minimum data event distance for multiple-point geostatistics.” Comput. Geosci. 104 (Apr): 35–53. https://doi.org/10.1016/j.cageo.2017.04.004.
Gelman, A. 2006. “Multilevel (hierarchical) modeling: What it can and cannot do.” Technometrics 48 (3): 432–435. https://doi.org/10.1198/004017005000000661.
Han, L., L. Wang, X. Ding, H. Wen, X. Yuan, and W. Zhang. 2021. “Similarity quantification of soil parametric data and sites using confidence ellipses.” Geosci. Front. 13 (1): 101280. https://doi.org/10.1016/j.gsf.2021.101280.
Jaksa, M. 2000. “Geotechnical risk and inadequate site investigations: A case study.” Aust. Geomech. 35 (2): 39–46.
Johnson, N. L. 1949. “Systems of frequency curves generated by methods of translation.” Biometrika 36 (1–2): 149–176. https://doi.org/10.2307/2332539.
Kootahi, K., and G. Moradi. 2017. “Evaluation of compression index of marine fine-grained soils by the use of index tests.” Mar. Georesour. Geotechnol. 35 (4): 548–570. https://doi.org/10.1080/1064119X.2016.1213775.
Kulhawy, F. H., and P. W. Mayne. 1990. Manual on estimating soil properties for foundation design. New York: Electric Power Research Institute.
Kullback, S., and R. A. Leibler. 1951. “On information and sufficiency.” Ann. Math. Stat. 22 (1): 79–86.
Lacasse, S., and T. Lunne. 1982. “Penetration tests in two Norwegian clays.” In Proc., 2nd European Symp. on Penetration Testing, 661–670. Oxfordshire, UK: Taylor & Francis.
Ladd, C. C., and R. Foott. 1974. “New design procedure for stability of soft clays.” J. Geotech. Eng. Div. 100 (7): 763–786. https://doi.org/10.1061/AJGEB6.0000066.
Lee, F.-H., T.-S. Tan, G. Karunaratne, and S.-L. Lee. 1990. “Geotechnical data management system.” J. Comput. Civ. Eng. 4 (3): 239–254. https://doi.org/10.1061/(ASCE)0887-3801(1990)4:3(239).
Liu, S., H. Zou, G. Cai, T. V. Bheemasetti, A. J. Puppala, and J. Lin. 2016. “Multivariate correlation among resilient modulus and cone penetration test parameters of cohesive subgrade soils.” Eng. Geol. 209 (May): 128–142. https://doi.org/10.1016/j.enggeo.2016.05.018.
Lu, S., J. Zhang, S. Zhou, and A. Xu. 2018. “Reliability prediction of the axial ultimate bearing capacity of piles: A hierarchical Bayesian method.” Adv. Mech. Eng. 10 (11): 1–11. https://doi.org/10.1177/1687814018811054.
Mahalanobis, P. C. 1936. “On the generalized distance in statistics.” In Proc., National Institute of Science of India, 49–55. Kolkata, India: National Institute of Sciences of India.
Mesri, G., and N. Huvaj. 2007. “Shear strength mobilized in undrained failure of soft clay and silt deposits.” In Advances in measurement and modeling of soil behavior, 1–22. Reston, VA: ASCE.
Oliphant, J., J. A. R. Ibrahim, and P. W. Jowitt. 1996. “ASSIST: A computer-based advisory system for site investigations.” Proc. Inst. Civ. Eng. 119 (2): 109–122. https://doi.org/10.1680/igeng.1996.28170.
Phoon, K. K., J. Ching, and T. Shuku. 2022a. “Challenges in data-driven site characterization.” Georisk: Assess. Manage. Risk Eng. Syst. Geohazards 16 (1): 114–126. https://doi.org/10.1080/17499518.2021.1896005.
Phoon, K. K., J. Ching, and Y. Wang. 2019. “Managing risk in geotechnical engineering—From data to digitalization.” In Proc., 7th Int. Symp. on Geotechnical Safety and Risk (ISGSR 2019), 13–34. Singapore: Research Publishing.
Phoon, K. K., T. Shuku, J. Ching, and I. Yoshida. 2022b. “Benchmark examples for data-driven site characterization.” Georisk: Assess. Manage. Risk Eng. Syst. Geohazards 1–23. https://doi.org/10.1080/17499518.2022.2025541.
Phoon, K.-K. 2018. “Probabilistic site characterization.” J. Risk Uncertainty Eng. Syst. Part A: Civ. Eng. 4 (4): 02018002. https://doi.org/10.1061/AJRUA6.0000992.
Phoon, K.-K., and J. Ching. 2013. “Multivariate model for soil parameters based on Johnson distributions.” In Foundation engineering in the face of uncertainty, 337–353. Reston, VA: ASCE.
Phoon, K.-K., and J. Ching. 2021. “Project DEEPGEO—Data-driven 3D subsurface mapping.” J. GeoEng. 16 (2): 61–73. https://doi.org/10.6310%2fjog.202106_16(2).2.
Phoon, K.-K., and F. H. Kulhawy. 1999. “Evaluation of geotechnical property variability.” Can. Geotech. J. 36 (4): 625–639. https://doi.org/10.1139/t99-039.
Pyrcz, M. J., J. B. Boisvert, and C. V. Deutsch. 2008. “A library of training images for fluvial and deepwater reservoirs and associated code.” Comput. Geosci. 34 (5): 542–560. https://doi.org/10.1016/j.cageo.2007.05.015.
Randolph, M., and S. Gourvenec. 2017. Offshore geotechnical engineering. London: CRC Press.
Raper, J., and D. Wainwright. 1987. “The use of the geotechnical database ‘GEOSHARE’ for site investigation data management.” Q. J. Eng. Geol. Hydrogeol. 20 (3): 221–230. https://doi.org/10.1144/GSL.QJEG.1987.020.03.03.
Shi, C., and Y. Wang. 2021. “Training image selection for development of subsurface geological cross-section by conditional simulations.” Eng. Geol. 295 (Dec): 106415. https://doi.org/10.1016/j.enggeo.2021.106415.
TC304. 2018. “ISSMGE (International Society for Soil Mechanics and Geotechnical Engineering) TC304 304dB database.” Accessed December 6, 2021. http://140.112.12.21/issmge/tc304.htm.
Terzaghi, K., R. B. Peck, and G. Mesri. 1996. Soil mechanics in engineering practice. New York: Wiley.
Toll, D. 1995. “The role of a knowledge-based system in interpreting geotechnical information.” Geotechnique 45 (3): 525–531. https://doi.org/10.1680/geot.1995.45.3.525.
Toll, D. G., S. Walthall, and S. Sharma. 2001. “Format for geotechnical data exchange in the United Kingdom.” Transp. Res. Rec. 1755 (1): 26–33. https://doi.org/10.3141/1755-03.
Zhang, J., C. Juang, J. Martin, and H. Huang. 2016. “Inter-region variability of Robertson and Wride method for liquefaction hazard analysis.” Eng. Geol. 203 (Mar): 191–203. https://doi.org/10.1016/j.enggeo.2015.12.024.
Zhang, J., J. Li, L. Zhang, and H. Huang. 2014. “Calibrating cross-site variability for reliability-based design of pile foundations.” Comput. Geotech. 62 (Oct): 154–163. https://doi.org/10.1016/j.compgeo.2014.07.013.
Zheng, S., Y. X. Zhu, D. Q. Li, Z. J. Cao, Q. X. Deng, and K. K. Phoon. 2021. “Probabilistic outlier detection for sparse multivariate geotechnical site investigation data using Bayesian learning.” Geosci. Front. 12 (1): 425–439. https://doi.org/10.1016/j.gsf.2020.03.017.
Zou, H., S. Liu, G. Cai, A. J. Puppala, and T. V. Bheemasetti. 2017. “Multivariate correlation analysis of seismic piezocone penetration (SCPTU) parameters and design properties of Jiangsu quaternary cohesive soils.” Eng. Geol. 228 (Oct): 11–38. https://doi.org/10.1016/j.enggeo.2017.07.005.
Information & Authors
Information
Published In
Journal of Engineering Mechanics
Volume 148 • Issue 10 • October 2022
Copyright
© 2022 American Society of Civil Engineers.
History
Received: Jan 28, 2022
Accepted: May 17, 2022
Published online: Aug 8, 2022
Published in print: Oct 1, 2022
Discussion open until: Jan 8, 2023
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited by
- Atma Sharma, Jie Zhang, Giovanni Spagnoli, A Bayesian Vine Algorithm for Geotechnical Site Characterization Using High Dimensional, Multivariate, Limited, and Missing Data, Journal of Engineering Mechanics, 10.1061/JENMDT.EMENG-7460, 150, 7, (2024).
- Kok-Kwang Phoon, What Geotechnical Engineers Want to Know about Reliability, ASCE-ASME Journal of Risk and Uncertainty in Engineering Systems, Part A: Civil Engineering, 10.1061/AJRUA6.RUENG-1002, 9, 2, (2023).
- Kok-Kwang Phoon, Jianye Ching, Zijun Cao, Unpacking data-centric geotechnics, Underground Space, 10.1016/j.undsp.2022.04.001, 7, 6, (967-989), (2022).
- Stephen Wu, Jianye Ching, Kok-Kwang Phoon, Quasi-site-specific soil property prediction using a cluster-based hierarchical Bayesian model, Structural Safety, 10.1016/j.strusafe.2022.102253, 99, (102253), (2022).