Bayesian Supervised Learning of Site-Specific Geotechnical Spatial Variability from Sparse Measurements
Publication: ASCE-ASME Journal of Risk and Uncertainty in Engineering Systems, Part A: Civil Engineering
Volume 6, Issue 2
Abstract
Although the properties of geomaterials vary spatially, geotechnical site investigations often take sparse measurements from a limited number of locations. To estimate geotechnical properties at unsampled locations, interpolation is often needed. This paper presents a Bayesian supervised learning method for interpolation of site-specific geotechnical data from sparse measurements. The interpolation is considered as a supervised learning problem and is solved under a Bayesian framework. Numerical examples are used to evaluate performance of the proposed method and to provide a comparative study with ordinary kriging, a popular interpolation method in geosciences applications. Results show that when the available measurement points are sparse and limited, the Bayesian supervised learning method performs better than kriging. When the number of measurement points is large, results from the proposed method and kriging are almost identical. In addition, the proposed method is data-driven and nonparametric. It does not require a detrending process when dealing with nonstationary data, and it bypasses estimation of a parametric form of autocorrelation structure (e.g., semivariogram in conventional kriging interpolation). A well-known challenge in kriging is the selection of a suitable semivariogram function form or a suitable trend function form for detrending, given sparse geotechnical data. The proposed Bayesian supervised learning method bypasses these challenges and is particularly suitable for nonstationary geotechnical data. Standard preprocessing steps such as outlier removal and noise reduction apply to Bayesian supervised learning.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or code generated or used during the study are available from the corresponding author by request.
Acknowledgments
The work described in this paper was supported by grants from the Research Grants Council of the Hong Kong Special Administrative Region, China (Project Nos. CityU 11213117 and T22-603/15N). The financial supports are gratefully acknowledged.
References
Ali, A., and K. Y. Kim. 2016. “Seismic site conditions in Gangneung, Korea, based on Rayleigh-wave dispersion curves and topographic data.” Geosci. J. 20 (6): 781–791. https://doi.org/10.1007/s12303-016-0013-1.
Alpaydin, E. 2010. Introduction to machine learning. Cambridge, MA: MIT Press.
Baecher, G. B., and J. T. Christian. 2003. Reliability and statistics in geotechnical engineering. Hoboken, NJ: Wiley.
Candes, E. J., J. K. Romberg, and T. Tao. 2006. “Stable signal recovery from incomplete and inaccurate measurements.” Commun. Pure Appl. Math. 59 (8): 1207–1223. https://doi.org/10.1002/cpa.20124.
Cao, Z., and Y. Wang. 2014. “Bayesian model comparison and selection of spatial correlation functions for soil parameters.” Struct. Saf. 49 (Jul): 10–17. https://doi.org/10.1016/j.strusafe.2013.06.003.
Caruana, R., and A. Niculescu-Mizil. 2006. “An empirical comparison of supervised learning algorithms.” In Proc., 23rd Int. Conf. on Machine Learning, 161–168. New York: Association for Computing Machinery.
Cattle, J. A., A. McBratney, and B. Minasny. 2002. “Kriging method evaluation for assessing the spatial distribution of urban soil lead contamination.” J. Environ. Qual. 31 (5): 1576–1588. https://doi.org/10.2134/jeq2002.1576.
Chen, B. S., and P. W. Mayne. 1994. Profiling the overconsolidation ratio of clays by piezocone tests. Atlanta: School of Civil and Environmental Engineering, Georgia Institute of Technology.
Ching, J., and K.-K. Phoon. 2017. “Characterizing uncertain site-specific trend function by sparse Bayesian learning.” J. Eng. Mech. 143 (7): 04017028. https://doi.org/10.1061/(ASCE)EM.1943-7889.0001240.
Ching, J., and K.-K. Phoon. 2019. “Modeling multivariate, uncertain, sparse, and incomplete site investigation data with spatial variation (MUSIC-X).” In Proc., 7th Int. Symp. on Geotechnical Safety and Risk (ISGSR 2019). Singapore: Research Publishing.
Ching, J. Y., K.-K. Phoon, J. L. Beck, and Y. Huang. 2017. “Identifiability of geotechnical site-specific trend functions.” ASCE-ASME J. Risk Uncertainty Eng. Syst., Part A: Civ. Eng. 3 (4): 04017021. https://doi.org/10.1061/AJRUA6.0000926.
Cressie, N. 1990. “The origins of kriging.” Math. Geol. 22 (3): 239–252. https://doi.org/10.1007/BF00889887.
Dietrich, C. R., and G. N. Newsam. 1993. “A fast and exact method for multidimensional Gaussian stochastic simulations.” Water Resour. Res. 29 (8): 2861–2869. https://doi.org/10.1029/93WR01070.
Donoho, D., A. Maleki, and M. Shahram. 2006. “Wavelab 850.” In Software toolkit for time-frequency analysis. Stanford, CA: Stanford Univ.
Du, W., and T. C. Pan. 2017. “Urban seismic loss estimation by incorporating ground-motion simulation, site effect, and kriging techniques: An application in Singapore.” Bull. Seismol. Soc. Am. 107 (6): 2745–2758. https://doi.org/10.1785/0120160346.
Fang, J., Y. Shen, H. Li, and P. Wang. 2015. “Pattern-coupled sparse Bayesian learning for recovery of block-sparse signals.” IEEE Trans. Signal Process. 63 (2): 360–372. https://doi.org/10.1109/TSP.2014.2375133.
Fang, Y., J. Wu, and B. Huang. 2012. “2D sparse signal recovery via 2D orthogonal matching pursuit.” Sci. China Inform. Sci. 55 (4): 889–897. https://doi.org/10.1007/s11432-012-4551-5.
Faul, A. C., and M. E. Tipping. 2002 “Analysis of sparse Bayesian learning.” In Proc., Advances in Neural Information Processing Systems, 383–389. New York: Association for Computing Machinery.
Gal, Y., R. Islam, and Z. Ghahramani. 2017. “Deep bayesian active learning with image data.” In Vol. 70 of Proc., 34th Int. Conf. on Machine Learning, 1183–1192. Brookline, MA: JMLR and Microtome Publishing.
García, S., J. Luengo, and F. Herrera. 2015. Data preprocessing in data mining, 59–139. New York: Springer.
Gelman, A., J. B. Carlin, H. S. Stern, and D. B. Rubin. 2014. Bayesian data analysis. Boca Raton, FL: Chapman & Hall/CRC Press.
Goldberg, D. E., and J. H. Holland. 1988. “Genetic algorithms and machine learning.” Mach. Learn. 3 (2): 95–99. https://doi.org/10.1023/A:1022602019183.
Goovaerts, P. 1997. Geostatistics for natural resources evaluation. New York: Oxford University Press.
Isaaks, E. H., and R. M. Srivastava. 1989. An introduction to applied geostatistics. New York: Oxford University Press.
Ji, S., Y. Xue, and L. Carin. 2008. “Bayesian compressive sensing.” IEEE Trans. Signal Process. 56 (6): 2346–2356. https://doi.org/10.1109/TSP.2007.914345.
Kotsiantis, S. B., D. Kanellopoulos, and P. E. Pintelas. 2006. “Data preprocessing for supervised learning.” Int. J. Comput. Sci. 1 (2): 111–117.
Kourou, K., T. P. Exarchos, K. P. Exarchos, M. V. Karamouzis, and D. I. Fotiadis. 2015. “Machine learning applications in cancer prognosis and prediction.” Comput. Struct. Biotechnol. J. 13: 8–17. https://doi.org/10.1016/j.csbj.2014.11.005.
Kubat, M., R. C. Holte, and S. Matwin. 1998. “Machine learning for the detection of oil spills in satellite radar images.” Mach. Learn. 30 (2–3): 195–215. https://doi.org/10.1023/A:1007452223027.
Kulhawy, F. H., and P. W. Mayne. 1990. Manual on estimating soil properties for foundation design. Palo Alto, CA: Electric Power Research Institute.
Li, D. Q., X. H. Qi, Z. J. Cao, X. S. Tang, W. Zhou, K.-K. Phoon, and C. B. Zhou. 2015. “Reliability analysis of strip footing considering spatially variable undrained shear strength that linearly increases with depth.” Soils Found. 55 (4): 866–880. https://doi.org/10.1016/j.sandf.2015.06.017.
Libbrecht, M. W., and W. S. Noble. 2015. “Machine learning applications in genetics and genomics.” Nat. Rev. Genet. 16 (6): 321. https://doi.org/10.1038/nrg3920.
Lumb, P. 1966. “The variability of natural soils.” Can. Geotech. J. 3 (2): 74–97. https://doi.org/10.1139/t66-009.
MacKay, D. J. 1995. “Probable networks and plausible predictions—A review of practical Bayesian methods for supervised neural networks.” Network: Comput. Neural Syst. 6 (3): 469–505. https://doi.org/10.1088/0954-898X_6_3_011.
Mohri, M., A. Rostamizadeh, and A. Talwalkar. 2012. Foundations of machine learning. Cambridge, MA: MIT Press.
Neal, R. M. 2012. Bayesian learning for neural networks. New York: Springer.
Nesbitt, H., and G. M. Young. 1989. “Formation and diagenesis of weathering profiles.” J. Geol. 97 (2): 129–147. https://doi.org/10.1086/629290.
Phoon, K.-K. 2017. “Role of reliability calculations in geotechnical design.” Georisk: Assess. Manage. Risk Eng. Syst. Geohazards 11 (1): 4–21. https://doi.org/10.1080/17499518.2016.1265653.
Phoon, K.-K. 2018. “Editorial for special collection on probabilistic site characterization.” ASCE-ASME J. Risk Uncertainty Eng. Syst., Part A: Civ. Eng. 4 (4): 02018002. https://doi.org/10.1061/AJRUA6.0000992.
Phoon, K.-K., J. Ching, and Y. Wang. 2019. “Managing risk in geotechnical engineering—From data to digitalization.” In Proc., 7th Int. Symp. on Geotechnical Safety and Risk. Taipei, Taiwan: International Symposium on Geotechnical Safety and Risk.
Phoon, K.-K., and F. H. Kulhawy. 1999. “Characterization of geotechnical variability.” Can. Geotech. J. 36 (4): 612–624. https://doi.org/10.1139/t99-038.
Phoon, K.-K., S.-T. Quek, and P. An. 2003. “Identification of statistically homogeneous soil layers using modified Bartlett statistics.” J. Geotech. Geoenviron. Eng. 129 (7): 649–659. https://doi.org/10.1061/(ASCE)1090-0241(2003)129:7(649).
Rasmussen, C. E. 2004. “Gaussian processes in machine learning.” In Advanced lectures on machine learning, 63–71. Berlin: Springer.
Rasmussen, C. E., and C. K. Williams. 2006. Gaussian processes for machine learning. Cambridge, MA: MIT Press.
Russell, S. J., and P. Norvig. 2016. Artificial intelligence: A modern approach. Harlow, UK: Pearson Education Limited.
Sivia, D., and J. Skilling. 2006. Data analysis: A Bayesian tutorial. Oxford, UK: Oxford University Press.
Strang, G. 2016. Introduction to linear algebra. Wellesley, MA: Cambridge Press.
Suthaharan, S. 2016. Machine learning models and algorithms for big data classification. Boston: Springer.
Tipping, M. E. 2001. “Sparse Bayesian learning and the relevance vector machine.” J. Mach. Learn. Res. 1 (Jun): 211–244.
Tipping, M. E., and A. C. Faul. 2003. “Fast marginal likelihood maximisation for sparse Bayesian models.” In Proc., AISTATS. Palermo, Italy: Society Artificial Intelligence and Statistics.
Vanmarcke, E. 2010. Random fields: Analysis and synthesis. Singapore: World Scientific.
Wang, Y., O. V. Akeju, and T. Zhao. 2017. “Interpolation of spatially varying but sparsely measured geo-data: A comparative study.” Eng. Geol. 231 (Dec): 200–217. https://doi.org/10.1016/j.enggeo.2017.10.019.
Wang, Y., and T. Zhao. 2016. “Interpretation of soil property profile from limited measurement data: A compressive sampling perspective.” Can. Geotech. J. 53 (9): 1547–1559. https://doi.org/10.1139/cgj-2015-0545.
Wang, Y., and T. Zhao. 2017. “Statistical interpretation of soil property profiles from sparse data using Bayesian compressive sampling.” Géotechnique 67 (6): 523–536. https://doi.org/10.1680/jgeot.16.P.143.
Wang, Y., T. Zhao, Y. Hu, and K.-K. Phoon. 2019. “Simulation of random fields with trend from sparse measurements without detrending.” J. Eng. Mech. 145 (2): 04018130. https://doi.org/10.1061/(ASCE)EM.1943-7889.0001560.
Webster, R. 2000. “Is soil variation random?” Geoderma 97 (3–4): 149–163. https://doi.org/10.1016/S0016-7061(00)00036-7.
Webster, R., and M. A. Oliver. 2007. Geostatistics for environmental scientists. Chichester, UK: Wiley.
Welling, M., and Y. W. Teh. 2011. “Bayesian learning via stochastic gradient Langevin dynamics.” In Proc., 28th Int. Conf. on Machine Learning, 681–688. New York: Association for Computing Machinery.
Williams, O., A. Blake, and R. Cipolla. 2005. “Sparse bayesian learning for efficient visual tracking.” IEEE Trans. Pattern Anal. Mach. Intell. 27 (8): 1292–1304. https://doi.org/10.1109/TPAMI.2005.167.
Wipf, D. P., and B. D. Rao. 2004. “Sparse Bayesian learning for basis selection.” IEEE Trans. Signal Process. 52 (8): 2153–2164. https://doi.org/10.1109/TSP.2004.831016.
Witten, I. H., E. Frank, M. A. Hall, and C. J. Pal. 2016. Data mining: Practical machine learning tools and techniques. Amsterdam, Netherlands: Morgan Kaufmann.
Wu, Z., N. E. Huang, S. R. Long, and C. K. Peng. 2007. “On the trend, detrending, and variability of nonlinear and nonstationary time series.” Proc. Natl. Acad. Sci. 104 (38): 14889–14894. https://doi.org/10.1073/pnas.0701020104.
Yuen, K. V., and H. Q. Mu. 2012. “A novel probabilistic method for robust parametric identification and outlier detection.” Probab. Eng. Mech. 30 (Oct): 48–59. https://doi.org/10.1016/j.probengmech.2012.06.002.
Zhang, J., L. Zhang, and W. H. Tang. 2009. “Bayesian framework for characterizing geotechnical model uncertainty.” J. Geotech. Geoenviron. Eng. 135 (7): 932–940. https://doi.org/10.1061/(ASCE)GT.1943-5606.0000018.
Zhang, J., L. M. Zhang, and W. H. Tang. 2011. “Kriging numerical models for geotechnical reliability analysis.” Soils Found. 51 (6): 1169–1177. https://doi.org/10.3208/sandf.51.1169.
Zhang, W. G., and A. T. C. Goh. 2013. “Multivariate adaptive regression splines for analysis of geotechnical engineering systems.” Comput. Geotech. 48 (Mar): 82–95. https://doi.org/10.1016/j.compgeo.2012.09.016.
Zhang, Z., and B. D. Rao. 2011. “Sparse signal recovery with temporally correlated source vectors using sparse Bayesian learning.” IEEE J. Sel. Top. Signal Process. 5 (5): 912–926. https://doi.org/10.1109/JSTSP.2011.2159773.
Zhao, T., Y. Hu, and Y. Wang. 2018. “Statistical interpretation of spatially varying 2D geo-data from sparse measurements using Bayesian compressive sampling.” Eng. Geol. 246 (Nov): 162–175. https://doi.org/10.1016/j.enggeo.2018.09.022.
Information & Authors
Information
Published In
ASCE-ASME Journal of Risk and Uncertainty in Engineering Systems, Part A: Civil Engineering
Volume 6 • Issue 2 • June 2020
Copyright
©2020 American Society of Civil Engineers.
History
Received: Apr 8, 2019
Accepted: Nov 20, 2019
Published online: Mar 17, 2020
Published in print: Jun 1, 2020
Discussion open until: Aug 17, 2020
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.