Image-Based 3D Reconstruction of Granular Grains via Hybrid Algorithm and Level Set with Convolution Kernel
This article has been corrected.
VIEW CORRECTIONPublication: Journal of Geotechnical and Geoenvironmental Engineering
Volume 148, Issue 5
Abstract
This study develops a novel method for reconstructing three dimensional (3D) granular grains from computed tomography (CT) images. Unlike previous studies requiring trial-and-error hyperparameters, the hybrid algorithm introduced here, integrating the random forest (RF) algorithm and enhanced by particle swarm optimization for automatic determination of hyperparameters, is the first to train the model for constituent classification and grain segmentation. In addition, and different from previous manual methods, a convolution kernel is applied to assign an initial level set function inside an individual grain and determine whether to activate the level function for automatically reconstructing 3D grains from a CT image. All results indicate the hybrid algorithm can rapidly search the optimum hyperparameters, providing a more effective way to identify the optimum RF-based model. This model segments grains with an accuracy of 90%, in comparison with a 52% accuracy achieved by the conventional watershed algorithm. The convolution kernel can accurately and automatically identify individual grains, avoiding manual assignment of an initial calculation area and ensuring grains are correctly reconstructed. Overall, the proposed method provides a more intelligent and effective way to reconstruct 3D grains from CT images.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
All data used during the study are available from the corresponding author by request.
Acknowledgments
This research was financially supported by the Research Grants Council (RGC) of Hong Kong Special Administrative Region Government (HKSARG) of China (Grant No. 15220221).
References
Altuhafi, F. N., M. R. Coop, and V. N. Georgiannou. 2016. “Effect of particle shape on the mechanical behavior of natural sands.” J. Geotech. Geoenviron. Eng. 142 (12): 04016071.
Arganda-Carreras, I., V. Kaynig, C. Rueden, K. W. Eliceiri, J. Schindelin, A. Cardona, and H. S. Seung. 2017. “Trainable Weka segmentation: A machine learning tool for microscopy pixel classification.” Bioinformatics 33 (15): 2424–2426. https://doi.org/10.1093/bioinformatics/btx180.
Beucher, S., and C. Lantuéjoul. 1979. “Use of watersheds in contour detection.” In Proc., Int. Workshop on Image Processing. Paris: Mines ParisTech.
Breiman, L. 1996. “Bagging predictors.” Mach. Learn. 24 (2): 123–140.
Breiman, L. 2001. “Random forests.” Mach. Learn. 45 (1): 5–32. https://doi.org/10.1023/A:1010933404324.
Canny, J. 1986. “A computational approach to edge detection.” IEEE Trans. Pattern Anal. Mach. Intell. PAMI-8 (6): 679–698. https://doi.org/10.1109/TPAMI.1986.4767851.
Cho, G. C., J. Dodds, and J. C. Santamarina. 2006. “Particle shape effects on packing density, stiffness, and strength: Natural and crushed sands.” J. Geotech. Geoenviron. Eng. 132 (5): 591–602. https://doi.org/10.1061/(ASCE)1090-0241(2006)132:5(591).
Coetzee, C. J. 2016. “Calibration of the discrete element method and the effect of particle shape.” Powder Technol. 297 (Sep): 50–70. https://doi.org/10.1016/j.powtec.2016.04.003.
Ghalib, A. M., and R. D. Hryciw. 1999. “Soil particle size distribution by mosaic imaging and watershed analysis.” J. Comput. Civ. Eng. 13 (2): 80–87. https://doi.org/10.1061/(ASCE)0887-3801(1999)13:2(80).
Haralick, R. M., and L. G. Shapiro. 1992. Computer and robot vision. Boston: Addison-Wesley Publishing.
Ho, T. K. 1998. “The random subspace method for constructing decision forests.” IEEE Trans. Pattern Anal. Mach. Intell. 20 (8): 832–844. https://doi.org/10.1109/34.709601.
Jarrar, Z. A., K. A. Alshibli, and R. I. Al-Raoush. 2020. “Three-dimensional evaluation of sand particle fracture using discrete-element method and synchrotron microcomputed tomography images.” J. Geotech. Geoenviron. Eng. 146 (7): 06020007. https://doi.org/10.1061/(ASCE)GT.1943-5606.0002281.
Kawamoto, R., E. Andò, G. Viggiani, and J. E. Andrade. 2016. “Level set discrete element method for three-dimensional computations with triaxial case study.” J. Mech. Phys. Solids 91 (Jun): 1–13. https://doi.org/10.1016/j.jmps.2016.02.021.
Kennedy, J., and R. Eberhart. 1995. “Particle swarm optimization.” In Proc., IEEE Int. Conf. on Neural Networks, 1942–1948. New York: IEEE.
Kim, F. H., D. Penumadu, J. Gregor, N. Kardjilov, and I. Manke. 2013. “High-resolution neutron and X-ray imaging of granular materials.” J. Geotech. Geoenviron. Eng. 139 (5): 715–723. https://doi.org/10.1061/(ASCE)GT.1943-5606.0000809.
Kong, D., and J. Fonseca. 2018. “Quantification of the morphology of shelly carbonate sands using 3D images.” Géotechnique 68 (3): 249–261. https://doi.org/10.1680/jgeot.16.P.278.
Lai, Z., and Q. Chen. 2017. “Particle swarm optimization for numerical bifurcation analysis in computational inelasticity.” Int. J. Numer. Anal. Methods Geomech. 41 (3): 442–468. https://doi.org/10.1002/nag.2657.
Lai, Z., and Q. Chen. 2019. “Reconstructing granular particles from X-ray computed tomography using the TWS machine learning tool and the level set method.” Acta Geotech. 14 (1): 1–18. https://doi.org/10.1007/s11440-018-0759-x.
Li, C. M., C. Y. Xu, C. F. Gui, and M. D. Fox. 2005. “Level set evolution without re-initialization: A new variational formulation.” In Proc., IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR’05), 430–436. New York: IEEE.
Li, Y., W. Liang, J. Tan, and Y. Zhang. 2015. “A novel automatically initialized level set approach based on region correlation for lumbar vertebrae CT image segmentation.” In Proc., 2015 IEEE Int. Symp. on Medical Measurements and Applications (MeMeA), 291–296. New York: IEEE.
Lorensen, W., and H. Cline. 1987. “Marching cubes: A high resolution 3D surface construction algorithm.” Comput. Graph. 21 (4): 163–169. https://doi.org/10.1145/37402.37422.
Lujan-Moreno, G. A., P. R. Howard, O. G. Rojas, and D. C. Montgomery. 2018. “Design of experiments and response surface methodology to tune machine learning hyperparameters, with a random forest case-study.” Expert Syst. Appl. 109 (Nov): 195–205. https://doi.org/10.1016/j.eswa.2018.05.024.
Manahiloh, K. N., and C. L. Meehan. 2017. “Determining the soil water characteristic curve and interfacial contact angle from microstructural analysis of X-ray CT images.” J. Geotech. Geoenviron. Eng. 143 (8): 04017034. https://doi.org/10.1061/(ASCE)GT.1943-5606.0001677.
Martínez-Muñoz, G., and A. Suárez. 2010. “Out-of-bag estimation of the optimal sample size in bagging.” Pattern Recognit. 43 (1): 143–152. https://doi.org/10.1016/j.patcog.2009.05.010.
Nadimi, S., and J. Fonseca. 2018. “A micro finite-element model for soil behaviour.” Géotechnique 68 (4): 290–302. https://doi.org/10.1680/jgeot.16.P.147.
Nguyen, H. B. K., M. M. Rahman, and A. B. Fourie. 2020. “How particle shape affects the critical state, triggering of instability and dilatancy of granular materials—Results from a DEM study.” Géotechnique 71 (9): 749–764.
Peng, Y., H. Liu, C. Li, X. Ding, X. Deng, and C. Wang. 2021. “The detailed particle breakage around the pile in coral sand.” Acta Geotech. 16 (6): 1971–1981. https://doi.org/10.1007/s11440-020-01089-2.
Probst, P., M. N. Wright, and A. L. Boulesteix. 2019. “Hyperparameters and tuning strategies for random forest.” Wiley Interdiscip. Rev.: Data Min. Knowl. Discovery 9 (3): e1301. https://doi.org/10.1002/widm.1301.
Samma, H., C. P. Lim, and J. Mohamad Saleh. 2016. “A new reinforcement learning-based memetic particle swarm optimizer.” Appl. Soft Comput. 43 (Jun): 276–297. https://doi.org/10.1016/j.asoc.2016.01.006.
Sezgin, M., and B. Sankur. 2004. “Survey over image thresholding techniques and quantitative performance evaluation.” J. Electron. Imaging 13 (1): 146–168.
Soille, P. 2003. Morphological image analysis: Principles and applications. Berlin: Springer.
Sun, Q., J. Zheng, and C. Li. 2019. “Improved watershed analysis for segmenting contacting particles of coarse granular soils in volumetric images.” Powder Technol. 356 (Nov): 295–303. https://doi.org/10.1016/j.powtec.2019.08.028.
Wang, P., Z.-Y. Yin, and Z.-Y. Wang. 2022. “Micromechanical investigation of particle-size effect of granular materials in biaxial test with the role of particle breakage.” J. Eng. Mech. 148 (1): 04021133.
Xuan, L., and Z. Hong. 2017. “An improved Canny edge detection algorithm.” In Proc., 8th IEEE Int. Conf. on Software Engineering and Service Science (ICSESS), 275–278. New York: IEEE.
Yang, W., L. Guo, T. Zhao, and G. Xiao. 2007. “Improving watersheds image segmentation method with graph theory.” In Proc., 2007 2nd IEEE Conf. on Industrial Electronics and Applications, 2550–2553. New York: IEEE.
Zhang, P., R. P. Chen, and H. N. Wu. 2019. “Real-time analysis and regulation of EPB shield steering using random forest.” Autom. Constr. 106 (Oct): 102860. https://doi.org/10.1016/j.autcon.2019.102860.
Zhang, P., H. Li, Q. P. Ha, Z. Y. Yin, and R. P. Chen. 2020a. “Reinforcement learning based optimizer for improvement of predicting tunneling-induced ground responses.” Adv. Eng. Inform. 45 (Aug): 101097. https://doi.org/10.1016/j.aei.2020.101097.
Zhang, P., Z. Y. Yin, and Y. F. Jin. 2022. “Three-dimensional quantitative analysis on granular particle shape using convolutional neural network.” Int. J. Numer. Anal. Methods Geomech. 46 (1): 187–204.
Zhang, P., Z. Y. Yin, Y. F. Jin, T. Chan, and F. P. Gao. 2021. “Intelligent modelling of clay compressibility using hybrid meta-heuristic and machine learning algorithms.” Geosci. Front. 12 (1): 441–452. https://doi.org/10.1016/j.gsf.2020.02.014.
Zhang, P., Z. Y. Yin, Y. F. Jin, and T. H. T. Chan. 2020b. “A novel hybrid surrogate intelligent model for creep index prediction based on particle swarm optimization and random forest.” Eng. Geol. 265 (Feb): 105328. https://doi.org/10.1016/j.enggeo.2019.105328.
Zhang, P., and Z.-Y. Yin. 2021. “A novel deep learning-based modelling strategy from image of particles to mechanical properties for granular materials with CNN and BiLSTM.” Comput. Meth. Appl. Mech. Eng. 382 (Aug): 113858. https://doi.org/10.1016/j.cma.2021.113858.
Zhang, X., Y. Shan, W. Wei, and Z. Zhu. 2010. “An image segmentation method based on improved watershed algorithm.” In Proc., 2010 Int. Conf. on Computational and Information Sciences, 258–261. New York: IEEE.
Information & Authors
Information
Published In
Copyright
© 2022 American Society of Civil Engineers.
History
Received: Aug 24, 2021
Accepted: Jan 13, 2022
Published online: Feb 25, 2022
Published in print: May 1, 2022
Discussion open until: Jul 25, 2022
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited by
- Mao-Xin Wang, Andy Yat Fai Leung, Gang Wang, Pin Zhang, Semiempirical Predictive Models for Seismically Induced Slope Displacements Considering Ground Motion Directionality, Journal of Geotechnical and Geoenvironmental Engineering, 10.1061/JGGEFK.GTENG-11930, 150, 9, (2024).
- Yu Peng, Zhen-Yu Yin, Micromechanical analysis of suction pile-granular soil interaction under inclined pulling load: Effect of pulling angle, Ocean Engineering, 10.1016/j.oceaneng.2022.113615, 270, (113615), (2023).
- Zhibin Ren, Yiqiu Tan, Lan Huang, Guannan Li, Huijie Lv, Study on stochastic behavior of particle system in hot mix asphalt mixture from a meso-structural perspective, Construction and Building Materials, 10.1016/j.conbuildmat.2023.130844, 372, (130844), (2023).
- Abdelhalim Azam, Abidhan Bardhan, Mosbeh R. Kaloop, Pijush Samui, Fayez Alanazi, Majed Alzara, Ahmed M. Yosri, Modeling resilient modulus of subgrade soils using LSSVM optimized with swarm intelligence algorithms, Scientific Reports, 10.1038/s41598-022-17429-z, 12, 1, (2022).
- Yu Peng, Xuanming Ding, Zhen-Yu Yin, Pei Wang, Micromechanical analysis of the particle corner breakage effect on pile penetration resistance and formation of breakage zones in coral sand, Ocean Engineering, 10.1016/j.oceaneng.2022.111859, 259, (111859), (2022).