Deep Learning-Based Segmentation for Field Evaluation of Riprap and Large-Sized Aggregates
Publication: Geo-Congress 2023
ABSTRACT
Aggregate materials play essential roles in the sustainable performance of engineering applications. Size and shape properties of these aggregates determine the composition and packing of the aggregate assemblies, which impact layer strength, modulus, and deformation response under wheel loading. Current state-of-the-practice methods to evaluate aggregate properties rely on visual inspection, manual measurements, material sampling, and laboratory sieve analysis, as well as ground penetrating radar (GPR) for on-site inspection. Advanced aggregate imaging systems developed to date primarily focused on measurement of separated or slightly contacting aggregate particles, which is not applicable for densely stacked aggregate assemblies under field conditions. In this regard, development of a reliable, accurate, and cost-effective field evaluation technique is crucial. This paper presents an innovative approach using deep learning-based image segmentation techniques for evaluating aggregate materials in the field. The approach requires preparing an image data set comprised of aggregate images collected from various field and laboratory sites, where each image is manually labeled to identify individual particle locations by tracing their boundaries. Then, a state-of-the-art object detection and segmentation framework, called Mask R-CNN, is trained on the task-specific data set to develop the image segmentation kernel. Finally, the trained segmentation kernel is used to segment individual particles, and post-processing provides the morphological indices for the segmented particles. This segmentation approach has been utilized for the field evaluation of large-sized riprap materials and medium-sized ballast materials, with further performance tuning to address various field conditions. The segmentation results show good agreement with the ground-truth labeling and greatly improves the accuracy and efficiency of aggregate field evaluation procedures. Based on the presented findings, the deep learning-based segmentation approach can serve as an efficient and reliable tool for determining aggregate shape and morphological properties in field evaluation applications.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Fowler, D. W., and Quiroga, P. N. (2003). The effects of aggregate characteristics on the performance of Portland cement concrete. International Centre for Aggregate Research, ICAR, 104.
Wnek, M. A., Tutumluer, E., Moaveni, M., and Gehringer, E. (2013). Investigation of aggregate properties influencing railroad ballast performance. Transportation research record, 2374(1), 180–189.
Tutumluer, E., and Pan, T. (2008). Aggregate morphology affecting strength and permanent deformation behavior of unbound aggregate materials. Journal of materials in civil engineering, 20(9), 617–627.
Lagasse, P. F. (2006). Riprap design criteria, recommended specifications, and quality control (Vol. 568). Transportation Research Board.
Barrett, P. J. (1980). The shape of rock particles, a critical review. Sedimentology, 27(3), 291–303.
Stark, T. D., and Wilk, S. T. (2018). Sampling, reconstituting, and gradation testing of railroad ballast. Railroad Ballast Testing and Properties, ASTM STP1605, 125–133.
Huang, H., Luo, J., Tutumluer, E., Hart, J. M., and Stolba, A. J. (2020). Automated segmentation and morphological analyses of stockpile aggregate images using deep convolutional neural networks. Transportation Research Record, 2674(10), 285–298.
Huang, H., Luo, J., Tutumluer, E., Hart, J. M., and Qamhia, I. (2020). Size and shape determination of riprap and large-sized aggregates using field imaging. Illinois Center for Transportation/Illinois Department of Transportation.
Masad, E., Al-Rousan, T., Bathina, M., McGahan, J., and Spiegelman, C. (2007). Analysis of aggregate shape characteristics and its relationship to hot mix asphalt performance. Road Materials and Pavement Design, 8(2), 317–350.
Gates, L., Masad, E., Pyle, R., and Bushee, D. (2011). Aggregate imaging measurement system 2 (AIMS2).
Tutumluer, E., Rao, C., and Stefanski, J. A. (2000). Video image analysis of aggregates.
Moaveni, M., Wang, S., Hart, J. M., Tutumluer, E., and Ahuja, N. (2013). Evaluation of aggregate size and shape by means of segmentation techniques and aggregate image processing algorithms. Transportation research record, 2335(1), 50–59.
He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017). Mask r-cnn. In Proceedings of the IEEE international conference on computer vision (pp. 2961–2969).
Tutumluer, E., Ahuja, N., Hart, J. M., Moaveni, M., Huang, H., Zhao, Z., and Shah, S. (2017). Field evaluation of ballast fouling conditions using machine vision (No. Safety- 27).
Selig, E. T., and Waters, J. M. (1994). Track geotechnology and substructure management. Thomas Telford.
Dutta, A., Gupta, A., and Zissermann, A. (2016). VGG image annotator (VIA). URL: http://www. robots. ox. ac. uk/vgg/software/via, 2.
Ren, S., He, K., Girshick, R., and Sun, J. (2015). Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in neural information processing systems, 28.
Long, J., Shelhamer, E., and Darrell, T. (2015). Fully convolutional networks for semantic s egmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 3431–3440).
Information & Authors
Information
Published In
History
Published online: Mar 23, 2023
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.