Abstract:As a fundamental but difficult topic in computer vision, 3D object segmentation has various applications in medical image analysis, autonomous vehicles, robotics, virtual reality, lithium battery image analysis, etc. In the past, 3D segmentation was performed using hand-made features and design techniques, but these techniques could not generalize to vast amounts of data or reach acceptable accuracy. Deep learning techniques have lately emerged as the preferred method for 3D segmentation jobs as a result of their extraordinary performance in 2D computer vision. Our proposed method used a CNN-based architecture called 3D UNET, which is inspired by the famous 2D UNET that has been used to segment volumetric image data. To see the internal changes of composite materials, for instance, in a lithium battery image, it is necessary to see the flow of different materials and follow the directions analyzing the inside properties. In this paper, a combination of 3D UNET and VGG19 has been used to conduct a multiclass segmentation of publicly available sandstone datasets to analyze their microstructures using image data based on four different objects in the samples of volumetric data. In our image sample, there are a total of 448 2D images, which are then aggregated as one 3D volume to examine the 3D volumetric data. The solution involves the segmentation of each object in the volume data and further analysis of each object to find its average size, area percentage, total area, etc. The open-source image processing package IMAGEJ is used for further analysis of individual particles. In this study, it was demonstrated that convolutional neural networks can be trained to recognize sandstone microstructure traits with an accuracy of 96.78% and an IOU of 91.12%. According to our knowledge, many prior works have applied 3D UNET for segmentation, but very few papers extend it further to show the details of particles in the sample. The proposed solution offers a computational insight for real-time implementation and is discovered to be superior to the current state-of-the-art methods. The result has importance for the creation of an approximately similar model for the microstructural analysis of volumetric data.

Stone Segmentation Based on Improved U-Net Network

Endoscopic Segmentation of Kidney Stone Based on Transfer Learning

Size Measurement of Stone Images Based on Improved UNet

Multi Mask Learning of Stone Segmentation for Auto-Monitoring System in TBM Construction

Real-time Water Area Segmentation for USV using Enhanced U-Net

High-Accuracy Image Segmentation Based on Hybrid Attention Mechanism for Sandstone Analysis

Deep learning-based automated image segmentation for concrete petrographic analysis

Research on Improved U-net Based Remote Sensing Image Segmentation Algorithm

An Improved Boundary-Aware U-Net for Ore Image Semantic Segmentation

Scanning electron microscopy (SEM) image segmentation for microstructure analysis of concrete using U-net convolutional neural network

Efficient image segmentation based on deep learning for mineral image classification

Enhancing Rock Image Segmentation in Digital Rock Physics: A Fusion of Generative AI and State-of-the-Art Neural Networks

Zero-Shot Kidney Stone Segmentation Based on Segmentation Anything Model for Robotic-Assisted Endoscope Navigation.

Segmentation of Seabed Sediment Images Based on Convolutional Neural Network

A Multi-Objective Semantic Segmentation Algorithm Based on Improved U-Net Networks

Image Segmentation Method on Quartz Particle-Size Detection by Deep Learning Networks

Toward enhancing concrete crack segmentation accuracy under complex scenarios: a novel modified U-Net network

Deep Learning-Based Segmentation of 3D Volumetric Image and Microstructural Analysis

Study on segmentation of blasting fragment images from open-pit mine based on U-CARFnet

Image segmentation of adhesive ores based on MSBA-Unet and convex-hull defect detection

An Ore Image Segmentation Method Based on RDU-Net Model