Abstract:As a fundamental but difficult topic in computer vision, 3D object segmentation has various applications in medical image analysis, autonomous vehicles, robotics, virtual reality, lithium battery image analysis, etc. In the past, 3D segmentation was performed using hand-made features and design techniques, but these techniques could not generalize to vast amounts of data or reach acceptable accuracy. Deep learning techniques have lately emerged as the preferred method for 3D segmentation jobs as a result of their extraordinary performance in 2D computer vision. Our proposed method used a CNN-based architecture called 3D UNET, which is inspired by the famous 2D UNET that has been used to segment volumetric image data. To see the internal changes of composite materials, for instance, in a lithium battery image, it is necessary to see the flow of different materials and follow the directions analyzing the inside properties. In this paper, a combination of 3D UNET and VGG19 has been used to conduct a multiclass segmentation of publicly available sandstone datasets to analyze their microstructures using image data based on four different objects in the samples of volumetric data. In our image sample, there are a total of 448 2D images, which are then aggregated as one 3D volume to examine the 3D volumetric data. The solution involves the segmentation of each object in the volume data and further analysis of each object to find its average size, area percentage, total area, etc. The open-source image processing package IMAGEJ is used for further analysis of individual particles. In this study, it was demonstrated that convolutional neural networks can be trained to recognize sandstone microstructure traits with an accuracy of 96.78% and an IOU of 91.12%. According to our knowledge, many prior works have applied 3D UNET for segmentation, but very few papers extend it further to show the details of particles in the sample. The proposed solution offers a computational insight for real-time implementation and is discovered to be superior to the current state-of-the-art methods. The result has importance for the creation of an approximately similar model for the microstructural analysis of volumetric data.

Voxel2Mesh: 3D Mesh Model Generation from Volumetric Data

Neural Volumetric Mesh Generator

Two-stage Generative Models of Simulating Training Data at the Voxel Level for Large-Scale Microscopy Bioimage Segmentation

Volumetric Segmentation Of 3d Mesh Models

A novel segmentation algorithm for complex 3D mesh model in computer vision.

A voxelized point clouds representation for object classification and segmentation on 3D data

VV-Net: Voxel VAE Net with Group Convolutions for Point Cloud Segmentation

Skull Segmentation from CBCT Images via Voxel-Based Rendering

V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation

Generative and Discriminative Voxel Modeling with Convolutional Neural Networks

VoxResNet: Deep Voxelwise Residual Networks for Volumetric Brain Segmentation

Vox2Cortex: Fast Explicit Reconstruction of Cortical Surfaces from 3D MRI Scans with Geometric Deep Neural Networks

VoxelEmbed: 3D Instance Segmentation and Tracking with Voxel Embedding based Deep Learning

Voxel-based 3D Point Cloud Semantic Segmentation: Unsupervised Geometric and Relationship Featuring vs Deep Learning Methods

The generation of tetrahedral mesh models for neuroanatomical MRI

A 3D Convolutional Neural Network for Volumetric Image Semantic Segmentation

Deep Sequential Segmentation of Organs in Volumetric Medical Scans

SAM3D: Segment Anything Model in Volumetric Medical Images

Deep Learning-Based Segmentation of 3D Volumetric Image and Microstructural Analysis

SparseVoxNet: 3-D Object Recognition With Sparsely Aggregation of 3-D Dense Blocks

World of Forms: Deformable Geometric Templates for One-Shot Surface Meshing in Coronary CT Angiography