Abstract:As a fundamental but difficult topic in computer vision, 3D object segmentation has various applications in medical image analysis, autonomous vehicles, robotics, virtual reality, lithium battery image analysis, etc. In the past, 3D segmentation was performed using hand-made features and design techniques, but these techniques could not generalize to vast amounts of data or reach acceptable accuracy. Deep learning techniques have lately emerged as the preferred method for 3D segmentation jobs as a result of their extraordinary performance in 2D computer vision. Our proposed method used a CNN-based architecture called 3D UNET, which is inspired by the famous 2D UNET that has been used to segment volumetric image data. To see the internal changes of composite materials, for instance, in a lithium battery image, it is necessary to see the flow of different materials and follow the directions analyzing the inside properties. In this paper, a combination of 3D UNET and VGG19 has been used to conduct a multiclass segmentation of publicly available sandstone datasets to analyze their microstructures using image data based on four different objects in the samples of volumetric data. In our image sample, there are a total of 448 2D images, which are then aggregated as one 3D volume to examine the 3D volumetric data. The solution involves the segmentation of each object in the volume data and further analysis of each object to find its average size, area percentage, total area, etc. The open-source image processing package IMAGEJ is used for further analysis of individual particles. In this study, it was demonstrated that convolutional neural networks can be trained to recognize sandstone microstructure traits with an accuracy of 96.78% and an IOU of 91.12%. According to our knowledge, many prior works have applied 3D UNET for segmentation, but very few papers extend it further to show the details of particles in the sample. The proposed solution offers a computational insight for real-time implementation and is discovered to be superior to the current state-of-the-art methods. The result has importance for the creation of an approximately similar model for the microstructural analysis of volumetric data.

DeepSeeded: Volumetric Segmentation of Dense Cell Populations with a Cascade of Deep Neural Networks in Bacterial Biofilm Applications

Single‐cell segmentation in bacterial biofilms with an optimized deep learning method enables tracking of cell lineages and measurements of growth rates

A novel deep learning-based 3D cell segmentation framework for future image-based disease detection

Learn to segment single cells with deep distance estimator and deep cell detector

Graph-Theoretic Post-Processing of Segmentation With Application to Dense Biofilms

Deep Temporal Sequence Classification and Mathematical Modeling for Cell Tracking in Dense 3D Microscopy Videos of Bacterial Biofilms

Deep Learning Enabled Time-Lapse 3D Cell Analysis

Automated Cell Structure Extraction for 3D Electron Microscopy by Deep Learning

Attention-Guided Residual U-Net with SE Connection and ASPP for Watershed-Based Cell Segmentation in Microscopy Images

Cascaded Diffusion Models for 2D and 3D Microscopy Image Synthesis to Enhance Cell Segmentation

Two-stage Generative Models of Simulating Training Data at the Voxel Level for Large-Scale Microscopy Bioimage Segmentation

Benchmarking of deep learning algorithms for 3D instance segmentation of confocal image datasets

Deep learning based semantic segmentation and quantification for MRD biochip images

Deep Learning-Based Segmentation of 3D Volumetric Image and Microstructural Analysis

A deep learning-based strategy for producing dense 3D segmentations from sparsely annotated 2D images

Accurate 3D Cell Segmentation using Deep Feature and CRF Refinement

Active mesh and neural network pipeline for cell aggregate segmentation

DDeep3M-based Neuronal Cell Counting in 2D Large-scale Images

An AI-based approach for detecting cells and microbial byproducts in low volume scanning electron microscope images of biofilms

Automated segmentation of cell organelles in volume electron microscopy using deep learning

DeepSea is an efficient deep-learning model for single-cell segmentation and tracking in time-lapse microscopy