Abstract:As a fundamental but difficult topic in computer vision, 3D object segmentation has various applications in medical image analysis, autonomous vehicles, robotics, virtual reality, lithium battery image analysis, etc. In the past, 3D segmentation was performed using hand-made features and design techniques, but these techniques could not generalize to vast amounts of data or reach acceptable accuracy. Deep learning techniques have lately emerged as the preferred method for 3D segmentation jobs as a result of their extraordinary performance in 2D computer vision. Our proposed method used a CNN-based architecture called 3D UNET, which is inspired by the famous 2D UNET that has been used to segment volumetric image data. To see the internal changes of composite materials, for instance, in a lithium battery image, it is necessary to see the flow of different materials and follow the directions analyzing the inside properties. In this paper, a combination of 3D UNET and VGG19 has been used to conduct a multiclass segmentation of publicly available sandstone datasets to analyze their microstructures using image data based on four different objects in the samples of volumetric data. In our image sample, there are a total of 448 2D images, which are then aggregated as one 3D volume to examine the 3D volumetric data. The solution involves the segmentation of each object in the volume data and further analysis of each object to find its average size, area percentage, total area, etc. The open-source image processing package IMAGEJ is used for further analysis of individual particles. In this study, it was demonstrated that convolutional neural networks can be trained to recognize sandstone microstructure traits with an accuracy of 96.78% and an IOU of 91.12%. According to our knowledge, many prior works have applied 3D UNET for segmentation, but very few papers extend it further to show the details of particles in the sample. The proposed solution offers a computational insight for real-time implementation and is discovered to be superior to the current state-of-the-art methods. The result has importance for the creation of an approximately similar model for the microstructural analysis of volumetric data.

Scanning electron microscopy (SEM) image segmentation for microstructure analysis of concrete using U-net convolutional neural network

Ultrasonic Array Tomography-Oriented Subsurface Crack Recognition and Cross-Section Image Reconstruction of Reinforced Concrete Structure Using Deep Neural Networks

Image-based Concrete Crack Detection in Tunnels Using Deep Fully Convolutional Networks

Deep learning-based automated image segmentation for concrete petrographic analysis

Deep Learning Methods for Phase Segmentation in Backscattered Electron Images of Cement Paste and SCM-blended Systems

Automatic damage detection and segmentation using deep learning algorithms in reinforced concrete structure inspections

Stone Segmentation Based on Improved U-Net Network

Computer Vision Method for Automatic Detection of Microstructure Defects of Concrete

Concrete forensic analysis using deep learning-based coarse aggregate segmentation

Autonomous Concrete Crack Semantic Segmentation Using Deep Fully Convolutional Encoder–Decoder Network in Concrete Structures Inspection

Toward enhancing concrete crack segmentation accuracy under complex scenarios: a novel modified U-Net network

Deep Learning-Based Segmentation of 3D Volumetric Image and Microstructural Analysis

Segmentation of Concrete Cracks by Using Fractal Dimension and UHK-Net

Microstructural segmentation using a union of attention guided U-Net models with different color transformed images

Comparative Study on Concrete Crack Detection of Tunnel Based on Different Deep Learning Algorithms

A deep learning-based approach to extraction of filler morphology in SEM images with the application of automated quality inspection

MudrockNet: Semantic Segmentation of Mudrock SEM Images through Deep Learning

Multi-temporal crack segmentation in concrete structure using deep learning approaches

Segmentation of X-Ray Images of Rocks Using Deep Learning

A Data-Driven Approach for Automated Integrated Circuit Segmentation of Scan Electron Microscopy Images.

Pore characterization was achieved based on the improved U-net deep learning network model and scanning electron microscope images