Abstract:As a fundamental but difficult topic in computer vision, 3D object segmentation has various applications in medical image analysis, autonomous vehicles, robotics, virtual reality, lithium battery image analysis, etc. In the past, 3D segmentation was performed using hand-made features and design techniques, but these techniques could not generalize to vast amounts of data or reach acceptable accuracy. Deep learning techniques have lately emerged as the preferred method for 3D segmentation jobs as a result of their extraordinary performance in 2D computer vision. Our proposed method used a CNN-based architecture called 3D UNET, which is inspired by the famous 2D UNET that has been used to segment volumetric image data. To see the internal changes of composite materials, for instance, in a lithium battery image, it is necessary to see the flow of different materials and follow the directions analyzing the inside properties. In this paper, a combination of 3D UNET and VGG19 has been used to conduct a multiclass segmentation of publicly available sandstone datasets to analyze their microstructures using image data based on four different objects in the samples of volumetric data. In our image sample, there are a total of 448 2D images, which are then aggregated as one 3D volume to examine the 3D volumetric data. The solution involves the segmentation of each object in the volume data and further analysis of each object to find its average size, area percentage, total area, etc. The open-source image processing package IMAGEJ is used for further analysis of individual particles. In this study, it was demonstrated that convolutional neural networks can be trained to recognize sandstone microstructure traits with an accuracy of 96.78% and an IOU of 91.12%. According to our knowledge, many prior works have applied 3D UNET for segmentation, but very few papers extend it further to show the details of particles in the sample. The proposed solution offers a computational insight for real-time implementation and is discovered to be superior to the current state-of-the-art methods. The result has importance for the creation of an approximately similar model for the microstructural analysis of volumetric data.

Vision-based volumetric measurements via deep learning-based point cloud segmentation for material management in jobsites

Deep learning-based semantic segmentation of machinable volumes for cyber manufacturing service

Automatic Segmentation of Bulk Material Heaps Using Color, Texture, and Topography from Aerial Data and Deep Learning-Based Computer Vision

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

Measure Anything: Real-time, Multi-stage Vision-based Dimensional Measurement using Segment Anything

Enhanced Motion Estimation for Autonomous Excavation: Accelerated Semantic Segmentation and ORB Features for Unstructured Environments

Improving completeness and accuracy of 3D point clouds by using deep learning for applications of digital twins to civil structures

Deep Learning-Based Segmentation of 3D Volumetric Image and Microstructural Analysis

Material augmented semantic segmentation of point clouds for building elements

Simultaneous Material Segmentation and 3D Reconstruction in Industrial Scenarios

Deep Learning Based Semantic Segmentation for BIM Model Generation from RGB-D Sensors

Ground material classification for UAV-based photogrammetric 3D data A 2D-3D Hybrid Approach

Robust Detection, Segmentation, and Metrology of High Bandwidth Memory 3D Scans Using an Improved Semi-Supervised Deep Learning Approach

Displacement Measurement and 3D Reconstruction of Segmental Retaining Wall Using Deep Convolutional Neural Networks and Binocular Stereovision

Uplifting Range-View-based 3D Semantic Segmentation in Real-Time with Multi-Sensor Fusion

Linear Feature-Based Image/LiDAR Integration for a Stockpile Monitoring and Reporting Technology

DIVESPOT: Depth Integrated Volume Estimation of Pile of Things Based on Point Cloud

Volumetric Instance-Aware Semantic Mapping and 3D Object Discovery

PointDMS: An Improved Deep Learning Neural Network via Multi-Feature Aggregation for Large-Scale Point Cloud Segmentation in Smart Applications of Urban Forestry Management

Deep learning‐based object identification with instance segmentation and pseudo‐LiDAR point cloud for work zone safety

Voxel-based 3D Point Cloud Semantic Segmentation: Unsupervised Geometric and Relationship Featuring vs Deep Learning Methods