Abstract:Recent advances in 3D fully convolutional networks (FCN) have made it feasible to produce dense voxel-wise predictions of volumetric images. In this work, we show that a multi-class 3D FCN trained on manually labeled CT scans of several anatomical structures (ranging from the large organs to thin vessels) can achieve competitive segmentation results, while avoiding the need for handcrafting features or training class-specific models. To this end, we propose a two-stage, coarse-to-fine approach that will first use a 3D FCN to roughly define a candidate region, which will then be used as input to a second 3D FCN. This reduces the number of voxels the second FCN has to classify to ∼10% and allows it to focus on more detailed segmentation of the organs and vessels. We utilize training and validation sets consisting of 331 clinical CT images and test our models on a completely unseen data collection acquired at a different hospital that includes 150 CT scans, targeting three anatomical organs (liver, spleen, and pancreas). In challenging organs such as the pancreas, our cascaded approach improves the mean Dice score from 68.5 to 82.2%, achieving the highest reported average score on this dataset. We compare with a 2D FCN method on a separate dataset of 240 CT scans with 18 classes and achieve a significantly higher performance in small organs and vessels. Furthermore, we explore fine-tuning our models to different datasets. Our experiments illustrate the promise and robustness of current 3D FCN based semantic segmentation of medical images, achieving state-of-the-art results.<sup>1</sup>.

Collaborative Multi-View Convolutions with Gating for Accurate and Fast Volumetric Medical Image Segmentation

3D Multiple-Contextual ROI-Attention Network for Efficient and Accurate Volumetric Medical Image Segmentation.

3D ConvNet+: A lightweight adaptive network for 3D medical image segmentation

3D U$$^$$-Net: A 3D Universal U-Net for Multi-domain Medical Image Segmentation

3D LVCN: A Lightweight Volumetric ConvNet

V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation

3D Tiled Convolution for Effective Segmentation of Volumetric Medical Images

Combined 3D CNN for Brain Tumor Segmentation

Brain tumor segmentation via C-dense convolutional neural network

A Lightweight Multi-Scale Multi-Angle Dynamic Interactive Transformer-CNN Fusion Model for 3D Medical Image Segmentation

An application of cascaded 3D fully convolutional networks for medical image segmentation

Automatic 3D Medical Image Segmentation with Densely-Connected Volumetric ConvNets

3D Global Convolutional Adversarial Network\\ for Prostate MR Volume Segmentation

3D bi-directional transformer U-Net for medical image segmentation

Group Shift Pointwise Convolution for Volumetric Medical Image Segmentation.

Volumetric ConvNets with Mixed Residual Connections for Automated Prostate Segmentation from 3D MR Images

Automatic Brain Tumor Segmentation By Exploring The Multi-Modality Complementary Information And Cascaded 3d Lightweight Cnns

ConvMedSegNet:A multi-receptive field depthwise convolutional neural network for medical image segmentation

Efficient 3D Depthwise and Separable Convolutions with Dilation for Brain Tumor Segmentation.

Y-CA-Net: A Convolutional Attention Based Network for Volumetric Medical Image Segmentation

3D Dilated Multi-Fiber Network for Real-time Brain Tumor Segmentation in MRI