Abstract:Deep learning networks are state-of-the-art approaches for 3D brain image segmentation, and the radiological characteristics extracted from tumors are of great significance for clinical diagnosis, treatment planning, and treatment outcome evaluation. However, two problems have been the hindering factors in brain image segmentation techniques. One is that deep learning networks require large amounts of manually annotated data. Another issue is the computational efficiency of 3D deep learning networks. In this study, we propose a vector quantization (VQ)-based 3D segmentation method that employs a novel unsupervised 3D deep embedding clustering (3D-DEC) network and an efficiency memory reserving-and-fading strategy. The VQ-based 3D-DEC network is trained on volume data in an unsupervised manner to avoid manual data annotation. The memory reserving-and-fading strategy beefs up model efficiency greatly. The designed methodology makes deep learning-based model feasible for biomedical image segmentation. The experiment is divided into two parts. First, we extensively evaluate the effectiveness and robustness of the proposed model on two authoritative MRI brain tumor databases (i.e., IBSR and BrainWeb). Second, we validate the model using real 3D brain tumor data collected from our institute for clinical practice significance. Results show that our method (without data manual annotation) has superior accuracy (0.74±0.04 Tanimoto coefficient on IBSR, 97.5% TP and 97.7% TN on BrainWeb, and 91% Dice, 88% sensitivity and 87% specificity on real brain data) and remarkable efficiency (speedup ratio is 18.72 on IBSR, 31.16 on BrainWeb, 31.00 on real brain data) compared to the state-of-the-art methods. The results show that our proposed model can address the lacks of manual annotations, and greatly increase computation speedup with competitive segmentation accuracy compared to other state-of-the-art 3D CNN models. Moreover, the proposed model can be used for tumor treatment follow-ups every 6 months, providing critical details for surgical and postoperative treatment by correctly extracting numerical radiomic features of tumors.

Spatial Probabilistic Distribution Map Based 3D FCN for Visual Pathway Segmentation

3D Multiple-Contextual ROI-Attention Network for Efficient and Accurate Volumetric Medical Image Segmentation.

Automatic Segmentation of 3D Perivascular Spaces in 7T MR Images Using Multi-Channel Fully Convolutional Network.

Multi-channel multi-scale fully convolutional network for 3D perivascular spaces segmentation in 7T MR images.

3d Brain Tumor Image Segmentation Integrating Cascaded Anisotropic Fully Convolutional Neural Network And Hybrid Level Set Method

Automatic Segmentation Of Brain Tumor Using 3d Se-Inception Networks With Residual Connections

Brain Tumor Segmentation Using 3D Mask R-CNN for Dynamic Susceptibility Contrast Enhanced Perfusion Imaging.

SS-Net: 3D Spatial-Spectral Network for Cerebrovascular Segmentation in TOF-MRA

Brain Tumor Segmentation Using a Fully Convolutional Neural Network with Conditional Random Fields.

Cerebrovascular segmentation in phase-contrast magnetic resonance angiography by a Radon projection composition network

3D Reconstruction-Oriented Fully Automatic Multi-Modal Tumor Segmentation by Dual Attention-Guided VNet

Automatic MRI Prostate Segmentation Using 3D Deeply Supervised FCN with Concatenated Atrous Convolution

3D Deep Neural Network-Based Brain Tumor Segmentation Using Multimodality Magnetic Resonance Sequences.

An Improved Three-Dimensional Dual-Path Brain Tumor Image Segmentation Network

Iterative Spatial Fuzzy Clustering for 3D Brain Magnetic Resonance Image Supervoxel Segmentation

Pseudo-3D Fully Convolutional DenseNets for Brain Tumor Segmentation

A 3D Spatially Weighted Network for Segmentation of Brain Tissue from MRI

An efficient memory reserving-and-fading strategy for vector quantization based 3D brain segmentation and tumor extraction using an unsupervised deep learning network

Priors-guided Convolutional Neural Network for 3D Foveal Avascular Zone Segmentation.

3D Dilated Multi-Fiber Network for Real-time Brain Tumor Segmentation in MRI

Post-Op Brain Tumor Bed Detection and Segmentation Using 3D Mask R-CNN for Dynamic Magnetic Resonance Perfusion Imaging