Abstract:Deep learning networks are state-of-the-art approaches for 3D brain image segmentation, and the radiological characteristics extracted from tumors are of great significance for clinical diagnosis, treatment planning, and treatment outcome evaluation. However, two problems have been the hindering factors in brain image segmentation techniques. One is that deep learning networks require large amounts of manually annotated data. Another issue is the computational efficiency of 3D deep learning networks. In this study, we propose a vector quantization (VQ)-based 3D segmentation method that employs a novel unsupervised 3D deep embedding clustering (3D-DEC) network and an efficiency memory reserving-and-fading strategy. The VQ-based 3D-DEC network is trained on volume data in an unsupervised manner to avoid manual data annotation. The memory reserving-and-fading strategy beefs up model efficiency greatly. The designed methodology makes deep learning-based model feasible for biomedical image segmentation. The experiment is divided into two parts. First, we extensively evaluate the effectiveness and robustness of the proposed model on two authoritative MRI brain tumor databases (i.e., IBSR and BrainWeb). Second, we validate the model using real 3D brain tumor data collected from our institute for clinical practice significance. Results show that our method (without data manual annotation) has superior accuracy (0.74±0.04 Tanimoto coefficient on IBSR, 97.5% TP and 97.7% TN on BrainWeb, and 91% Dice, 88% sensitivity and 87% specificity on real brain data) and remarkable efficiency (speedup ratio is 18.72 on IBSR, 31.16 on BrainWeb, 31.00 on real brain data) compared to the state-of-the-art methods. The results show that our proposed model can address the lacks of manual annotations, and greatly increase computation speedup with competitive segmentation accuracy compared to other state-of-the-art 3D CNN models. Moreover, the proposed model can be used for tumor treatment follow-ups every 6 months, providing critical details for surgical and postoperative treatment by correctly extracting numerical radiomic features of tumors.

Two-Stage Deep Learning Segmentation for Tiny Brain Regions.

Shape-Scale Co-Awareness Network for 3D Brain Tumor Segmentation.

Region-based U-net for accelerated training and enhanced precision in deep brain segmentation

BrainSegFounder: Towards 3D foundation models for neuroimage segmentation

Automatic Segmentation of MRI of Brain Tumor Using Deep Convolutional Network

Exclusive Independent Probability Estimation using Deep 3D Fully Convolutional DenseNets: Application to IsoIntense Infant Brain MRI Segmentation

Quality-driven deep active learning method for 3D brain MRI segmentation

DeSeg: auto detector-based segmentation for brain metastases

Label-Efficient 3D Brain Segmentation via Complementary 2D Diffusion Models with Orthogonal Views

nnSegNeXt: A 3D Convolutional Network for Brain Tissue Segmentation Based on Quality Evaluation

Generalizing deep learning brain segmentation for skull removal and intracranial measurements.

Robust Brain Magnetic Resonance Image Segmentation for Hydrocephalus Patients: Hard and Soft Attention

Brain Tumor Segmentation Based on Deep Learning, Attention Mechanisms, and Energy-Based Uncertainty Prediction

DeepMRSeg: A convolutional deep neural network for anatomy and abnormality segmentation on MR images

An efficient memory reserving-and-fading strategy for vector quantization based 3D brain segmentation and tumor extraction using an unsupervised deep learning network

Adaptable Global Network for Whole-Brain Segmentation with Symmetry Consistency Loss

Multiscale lightweight 3D segmentation algorithm with attention mechanism: Brain tumor image segmentation

Subcortical Brain Segmentation Based on Atlas Registration and Linearized Kernel Sparse Representative Classifier

Segmentation of Brain Metastases in MRI: A Two-Stage Deep Learning Approach with Modality Impact Study

Transfer Learning from Partial Annotations for Whole Brain Segmentation

Deep Learning-based Segmentation of Cerebral Aneurysms in 3D TOF-MRA using Coarse-to-Fine Framework