Abstract:Deep learning networks are state-of-the-art approaches for 3D brain image segmentation, and the radiological characteristics extracted from tumors are of great significance for clinical diagnosis, treatment planning, and treatment outcome evaluation. However, two problems have been the hindering factors in brain image segmentation techniques. One is that deep learning networks require large amounts of manually annotated data. Another issue is the computational efficiency of 3D deep learning networks. In this study, we propose a vector quantization (VQ)-based 3D segmentation method that employs a novel unsupervised 3D deep embedding clustering (3D-DEC) network and an efficiency memory reserving-and-fading strategy. The VQ-based 3D-DEC network is trained on volume data in an unsupervised manner to avoid manual data annotation. The memory reserving-and-fading strategy beefs up model efficiency greatly. The designed methodology makes deep learning-based model feasible for biomedical image segmentation. The experiment is divided into two parts. First, we extensively evaluate the effectiveness and robustness of the proposed model on two authoritative MRI brain tumor databases (i.e., IBSR and BrainWeb). Second, we validate the model using real 3D brain tumor data collected from our institute for clinical practice significance. Results show that our method (without data manual annotation) has superior accuracy (0.74±0.04 Tanimoto coefficient on IBSR, 97.5% TP and 97.7% TN on BrainWeb, and 91% Dice, 88% sensitivity and 87% specificity on real brain data) and remarkable efficiency (speedup ratio is 18.72 on IBSR, 31.16 on BrainWeb, 31.00 on real brain data) compared to the state-of-the-art methods. The results show that our proposed model can address the lacks of manual annotations, and greatly increase computation speedup with competitive segmentation accuracy compared to other state-of-the-art 3D CNN models. Moreover, the proposed model can be used for tumor treatment follow-ups every 6 months, providing critical details for surgical and postoperative treatment by correctly extracting numerical radiomic features of tumors.

3D Cnn-Based Soma Segmentation from Brain Images at Single-Neuron Resolution

Fast and Lightweight Network Improves Serial Brain Section Stitching

Neuron Segmentation Based on CNN with Semi-Supervised Regularization.

A 3D semantic segmentation network for accurate neuronal soma segmentation

nnSegNeXt: A 3D Convolutional Network for Brain Tissue Segmentation Based on Quality Evaluation

Neuron Image Segmentation via Learning Deep Features and Enhancing Weak Neuronal Structures

DDeep3M+: Adaptive Enhancement Powered Weakly Supervised Learning for Neuron Segmentation.

MRI tumor segmentation with densely connected 3D CNN

Pseudo-3D Fully Convolutional DenseNets for Brain Tumor Segmentation

Automatic rat brain image segmentation using triple cascaded convolutional neural networks in a clinical PET/MR

MedSegMamba: 3D CNN-Mamba Hybrid Architecture for Brain Segmentation

An efficient memory reserving-and-fading strategy for vector quantization based 3D brain segmentation and tumor extraction using an unsupervised deep learning network

Whole brain segmentation with full volume neural network

Deep Learning-Based Brain Image Segmentation for Automated Tumour Detection

Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentation

Deep learning with multiresolution handcrafted features for brain MRI segmentation

Boosting Multilabel Semantic Segmentation for Somata and Vessels in Mouse Brain

Multi-Center Brain Imaging Classification Using a Novel 3D CNN Approach.

Brain Image Segmentation for Ultrascale Neuron Reconstruction via an Adaptive Dual-Task Learning Network

Brain tumor segmentation via C-dense convolutional neural network

Semantic Segmentation of Neuronal Bodies in Fluorescence Microscopy Using a 2D+3D CNN Training Strategy with Sparsely Annotated Data