Abstract:Deep learning networks are state-of-the-art approaches for 3D brain image segmentation, and the radiological characteristics extracted from tumors are of great significance for clinical diagnosis, treatment planning, and treatment outcome evaluation. However, two problems have been the hindering factors in brain image segmentation techniques. One is that deep learning networks require large amounts of manually annotated data. Another issue is the computational efficiency of 3D deep learning networks. In this study, we propose a vector quantization (VQ)-based 3D segmentation method that employs a novel unsupervised 3D deep embedding clustering (3D-DEC) network and an efficiency memory reserving-and-fading strategy. The VQ-based 3D-DEC network is trained on volume data in an unsupervised manner to avoid manual data annotation. The memory reserving-and-fading strategy beefs up model efficiency greatly. The designed methodology makes deep learning-based model feasible for biomedical image segmentation. The experiment is divided into two parts. First, we extensively evaluate the effectiveness and robustness of the proposed model on two authoritative MRI brain tumor databases (i.e., IBSR and BrainWeb). Second, we validate the model using real 3D brain tumor data collected from our institute for clinical practice significance. Results show that our method (without data manual annotation) has superior accuracy (0.74±0.04 Tanimoto coefficient on IBSR, 97.5% TP and 97.7% TN on BrainWeb, and 91% Dice, 88% sensitivity and 87% specificity on real brain data) and remarkable efficiency (speedup ratio is 18.72 on IBSR, 31.16 on BrainWeb, 31.00 on real brain data) compared to the state-of-the-art methods. The results show that our proposed model can address the lacks of manual annotations, and greatly increase computation speedup with competitive segmentation accuracy compared to other state-of-the-art 3D CNN models. Moreover, the proposed model can be used for tumor treatment follow-ups every 6 months, providing critical details for surgical and postoperative treatment by correctly extracting numerical radiomic features of tumors.

Instance Segmentation from Volumetric Biomedical Images Without Voxel-Wise Labeling.

Adaptive Decomposition and Shared Weight Volumetric Transformer Blocks for Efficient Patch-Free 3D Medical Image Segmentation.

Deep Learning Based Instance Segmentation in 3D Biomedical Images Using Weak Annotation

3D Multiple-Contextual ROI-Attention Network for Efficient and Accurate Volumetric Medical Image Segmentation.

Boosting Multilabel Semantic Segmentation for Somata and Vessels in Mouse Brain

Cerebrovascular Segmentation from TOF-MRA Using Model- and Data-Driven Method Via Sparse Labels

An efficient memory reserving-and-fading strategy for vector quantization based 3D brain segmentation and tumor extraction using an unsupervised deep learning network

Object-Guided Instance Segmentation for Biological Images

BoxNet: Deep Learning Based Biomedical Image Segmentation Using Boxes Only Annotation

DeepBrainSeg: Automated Brain Region Segmentation for Micro-Optical Images with a Convolutional Neural Network

Weakly Supervised 3D Instance Segmentation without Instance-level Annotations

3D Cnn-Based Soma Segmentation from Brain Images at Single-Neuron Resolution

Object-Guided Instance Segmentation With Auxiliary Feature Refinement for Biological Images

VoxelEmbed: 3D Instance Segmentation and Tracking with Voxel Embedding based Deep Learning

Deep Mouse: an End-to-End Auto-Context Refinement Framework for Brain Ventricle & Body Segmentation in Embryonic Mice Ultrasound Volumes

Fast interactive medical image segmentation with weakly supervised deep learning method

DDeep3M+: Adaptive Enhancement Powered Weakly Supervised Learning for Neuron Segmentation.

Semantic instance segmentation with discriminative deep supervision for medical images

A Multi-resolution Coarse-to-Fine Segmentation Framework with Active Learning in 3D Brain MRI

Weakly supervised instance segmentation via peak mining and filtering

Positional Information is a Strong Supervision for Volumetric Medical Image Segmentation