Abstract:Direct automatic segmentation of objects in 3D medical imaging, such as magnetic resonance (MR) imaging, is challenging as it often involves accurately identifying multiple individual structures with complex geometries within a large volume under investigation. Most deep learning approaches address these challenges by enhancing their learning capability through a substantial increase in trainable parameters within their models. An increased model complexity will incur high computational costs and large memory requirements unsuitable for real-time implementation on standard clinical workstations, as clinical imaging systems typically have low-end computer hardware with limited memory and CPU resources only. This paper presents a compact convolutional neural network (CAN3D) designed specifically for clinical workstations and allows the segmentation of large 3D Magnetic Resonance (MR) images in real-time. The proposed CAN3D has a shallow memory footprint to reduce the number of model parameters and computer memory required for state-of-the-art performance and maintain data integrity by directly processing large full-size 3D image input volumes with no patches required. The proposed architecture significantly reduces computational costs, especially for inference using the CPU. We also develop a novel loss function with extra shape constraints to improve segmentation accuracy for imbalanced classes in 3D MR images. Compared to state-of-the-art approaches (U-Net3D, improved U-Net3D and V-Net), CAN3D reduced the number of parameters up to two orders of magnitude and achieved much faster inference, up to 5 times when predicting with a standard commercial CPU (instead of GPU). For the open-access OAI-ZIB knee MR dataset, in comparison with manual segmentation, CAN3D achieved Dice coefficient values of (mean = 0.87 ± 0.02 and 0.85 ± 0.04) with mean surface distance errors (mean = 0.36 ± 0.32 mm and 0.29 ± 0.10 mm) for imbalanced classes such as (femoral and tibial) cartilage volumes respectively when training volume-wise under only 12G video memory. Similarly, CAN3D demonstrated high accuracy and efficiency on a pelvis 3D MR imaging dataset for prostate cancer consisting of 211 examinations with expert manual semantic labels (bladder, body, bone, rectum, prostate) now released publicly for scientific use as part of this work.

7T Guided 3T Brain Tissue Segmentation Using Cascaded Nested Network

A Cascaded Nested Network for 3T Brain MR Image Segmentation Guided by 7T Labeling.

Generative Adversarial Network Based Cerebrovascular Segmentation for Time-of-flight Magnetic Resonance Angiography Image

Deep Cascaded Attention Network for Multi-task Brain Tumor Segmentation.

APRNet: A 3D Anisotropic Pyramidal Reversible Network with Multi-Modal Cross-Dimension Attention for Brain Tissue Segmentation in MR Images.

CAN: Context-assisted full Attention Network for brain tissue segmentation

CAN3D: Fast 3D medical image segmentation via compact context aggregation

Joint Reconstruction and Segmentation of 7T-Like MR Images from 3T MRI Based on Cascaded Convolutional Neural Networks

Syn_SegNet: A Joint Deep Neural Network for Ultrahigh-Field 7 T MRI Synthesis and Hippocampal Subfield Segmentation in Routine 3 T MRI

Syn_SegNet: A Joint Deep Neural Network for Ultrahigh-Field 7T MRI Synthesis and Hippocampal Subfield Segmentation in Routine 3T MRI.

Nested Dilation Networks for Brain Tumor Segmentation Based on Magnetic Resonance Imaging

Deep Cerebellar Nuclei Segmentation via Semi-Supervised Deep Context-Aware Learning from 7T Diffusion MRI

Learning-based 3T brain MRI segmentation with guidance from 7T MRI labeling.

nnSegNeXt: A 3D Convolutional Network for Brain Tissue Segmentation Based on Quality Evaluation

A 3D Spatially Weighted Network for Segmentation of Brain Tissue from MRI

Multi-Scale Masked 3-D U-Net For Brain Tumor Segmentation

Robust 3D Convolutional Neural Network with Boundary Correction for Accurate Brain Tissue Segmentation.

Tissue Segmentation of Thick-Slice Fetal Brain MR Scans with Guidance from High-Quality Isotropic Volumes

CAU-Net: A Deep Learning Method for Deep Gray Matter Nuclei Segmentation.

Combined 3D CNN for Brain Tumor Segmentation

RP-Net: A 3D Convolutional Neural Network for Brain Segmentation from Magnetic Resonance Imaging.