Abstract:Class imbalance has emerged as one of the major challenges for medical image segmentation. The model cascade (MC) strategy, a popular scheme, significantly alleviates the class imbalance issue via running a set of individual deep models for coarse-to-fine segmentation. Despite its outstanding performance, however, this method leads to undesired system complexity and also ignores the correlation among the models. To handle these flaws in the MC approach, we propose in this paper a light-weight deep model, i.e., the One-pass Multi-task Network (OM-Net) to solve class imbalance better than MC does, while requiring only one-pass computation for brain tumor segmentation. First, OM-Net integrates the separate segmentation tasks into one deep model, which consists of shared parameters to learn joint features, as well as task-specific parameters to learn discriminative features. Second, to more effectively optimize OM-Net, we take advantage of the correlation among tasks to design both an online training data transfer strategy and a curriculum learning-based training strategy. Third, we further propose sharing prediction results between tasks, which enables us to design a cross-task guided attention (CGA) module. By following the guidance of the prediction results provided by the previous task, CGA can adaptively recalibrate channel-wise feature responses based on the category-specific statistics. Finally, a simple yet effective post-processing method is introduced to refine the segmentation results of the proposed attention network. Extensive experiments are conducted to demonstrate the effectiveness of the proposed techniques. Most impressively, we achieve state-of-the-art performance on the BraTS 2015 testing set and BraTS 2017 online validation set. Using these proposed approaches, we also won joint third place in the BraTS 2018 challenge among 64 participating teams. The code is publicly available at https://github.com/chenhong-zhou/OM-Net.

One-Pass Multi-task Convolutional Neural Networks for Efficient Brain Tumor Segmentation.

One-Pass Multi-Task Networks with Cross-Task Guided Attention for Brain Tumor Segmentation

Multi-step Cascaded Networks for Brain Tumor Segmentation

Deep Cascaded Attention Network for Multi-task Brain Tumor Segmentation.

Dual-force Convolutional Neural Networks for Accurate Brain Tumor Segmentation

Automatic Brain Tumor Segmentation Using Cascaded Anisotropic Convolutional Neural Networks

Automatic Brain Tumor Segmentation By Exploring The Multi-Modality Complementary Information And Cascaded 3d Lightweight Cnns

Effective and Efficient Multitask Learning for Brain Tumor Segmentation

Multi-Scale Masked 3-D U-Net For Brain Tumor Segmentation

Brain Tumor Segmentation Network with Multi-View Ensemble Discrimination and Kernel-Sharing Dilated Convolution.

Multiscale Cnns For Brain Tumor Segmentation And Diagnosis

A Deep-Learning Model with Learnable Group Convolution and Deep Supervision for Brain Tumor Segmentation

Automatic Segmentation of MRI of Brain Tumor Using Deep Convolutional Network

A deep learning model integrating FCNNs and CRFs for brain tumor segmentation

Brain Tumor Segmentation Using a Fully Convolutional Neural Network with Conditional Random Fields.

Effective Multipath Feature Extraction 3D CNN for Multimodal Brain Tumor Segmentation

Cascade Residual Multiscale Convolution and Mamba-Structured UNet for Advanced Brain Tumor Image Segmentation

DPAFNet: A Residual Dual-Path Attention-Fusion Convolutional Neural Network for Multimodal Brain Tumor Segmentation

Multi-scale Strategy Based 3D Dual-Encoder Brain Tumor Segmentation Network with Attention Mechanism.

Efficient 3D Depthwise and Separable Convolutions with Dilation for Brain Tumor Segmentation.

A Multi-task Contextual Atrous Residual Network for Brain Tumor Detection & Segmentation