Abstract:Brain tumor segmentation plays an important role in diagnosing brain tumor. Nowadays, intense interest has been received in applying convolution neural networks in medical image analysis, but its performance is restricted by the limitation of the depth of the network. And how to accelerate the information propagation and make full use of all the hierarchical features in the network is also of vital importance. To address these problems, this paper proposed Deep Residual Dilate Network with Middle Supervision (RDM-Net), which combines the residual network with dilated convolution. It can solve the problem of vanishing gradient and increase the receptive field without reducing the resolution. During images processing, some information of regions of small tumor could be discarded, for its resolution is attenuated to a single pixel by continuously convolutional operations. Therefore, the spatial fusion block, consisting of a pixel discriminator and a region discriminator, has been designed to reserve the detailed information in the region of small tumor. It evaluates the relationship between this single pixel and its adjacent region to obtain the spatial structure information of brain tumors. Furthermore, the middle supervision block consisting of proposal pyramid and multi-hierarchical loss is proposed, which shortens the distance of information path and reduces cumulative errors during the network training. The proposal pyramid is inspired by the idea of boost learning, which fuses each proposal at multiple resolution level to ensure that the network produces better predictions. Multi-hierarchical loss combines the loss of intermediate proposal in the middle layers and the loss of prediction of the output layer to achieve the effect of middle supervision. The results of experiments illustrate that our framework can effectively propagate features of each layer and increase the diversity of information to enhance feature hierarchy for medical image recognition. Compared to other state-of-the-art methods, our framework has performed well in the BRATS2015 challenge. In summary, the main contribution in our paper is that this work is an early attempt to adopt the concept of middle supervision on multi-modal brain tumor segmentation.

Efficient Brain Tumor Segmentation with Dilated Multi-fiber Network and Weighted Bi-directional Feature Pyramid Network

3D Dilated Multi-Fiber Network for Real-time Brain Tumor Segmentation in MRI

An N-Shaped Lightweight Network with a Feature Pyramid and Hybrid Attention for Brain Tumor Segmentation

Parallel pathway dense neural network with weighted fusion structure for brain tumor segmentation

DFP-ResUNet:Convolutional Neural Network with a Dilated Convolutional Feature Pyramid for Multimodal Brain Tumor Segmentation

DPAFNet: A Residual Dual-Path Attention-Fusion Convolutional Neural Network for Multimodal Brain Tumor Segmentation

A multi-path adaptive fusion network for multimodal brain tumor segmentation

How to Improve the Deep Residual Network to Segment Multi-Modal Brain Tumor Images

Efficient 3D Depthwise and Separable Convolutions with Dilation for Brain Tumor Segmentation.

Multi-view Hierarchical Split Network for Brain Tumor Segmentation.

Remu-Net: Multi-Branch Net Framework for 3D Brain Tumor Segmentation

Multi-Scale Masked 3-D U-Net For Brain Tumor Segmentation

An Improved Three-Dimensional Dual-Path Brain Tumor Image Segmentation Network

Effective and Efficient Multitask Learning for Brain Tumor Segmentation

Learning rich features with hybrid loss for brain tumor segmentation

Multiscale lightweight 3D segmentation algorithm with attention mechanism: Brain tumor image segmentation

Yaru3DFPN: a lightweight modified 3D UNet with feature pyramid network and combine thresholding for brain tumor segmentation

MBDRes-U-Net: Multi-Scale Lightweight Brain Tumor Segmentation Network

Modality-level cross-connection and attentional feature fusion based deep neural network for multi-modal brain tumor segmentation

Dual‐pathway DenseNets with Fully Lateral Connections for Multimodal Brain Tumor Segmentation

Automatic Brain Tumor Segmentation By Exploring The Multi-Modality Complementary Information And Cascaded 3d Lightweight Cnns