Abstract:Medical image segmentation task has been a hot research topic in the field of computer vision and natural field for many years. With the rapid development and application of convolutional neural networks, more and more medical segmentation models based on deep learning have been proposed, and more successful results and applications have been achieved in many disease segmentation tasks.The effect of medical image segmentation tasks is getting better. However, the computational cost of the medical image segmentation model has not been improved well. In this work, we propose a medical image segmentation model compression scheme that is theoretically applicable to all convolutional neural networks. First, we choose to construct a search space based on the number of convolution kernels at each location where convolution is used in the model, and then use neural network search to find a sub-network in this search space with less computation and high segmentation accuracy. Aiming at the encoding-decoding structure of the segmentation network, we propose Symmetrical-NAS to ensure that the encoding structure and decoding structure of any sub-network in our search space are symmetrical. Since it is too expensive to traverse the entire search space for training to find the most suitable architecture, we use weight sharing for training. During training, a sub-network in the search space is randomly selected for activation each time. Second, we use the method of knowledge distillation for training. We use the basic model as the teacher model and the searched sub-network as the student model to realize the knowledge transfer between the teacher model and the student model. Third, we use separable convolution instead of convolutional layer. Our method can be applied to various medicial image segmentation models regardless of model architectures and learning algorithms. Our method can reduce the computation of medical image segmentation models by 90× regarding FLOPs with little loss of segmentation effect. The code and demo will be publicly available.

Attention-Fused CNN Model Compression with Knowledge Distillation for Brain Tumor Segmentation

Efficient knowledge distillation for liver CT segmentation using growing assistant network

Brain Tumor Segmentation based on Knowledge Distillation and Adversarial Training

Model Compression with NAS and Knowledge Distillation for Medical Image Segmentation.

Brain tumor image segmentation based on prior knowledge via transformer

OdCFU-Net for Brain Tumor Segmentation Based on MRI

ABUS Tumor Segmentation Via Decouple Contrastive Knowledge Distillation.

Attention 3D U-Net with Multiple Skip Connections for Segmentation of Brain Tumor Images

Automatic Brain Tumor Segmentation By Exploring The Multi-Modality Complementary Information And Cascaded 3d Lightweight Cnns

Advance Brain Tumor Segmentation Using Feature Fusion Methods with Deep U-Net Model with CNN for MRI Data

A single stage knowledge distillation network for brain tumor segmentation on limited MR image modalities

3D Dilated Multi-Fiber Network for Real-time Brain Tumor Segmentation in MRI

Feature interaction network based on hierarchical decoupled convolution for 3D medical image segmentation

3D Hyper-Dense Connected Convolutional Neural Network for Brain Tumor Segmentation

Advanced U-Net Model for Precise Brain Tumor Segmentation in MRI Images

Combined 3D CNN for Brain Tumor Segmentation

A deep learning model integrating FCNNs and CRFs for brain tumor segmentation

A Novel End-to-end Brain Tumor Segmentation Method Using Improved Fully Convolutional Networks.

Brain tumor segmentation via C-dense convolutional neural network

TransSea: Hybrid CNN-Transformer with Semantic Awareness for 3D Brain Tumor Segmentation

Brain Tumor Segmentation Based on Deep Learning, Attention Mechanisms, and Energy-Based Uncertainty Prediction