Abstract:Background and objective: Precisely segmenting brain tumors using multimodal Magnetic Resonance Imaging (MRI) is an essential task for early diagnosis, disease monitoring, and surgical planning. Unfortunately, the complete four image modalities utilized in the well-known BraTS benchmark dataset: T1, T2, Fluid-Attenuated Inversion Recovery (FLAIR), and T1 Contrast-Enhanced (T1CE) are not regularly acquired in clinical practice due to the high cost and long acquisition time. Rather, it is common to utilize limited image modalities for brain tumor segmentation. Methods: In this paper, we propose a single stage learning of knowledge distillation algorithm that derives information from the missing modalities for better segmentation of brain tumors. Unlike the previous works that adopted a two-stage framework to distill the knowledge from a pre-trained network into a student network, where the latter network is trained on limited image modality, we train both models simultaneously using a single-stage knowledge distillation algorithm. We transfer the information by reducing the redundancy from a teacher network trained on full image modalities to the student network using Barlow Twins loss on a latent-space level. To distill the knowledge on the pixel level, we further employ a deep supervision idea that trains the backbone networks of both teacher and student paths using Cross-Entropy loss. Results: We demonstrate that the proposed single-stage knowledge distillation approach enables improving the performance of the student network in each tumor category with overall dice scores of 91.11% for Tumor Core, 89.70% for Enhancing Tumor, and 92.20% for Whole Tumor in the case of only using the FLAIR and T1CE images, outperforming the state-of-the-art segmentation methods. Conclusions: The outcomes of this work prove the feasibility of exploiting the knowledge distillation in segmenting brain tumors using limited image modalities and hence make it closer to clinical practices.

ABUS Tumor Segmentation Via Decouple Contrastive Knowledge Distillation.

Efficient knowledge distillation for liver CT segmentation using growing assistant network

A Medical Image Segmentation Method Combining Knowledge Distillation and Contrastive Learning

Pixel-Level and Affinity-Level Knowledge Distillation for Unsupervised Segmentation of Covid-19 Lesions

Attention-Fused CNN Model Compression with Knowledge Distillation for Brain Tumor Segmentation

Semantic Segmentation of Medical Images Based on Knowledge Distillation Algorithm

MSKD: Structured knowledge distillation for efficient medical image segmentation

Efficient Medical Image Segmentation Based on Knowledge Distillation

A single stage knowledge distillation network for brain tumor segmentation on limited MR image modalities

Multi-Task Multi-Scale Contrastive Knowledge Distillation for Efficient Medical Image Segmentation

Efficient Biomedical Instance Segmentation via Knowledge Distillation

Medical Image Segmentation of Liver Tumors with Multi-phase Deficiency Based on Hierarchical Knowledge Distillation Network

Knowledge Distillation for Adaptive MRI Prostate Segmentation Based on Limit-Trained Multi-Teacher Models

LightBTSeg: A lightweight breast tumor segmentation model using ultrasound images via dual-path joint knowledge distillation

Brain Tumor Segmentation based on Knowledge Distillation and Adversarial Training

Dilated Densely Connected U-Net with Uncertainty Focus Loss for 3D ABUS Mass Segmentation.

Knowledge Distillation of Attention and Residual U-Net: Transfer from Deep to Shallow Models for Medical Image Classification.

Unpaired Multi-modal Segmentation via Knowledge Distillation

Tumor segmentation in automated whole breast ultrasound using bidirectional LSTM neural network and attention mechanism

Attention Correction Feature and Boundary Constraint Knowledge Distillation for Efficient 3D Medical Image Segmentation

Feature interaction network based on hierarchical decoupled convolution for 3D medical image segmentation