Abstract:Medical image segmentation has been significantly advanced by deep learning (DL) techniques, though the data scarcity inherent in medical applications poses a great challenge to DL-based segmentation methods. Self-supervised learning offers a solution by creating auxiliary learning tasks from the available dataset and then leveraging the knowledge acquired from solving auxiliary tasks to help better solve the target segmentation task. Different auxiliary tasks may have different properties and thus can help the target task to different extents. It is desired to leverage their complementary advantages to enhance the overall assistance to the target task. To achieve this, existing methods often adopt a joint training paradigm, which co-solves segmentation and auxiliary tasks by integrating their losses or intermediate gradients. However, direct coupling of losses or intermediate gradients risks undesirable interference because the knowledge acquired from solving each auxiliary task at every training step may not always benefit the target task. To address this issue, we propose a two-stage training approach. In the first stage, the target segmentation task will be independently co-solved with each auxiliary task in both joint training and pre-training modes, with the better model selected via validation performance. In the second stage, the models obtained with respect to each auxiliary task are converted into a single model using an ensemble knowledge distillation method. Our approach allows for making best use of each auxiliary task to create multiple elite segmentation models and then combine them into an even more powerful model. We employed five auxiliary tasks of different proprieties in our approach and applied it to train the U-Net model on an X-ray pneumothorax segmentation dataset. Experimental results demonstrate the superiority of our approach over several existing methods.

Self-Paced Co-Training and Foundation Model for Semi-Supervised Medical Image Segmentation

Beyond Pixel-Wise Supervision for Medical Image Segmentation: From Traditional Models to Foundation Models

Self-paced and self-consistent co-training for semi-supervised image segmentation

Transformation Consistent Self-ensembling Model for Semi-supervised Medical Image Segmentation

Semi-supervised Segmentation with Self-training Based on Quality Estimation and Refinement.

Transformation-Consistent Self-Ensembling Model for Semisupervised Medical Image Segmentation

Self-Supervised Correction Learning for Semi-Supervised Biomedical Image Segmentation

SC-SSL: Self-correcting Collaborative and Contrastive Co-training Model for Semi-Supervised Medical Image Segmentation

An Efficient Semi-Supervised Framework with Multi-Task and Curriculum Learning for Medical Image Segmentation

Positional Information is a Strong Supervision for Volumetric Medical Image Segmentation

Semi-MedSeq: Semi-supervised Semantic Segmentation for Medical Image Sequences.

Self-training with dual uncertainty for semi-supervised medical image segmentation

Shape and boundary-aware multi-branch model for semi-supervised medical image segmentation

Semi-supervised Medical Image Segmentation with Distribution Calibration and Non-local Semantic Constraint.

Semi-supervised Medical Image Segmentation Method Based on Cross-pseudo Labeling Leveraging Strong and Weak Data Augmentation Strategies

Role Exchange-Based Self-Training Semi-Supervision Framework for Complex Medical Image Segmentation

Self-Ensembling Contrastive Learning for Semi-Supervised Medical Image Segmentation

Self and Mixed Supervision to Improve Training Labels for Multi-Class Medical Image Segmentation

Two-Stage Multi-task Self-Supervised Learning for Medical Image Segmentation

Segment Together: A Versatile Paradigm for Semi-Supervised Medical Image Segmentation

The student-teacher framework guided by self-training and consistency regularization for semi-supervised medical image segmentation