Abstract:To develop a robust segmentation model, encoding the underlying features/structures of the input data is essential to discriminate the target structure from the background. To enrich the extracted feature maps, contrastive learning and self-learning techniques are employed, particularly when the size of the training dataset is limited. In this work, we set out to investigate the impact of contrastive learning and self-learning on the performance of the deep learning-based semantic segmentation. To this end, three different datasets were employed used for brain tumor and hippocampus delineation from MR images (BraTS and Decathlon datasets, respectively) and kidney segmentation from CT images (Decathlon dataset). Since data augmentation techniques are also aimed at enhancing the performance of deep learning methods, a deformable data augmentation technique was proposed and compared with contrastive learning and self-learning frameworks. The segmentation accuracy for the three datasets was assessed with and without applying data augmentation, contrastive learning, and self-learning to individually investigate the impact of these techniques. The self-learning and deformable data augmentation techniques exhibited comparable performance with Dice indices of 0.913 ± 0.030 and 0.920 ± 0.022 for kidney segmentation, 0.890 ± 0.035 and 0.898 ± 0.027 for hippocampus segmentation, and 0.891 ± 0.045 and 0.897 ± 0.040 for lesion segmentation, respectively. These two approaches significantly outperformed the contrastive learning and the original model with Dice indices of 0.871 ± 0.039 and 0.868 ± 0.042 for kidney segmentation, 0.872 ± 0.045 and 0.865 ± 0.048 for hippocampus segmentation, and 0.870 ± 0.049 and 0.860 ± 0.058 for lesion segmentation, respectively. The combination of self-learning with deformable data augmentation led to a robust segmentation model with no outliers in the outcomes. This work demonstrated the beneficial impact of self-learning and deformable data augmentation on organ and lesion segmentation, where no additional training datasets are needed.

Attention decoupled contrastive learning for semi-supervised segmentation method based on data augmentation

Dual-Decoder Consistency via Pseudo-Labels Guided Data Augmentation for Semi-Supervised Medical Image Segmentation

Self-Ensembling Contrastive Learning for Semi-Supervised Medical Image Segmentation

Contrastive and Selective Hidden Embeddings for Medical Image Segmentation

Class-aware Patch Based Contrastive Learning for Medical Image Segmentation

Uncertainty-Guided Voxel-Level Supervised Contrastive Learning for Semi-Supervised Medical Image Segmentation

Semi-supervised Medical Image Segmentation Method Based on Cross-pseudo Labeling Leveraging Strong and Weak Data Augmentation Strategies

Contrastive Learning vs. Self-Learning vs. Deformable Data Augmentation in Semantic Segmentation of Medical Images

Label-Decoupled Medical Image Segmentation with Spatial-Channel Graph Convolution and Dual Attention Enhancement

Dual-consistency guidance semi-supervised medical image segmentation with low-level detail feature augmentation

Combining Contrastive Learning and Shape Awareness for Semi-Supervised Medical Image Segmentation

Semi-supervised medical image segmentation with diverse views via cross-pseudo supervision

Dual-stream-based dense local features contrastive learning for semi-supervised medical image segmentation

Adversarial Dense Contrastive Learning for Semi-Supervised Semantic Segmentation

Decoupled Consistency for Semi-supervised Medical Image Segmentation

Accurate Semi-Supervised Medical Image Segmentation Using DECTNet Combined with DSST Framework

Semantic-Aware Contrastive Learning for Multi-Object Medical Image Segmentation

Diverse Data Augmentation for Learning Image Segmentation with Cross-Modality Annotations.

A Domain Adaptive Semantic Segmentation Method Using Contrastive Learning and Data Augmentation

Multi-task Attention-Based Semi-supervised Learning for Medical Image Segmentation

Contrastive Semi-Supervised Learning for Domain Adaptive Segmentation Across Similar Anatomical Structures