Abstract:Recently, semi-supervised semantic segmentation methods based on weak-to-strong consistency learning have achieved the most advanced performance. The key to such a technique lies in strong perturbations and multi-objective co-training. However, CutMix, the most commonly used data augmentation in this field, limits the strength of perturbations as it only focuses on single random local context. Besides, complex optimization targets also reduce computational efficiency. In this work, we propose an efficient consistency learning based framework. Specifically, a novel unsupervised data augmentation strategy, EntropyMix, is present for semi-supervised semantic segmentation. Patches of unlabeled data from multi-view augmentations are combined into new training samples based on their prediction entropy, which provides more informative and powerful perturbations for consistency regularization and impels the model to focus on cross-view local context. On this basis, we further propose Self Pseudo Entropy Knowledge Distillation (SPEED) to learn global pixel relations from multi- and cross-view perturbations by optimizing a linear combination of feature-and logit-level distillation loss, enhancing model performance without additional auxiliary segmentation heads or a complex pre-trained teacher model. The collocation of the two ideas above is a plug-and-play technique without additional modification. Extensive experimental results on PASCAL VOC and Cityscapes datasets under various training settings demonstrate the superiority of the proposed data augmentation strategy and self-distillation loss, achieving new state-of-the-art performance. Remarkably, our method reaches mIoU of 75.16% using only 0.87% labeled data on PASCAL VOC and mIoU of 76.98% using only 6.25% labeled data on Cityscapes. The code is available at https://github.com/xiaoqiang-lu/SPEED.

Semi-supervised Semantic Segmentation with Mutual Knowledge Distillation

Self Pseudo Entropy Knowledge Distillation for Semi-supervised Semantic Segmentation

FAKD: Feature Augmented Knowledge Distillation for Semantic Segmentation

Semi-Online Knowledge Distillation

Robust Mutual Learning for Semi-supervised Semantic Segmentation

Patch-Level Knowledge Distillation and Regularization for Missing Modality Medical Image Segmentation.

Make a Strong Teacher with Label Assistance: A Novel Knowledge Distillation Approach for Semantic Segmentation

A Simple Baseline for Semi-supervised Semantic Segmentation with Strong Data Augmentation

MTED: Multiple Teachers Ensemble Distillation for Compact Semantic Segmentation

Deep Mutual Distillation for Semi-supervised Medical Image Segmentation

Augmentation-Free Dense Contrastive Knowledge Distillation for Efficient Semantic Segmentation

Semantic segmentation method for continuous images based on multi-level knowledge distillation

Multi-Knowledge Aggregation and Transfer for Semantic Segmentation

Perturbation Consistency and Mutual Information Regularization for Semi-Supervised Semantic Segmentation

Learning Semantic Textual Similarity via Multi-Teacher Knowledge Distillation: A Multiple Data Augmentation method

Augmentation-free Dense Contrastive Distillation for Efficient Semantic Segmentation

Multi-view knowledge distillation for efficient semantic segmentation

Semi-supervised Semantic Segmentation with Multi-Reliability and Multi-Level Feature Augmentation

Semi-Supervised Semantic Segmentation Via Dynamic Self-Training and Class-Balanced Curriculum.

Channel-wise Distillation for Semantic Segmentation.

Semi-supervised semantic segmentation needs strong, varied perturbations