Abstract:To achieve high performance, most deep convolutional neural networks (DCNNs) require a significant amount of training data with ground truth labels. However, creating ground-truth labels for semantic segmentation requires more time, human effort, and cost compared with other tasks such as classification and object detection, because the ground-truth label of every pixel in an image is required. Hence, it is practically demanding to train DCNNs using a limited amount of training data for semantic segmentation. Generally, training DCNNs using a limited amount of data is problematic as it easily results in a decrease in the accuracy of the networks because of overfitting to the training data. Here, we propose a new regularization method called pixel-wise adaptive label smoothing (PALS) via self-knowledge distillation to stably train semantic segmentation networks in a practical situation, in which only a limited amount of training data is available. To mitigate the problem caused by limited training data, our method fully utilizes the internal statistics of pixels within an input image. Consequently, the proposed method generates a pixel-wise aggregated probability distribution using a similarity matrix that encodes the affinities between all pairs of pixels. To further increase the accuracy, we add one-hot encoded distributions with ground-truth labels to these aggregated distributions, and obtain our final soft labels. We demonstrate the effectiveness of our method for the Cityscapes dataset and the Pascal VOC2012 dataset using limited amounts of training data, such as 10%, 30%, 50%, and 100%. Based on various quantitative and qualitative comparisons, our method demonstrates more accurate results compared with previous methods. Specifically, for the Cityscapes test set, our method achieved mIoU improvements of 0.076%, 1.848%, 1.137%, and 1.063% for 10%, 30%, 50%, and 100% training data, respectively, compared with the method of the cross-entropy loss using one-hot encoding with ground truth labels.

CAFS: Class Adaptive Framework for Semi-Supervised Semantic Segmentation

Class-Wise Adaptive Strategy for Semi Supervised Semantic Segmentation

CFCG: Semi-Supervised Semantic Segmentation Via Cross-Fusion and Contour Guidance Supervision

Fully Self-Supervised Learning for Semantic Segmentation

Improving Semantic Segmentation via Efficient Self-Training

Semi-Supervised Semantic Segmentation Via Adaptive Equalization Learning

Category-sensitive Semi-Supervised Semantic Segmentation Framework for Land-Use/land-cover Mapping with Optical Remote Sensing Images

Semi-supervised Semantic Segmentation with Multi-Reliability and Multi-Level Feature Augmentation

Semi-Supervised Landcover Classification with Adaptive Pixel-Rebalancing Self-Training.

SSA-Seg: Semantic and Spatial Adaptive Pixel-level Classifier for Semantic Segmentation

L2A: Learning Affinity from Attention for Weakly Supervised Continual Semantic Segmentation

A Self-Training Framework Based on Multi-Scale Attention Fusion for Weakly Supervised Semantic Segmentation

Semi-Supervised Semantic Segmentation Via Dynamic Self-Training and Class-Balanced Curriculum.

CAFA: Cross-Modal Attentive Feature Alignment for Cross-Domain Urban Scene Segmentation

Foundation Model Assisted Weakly Supervised Semantic Segmentation

Spatial Structure Constraints for Weakly Supervised Semantic Segmentation

UCC: Uncertainty Guided Cross-head Cotraining for Semi-Supervised Semantic Segmentation.

Semisupervised Semantic Segmentation With Certainty-Aware Consistency Training for Remote Sensing Imagery

SFC: Shared Feature Calibration in Weakly Supervised Semantic Segmentation

Semantic Segmentation Using Pixel-Wise Adaptive Label Smoothing via Self-Knowledge Distillation for Limited Labeling Data