Abstract:Domain adaptive semantic segmentation attempts to make satisfactory dense predictions on an unlabeled target domain by utilizing the supervised model trained on a labeled source domain. One popular solution is self-training, which retrains the model with pseudo labels on target instances. Plenty of approaches tend to alleviate noisy pseudo labels, however, they ignore the intrinsic connection of the training data, i.e., intra-class compactness and inter-class dispersion between pixel representations across and within domains. In consequence, they struggle to handle cross-domain semantic variations and fail to build a well-structured embedding space, leading to less discrimination and poor generalization. In this work, we propose Semantic-Guided Pixel Contrast (SePiCo), a novel one-stage adaptation framework that highlights the semantic concepts of individual pixels to promote learning of class-discriminative and class-balanced pixel representations across domains, eventually boosting the performance of self-training methods. Specifically, to explore proper semantic concepts, we first investigate a centroid-aware pixel contrast that employs the category centroids of the entire source domain or a single source image to guide the learning of discriminative features. Considering the possible lack of category diversity in semantic concepts, we then blaze a trail of distributional perspective to involve a sufficient quantity of instances, namely distribution-aware pixel contrast, inwhich we approximate the true distribution of each semantic category from the statistics of labeled source data. Moreover, such an optimization objective can derive a closed-form upper bound by implicitly involving an infinite number of (dis)similar pairs, making it computationally efficient. Extensive experiments show that SePiCo not only helps stabilize training but also yields discriminative representations, making significant progress on both synthetic-to-real and daytime-to-nighttime adaptation scenarios. The code and models are available at https://github.com/BITDA/SePiCo.

DECNet: Dense embedding contrast for unsupervised semantic segmentation

Semi-Supervised Semantic Segmentation of Remote Sensing Images With Iterative Contrastive Network

Exploring Cross-Image Pixel Contrast for Semantic Segmentation

Cross-Image Pixel Contrasting for Semantic Segmentation

DESENet: a bilateral network with detail-enhanced semantic encoder for real-time semantic segmentation

Adversarial Dense Contrastive Learning for Semi-Supervised Semantic Segmentation

Region-aware Contrastive Learning for Semantic Segmentation

Directed Mix Contrast for Lidar Point Cloud Segmentation

Positive-Negative Equal Contrastive Loss for Semantic Segmentation

Multiscale Prototype Contrast Network for High-Resolution Aerial Imagery Semantic Segmentation

SPDC: A SUPER-POINT AND POINT COMBINING BASED DUAL-SCALE CONTRASTIVE LEARNING NETWORK FOR POINT CLOUD SEMANTIC SEGMENTATION

Pixel Contrastive-Consistent Semi-Supervised Semantic Segmentation

Confidence-Weighted Dual-Teacher Networks With Biased Contrastive Learning for Semi-Supervised Semantic Segmentation in Remote Sensing Images

Contrast, Stylize and Adapt: Unsupervised Contrastive Learning Framework for Domain Adaptive Semantic Segmentation

RiSSNet: Contrastive Learning Network with a Relaxed Identity Sampling Strategy for Remote Sensing Image Semantic Segmentation

Boosting Semantic Segmentation from the Perspective of Explicit Class Embeddings

Dense Contrastive Learning for Self-Supervised Visual Pre-Training

DCANet: Dense Context-Aware Network for Semantic Segmentation

SePiCo: Semantic-Guided Pixel Contrast for Domain Adaptive Semantic Segmentation.

CSC-Unet: A Novel Convolutional Sparse Coding Strategy Based Neural Network for Semantic Segmentation

Augmentation-Free Dense Contrastive Knowledge Distillation for Efficient Semantic Segmentation