Abstract:In recent years, constrained by the challenges associated with expensive data annotation and poor generalization ability in supervised models, domain adaptation has been proposed to effectively mitigate domain gaps, which has gained significant attention in the field of remote sensing. However, most existing methods do not consider the inherent characteristics of remote sensing images when formulating adaptive strategies. Additionally, there has been limited research on addressing class-imbalanced data situations, leading to undesirable performance in domain adaptation tasks involving long-tailed datasets. To overcome the aforementioned limitations, based on the analysis of intra-class diversity and intra-domain style differences of remote sensing images, we propose a novel prototype contrastive learning framework called general-specific prototype contrastive learning (GSPCL). Due to the unreliability of clustering samples in conventional prototype-based clustering methods, the Bidirectional Weighted Prototype (BWP) strategy is proposed to optimize this loophole. Consequently, more robust prototypes are constructed in both domains, serving as mediators to reduce domain discrepancies bidirectionally. Particularly, often overlooked in most methods, we incorporate low-confidence sample features into the contrastive learning process alongside these prototypes, to further guide the model to address feature alignment and long-tail issues effectively. Finally, in order to verify the superiority of our proposed method, we adhere to two existing experiment settings and construct an extra optical remote sensing domain adaptation dataset with class-imbalanced scenarios. In the first two experimental settings, GSPCL outperforms the second-ranked approach by 5.0% and 4.0% in average accuracy. Furthermore, our approach exhibits highly competitive results in handling long-tailed data scenarios.

Prototype-based Cross-cluster Unsupervised Domain Adaptation for Semantic Segmentation

Prototype-guided Unsupervised Domain Adaptation for Semantic Segmentation

A Prototypical Knowledge Oriented Adaptation Framework for Semantic Segmentation

Unsupervised Domain Adaption via Similarity-Based Prototypes for Cross-Modality Segmentation

Domain-invariant Prototypes for Semantic Segmentation

Learning a Target-Dependent Classifier for Cross-Domain Semantic Segmentation: Fine-tuning Versus Meta-Learning

Target-targeted Domain Adaptation for Unsupervised Semantic Segmentation

Cross-Domain Adaptive Clustering for Semi-Supervised Domain Adaptation

Informative Data Mining for One-Shot Cross-Domain Semantic Segmentation

More Separable and Easier to Segment: A Cluster Alignment Method for Cross-Domain Semantic Segmentation

Unsupervised Domain Adaptive Semantic Segmentation Based on Clip-Guided Prototypical Contrastive Learning

Unsupervised Pixel-Wise Weighted Adversarial Domain Adaptation

Adaptive Refining-Aggregation-Separation Framework for Unsupervised Domain Adaptation Semantic Segmentation

Prototype-Guided Multitask Adversarial Network for Cross-Domain LiDAR Point Clouds Semantic Segmentation

Domain Adaptive Remote Sensing Image Semantic Segmentation with Prototype Guidance

Differential Treatment for Stuff and Things: A Simple Unsupervised Domain Adaptation Method for Semantic Segmentation

Unsupervised Domain Adaptive Image Semantic Segmentation Based on Convolutional Fine-Grained Discriminant and Entropy Minimization

Prototypical Contrastive Learning for Domain Adaptive Semantic Segmentation.

A Multi-Grained Unsupervised Domain Adaptation Approach for Semantic Segmentation

Cross-Scene Classification of Remote Sensing Images Based on General-Specific Prototype Contrastive Learning

Unsupervised Domain Adaptive Point Cloud Semantic Segmentation.