Abstract:Current unsupervised domain adaptation (UDA) techniques in semantic segmentation effectively decrease the domain discrepancy between the labeled source domain and unlabeled target domain, thereby enhancing the model’s pixel-wise discriminative capability for target domain data. However, in remote sensing images (RSIs), our study uncovers that these approaches perform poorly in the presence of class distribution inconsistencies between the source and target domains. In this work, we propose a one-stage mean teacher framework with a novel auxiliary prototype classifier, named MTA, to address this issue. Specifically, the teacher model assigns pseudo labels at pixel level for target samples and captures knowledge from the student model via exponential moving average (EMA). With labeled source samples and target samples that have pseudo labels, the student model can alleviate the divergence between the source and target domains. In addition, the auxiliary prototype classifier (APC) reduces the performance degradation in the parametric softmax classifier of the student model caused by class distribution divergence. We also propose a prototype computation scheme to obtain each class prototype in the APC. Specifically, we build a memory bank for each class of the two domains to store feature embeddings dynamically. Then, we compute the class prototype by applying the clustering algorithm on memory banks corresponding to the class. Meanwhile, the APC reduces the intra-class domain discrepancy by optimizing the cross-entropy loss, which brings each class feature distribution of the two domains closer to the class prototype. The experimental results on RSIs UDA semantic segmentation tasks show the superiority of our approach over comparative methods.

Prototype-Guided Multitask Adversarial Network for Cross-Domain LiDAR Point Clouds Semantic Segmentation

Category-Level Adversaries for Outdoor LiDAR Point Clouds Cross-Domain Semantic Segmentation

Domain Adaptive Remote Sensing Image Semantic Segmentation with Prototype Guidance

Point-Based Multilevel Domain Adaptation for Point Cloud Segmentation

MultiDAN: Unsupervised, Multistage, Multisource and Multitarget Domain Adaptation for Semantic Segmentation of Remote Sensing Images

Adversarial unsupervised domain adaptation for 3D semantic segmentation with multi-modal learning

A Learnable Self-supervised Task for Unsupervised Domain Adaptation on Point Clouds

Prototype-guided Unsupervised Domain Adaptation for Semantic Segmentation

Unsupervised Domain Adaptation Multi-Level Adversarial Network for Semantic Segmentation Based on Multi-Modal Features

LiOn-XA: Unsupervised Domain Adaptation via LiDAR-Only Cross-Modal Adversarial Training

Multi-Target Unsupervised Domain Adaptation for Semantic Segmentation without External Data

Self-training and Multi-level Adversarial Network for Domain Adaptive Remote Sensing Image Segmentation

Unsupervised Domain Adaptation by Cross-Prototype Contrastive Learning for Medical Image Segmentation.

Learning to Adapt SAM for Segmenting Cross-domain Point Clouds

Adversarial Unsupervised Domain Adaptation for 3D Semantic Segmentation with 2D Image Fusion of Dense Depth

Threshold-adaptive Unsupervised Focal Loss for Domain Adaptation of Semantic Segmentation

BAPA-Net: Boundary Adaptation and Prototype Alignment for Cross-domain Semantic Segmentation

Self-Supervised Boundary Point Prediction Task for Point Cloud Domain Adaptation

Unsupervised Domain Adaptation Network with Category-Centric Prototype Aligner for Biomedical Image Segmentation

Deep Multi-Modality Adversarial Networks for Unsupervised Domain Adaptation

Uncertainty-weighted prototype active learning in domain adaptive semantic segmentation