Abstract:This paper explores the Class-Incremental Source-Free Unsupervised Domain Adaptation (CI-SFUDA) problem, where the unlabeled target data come incrementally without access to labeled source instances. This problem poses two challenges, the disturbances of similar source-class knowledge to target-class representation learning and the new target knowledge to old ones. To address them, we propose the Multi-Granularity Class Prototype Topology Distillation (GROTO) algorithm, which effectively transfers the source knowledge to the unlabeled class-incremental target domain. Concretely, we design the multi-granularity class prototype self-organization module and prototype topology distillation module. Firstly, the positive classes are mined by modeling two accumulation distributions. Then, we generate reliable pseudo-labels by introducing multi-granularity class prototypes, and use them to promote the positive-class target feature self-organization. Secondly, the positive-class prototypes are leveraged to construct the topological structures of source and target feature spaces. Then, we perform the topology distillation to continually mitigate the interferences of new target knowledge to old ones. Extensive experiments demonstrate that our proposed method achieves state-of-the-art performances on three public datasets.

What problem does this paper attempt to address?

### Problems the paper attempts to solve This paper aims to solve the **Class - Incremental Source - Free Unsupervised Domain Adaptation (CI - SFUDA) problem**. Specifically, the paper explores how to effectively transfer a pre - trained source model to unlabeled target - domain data when the target - domain data arrives in an incremental manner and labeled source - domain data is inaccessible. #### Main challenges 1. **Interference of similar source - class knowledge in target - class representation learning**: - Since the label space at each stage of the target domain is only a subset of the source - domain label space, unlabeled target data may be wrongly assigned to pseudo - labels of similar source classes that are irrelevant to the target label space, resulting in target - representation bias. 2. **Impact of new target knowledge on old knowledge**: - When adapting to new classes, the optimizer will update the model weights to adjust to the features and patterns of the new classes, which may cause the model to forget the previously learned knowledge. #### Solutions To solve the above problems, the paper proposes the **Multi - Granularity Class Prototype Topology Distillation (GROTO) algorithm**, which effectively transfers source knowledge to the unlabeled incremental target domain through the following two modules: 1. **Multi - granularity class - prototype self - organization module**: - By modeling source similarity and target probability cumulative distribution, positive classes are mined and reliable pseudo - labels are generated, thus promoting the self - organization of positive - class target features. - Specific steps include: Hybrid Knowledge - driven Positive Class Mining (HKPCM) and Positive - class Target Feature Self - organization (PTFS). 2. **Prototype topology distillation module**: - By calculating positive - class prototypes to construct the topological structures of the source - domain and target - domain feature spaces and performing point - to - point topology distillation, the interference of new target knowledge on old knowledge is continuously reduced. - Specific steps include: calculating positive - class prototypes, constructing the topological structures of the source domain and the target domain, and distilling through the Topology Distillation Loss (Lptd). ### Summary The main contributions of this paper are: - Exploring the CI - SFUDA problem and proposing the GROTO algorithm. - Designing the multi - granularity class - prototype self - organization module, which reduces the interference of similar source - class knowledge in target - class representation learning. - Designing the prototype topology distillation module, which reduces the impact of new target knowledge on old knowledge. Experimental results show that this method achieves state - of - the - art performance on three public datasets, proving its effectiveness in dealing with the CI - SFUDA problem.

Multi-Granularity Class Prototype Topology Distillation for Class-Incremental Source-Free Unsupervised Domain Adaptation

MCKD: Mutually Collaborative Knowledge Distillation for Federated Domain Adaptation and Generalization

Class-Incremental Unsupervised Domain Adaptation via Pseudo-Label Distillation

Generation, division and training: A promising method for source-free unsupervised domain adaptation

Learning Transferable Conceptual Prototypes for Interpretable Unsupervised Domain Adaptation

Exploiting multi-level consistency learning for source-free domain adaptation

Upcycling Models under Domain and Category Shift

Domain Adaptation Based on Source Category Prototypes.

Prototype-Based Multisource Domain Adaptation

Imbalance-Agnostic Source-Free Domain Adaptation via Avatar Prototype Alignment

BMD: A General Class-balanced Multicentric Dynamic Prototype Strategy for Source-free Domain Adaptation

Source-free Domain Adaptation with Class Prototype Discovery

Exploiting Fine-Grained Prototype Distribution for Boosting Unsupervised Class Incremental Learning

Denoised Maximum Classifier Discrepancy for Source-Free Unsupervised Domain Adaptation

Source-free Domain Adaptation Via Dynamic Pseudo Labeling and Self-supervision

Dual Classifier Adaptation: Source-Free UDA via Adaptive Pseudo-Labels Learning

Unified multi-level neighbor clustering for Source-Free Unsupervised Domain Adaptation

Multi-source Distilling Domain Adaptation

Uncertainty-Aware Distillation for Semi-Supervised Few-Shot Class-Incremental Learning

Teacher-Student Mutual Learning for efficient source-free unsupervised domain adaptation

Uncertainty-Guided Semi-Supervised Few-Shot Class-Incremental Learning With Knowledge Distillation