Abstract:Unsupervised domain adaptive person re-identification (ReID) has been extensively investigated to mitigate the adverse effects of domain gaps. Those works assume the target domain data can be accessible all at once. However, for the real-world streaming data, this hinders the timely adaptation to changing data statistics and sufficient exploitation of increasing samples. In this paper, to address more practical scenarios, we propose a new task, Lifelong Unsupervised Domain Adaptive (LUDA) person ReID. This is challenging because it requires the model to continuously adapt to unlabeled data in the target environments while alleviating catastrophic forgetting for such a fine-grained person retrieval task. We design an effective scheme for this task, dubbed CLUDA-ReID, where the anti-forgetting is harmoniously coordinated with the adaptation. Specifically, a meta-based Coordinated Data Replay strategy is proposed to replay old data and update the network with a coordinated optimization direction for both adaptation and memorization. Moreover, we propose Relational Consistency Learning for old knowledge distillation/inheritance in line with the objective of retrieval-based tasks. We set up two evaluation settings to simulate the practical application scenarios. Extensive experiments demonstrate the effectiveness of our CLUDA-ReID for both scenarios with stationary target streams and scenarios with dynamic target streams.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is that in practical applications, when target - domain data arrives in the form of a stream, how to make the unsupervised domain - adaptation person re - identification (ReID) model continuously adapt to the new environment while avoiding catastrophic forgetting. Specifically, existing unsupervised domain - adaptation (UDA) methods usually assume that the target - domain data can be obtained all at once, which is not always feasible in real - world scenarios. Therefore, the paper proposes a more realistic task - lifelong unsupervised domain - adaptation (LUDA) person re - identification, aiming to enable the model to achieve continuous domain - adaptation through continuously arriving unlabeled data without relying on labels and maintain the memory of old knowledge during this process. ### Main contributions of the paper: 1. **Proposing a new task**: Lifelong unsupervised domain - adaptation (LUDA) person re - identification, enabling the model to automatically adapt to new environments using continuously collected unlabeled data. 2. **Designing an effective scheme**: Named CLUDA - ReID, which includes Coordinated Data Replay (CDR) and Relational Consistency Learning (RCL), explicitly coordinating forgetting - prevention and adaptation. 3. **Establishing two practical evaluation schemes**: Simulating real - application scenarios, extensive experiments show that the proposed method can effectively achieve LUDA in both static or dynamic target - stream scenarios and enhance the generalization ability of unseen domains. ### Key technical points of the solution: - **Coordinated Data Replay (CDR)**: Coordinate the optimization objectives of forgetting - prevention and adaptation through a meta - optimization strategy. Specifically, a memory buffer of a limited size is used to store old data, and the current model is updated together with new data in each iteration. In addition, a historical model is maintained for knowledge distillation. - **Relational Consistency Learning (RCL)**: By encouraging the historical model and the current model to output consistent ranking results for input samples and the consistency of absolute ID - related features, more effective knowledge distillation is achieved, especially designed for the characteristics of the person re - identification task. ### Experimental verification: - **Datasets and evaluation metrics**: Use the synthetic dataset PersonX for source - domain pre - training, and use three publicly available real - world image datasets, Market1501, CUHK - SYSU, and MSMT17, for unsupervised fine - tuning. Evaluation metrics include Rank - 1 accuracy (R - 1) and mean Average Precision (mAP). - **Experimental configuration**: In the static target scenario, the training data of Market1501 is evenly divided into 5 subsets for 5 - stage LUDA training. After each stage, calculate the R - 1 and mAP accuracies on the source data and the target data respectively to evaluate the model's forgetting - prevention ability and timely adaptation ability. - **Experimental results**: The experimental results show that by gradually adding different components (such as data replay, CDR, RCL, etc.), the performance of the model on both the source domain and the target domain is significantly improved, especially the introduction of RCL greatly improves the model's forgetting - prevention ability. In conclusion, through proposing the LUDA task and the corresponding solution, this paper provides new ideas and technical support for continuous domain - adaptation in practical applications.

Lifelong Unsupervised Domain Adaptive Person Re-identification with Coordinated Anti-forgetting and Adaptation

Unsupervised Lifelong Person Re-identification via Contrastive Rehearsal

Unsupervised Domain Adaptation Via Dynamic Clustering and Co-Segment Attentive Learning for Video-Based Person Re-Identification

Lifelong Person Re-identification by Pseudo Task Knowledge Preservation

Diverse Representation Embedding for Lifelong Person Re-Identification

Adapt Only Once: Fast Unsupervised Person Re-Identification Via Relevance-Aware Guidance

Group-aware Label Transfer for Domain Adaptive Person Re-identification

Distribution Aligned Semantics Adaption for Lifelong Person Re-Identification

Lifelong Person Re-Identification via Adaptive Knowledge Accumulation

Semi-Supervised Domain Generalizable Person Re-Identification

Anti-Forgetting Adaptation for Unsupervised Person Re-identification

Unsupervised Domain Adaptive Learning via Synthetic Data for Person Re-identification

Learning consistent region features for lifelong person re-identification

Domain Consistency Representation Learning for Lifelong Person Re-Identification

Reliability Exploration with Self-Ensemble Learning for Domain Adaptive Person Re-Identification

Auto-selected Knowledge Adapters for Lifelong Person Re-identification

Dual-Uncertainty Guided Curriculum Learning and Part-Aware Feature Refinement for Domain Adaptive Person Re-Identification

Unsupervised Domain Adaptive Person Re-Identification via Human Learning Imitation

Unsupervised cross-domain person re-identification with self-attention and joint-flexible optimization

Part-aware Progressive Unsupervised Domain Adaptation for Person Re-Identification

Patch-based Knowledge Distillation for Lifelong Person Re-Identification