Abstract:Unsupervised visible-infrared person re-identification (US-VI-ReID) aims at learning a cross-modality matching model under unsupervised conditions, which is an extremely important task for practical nighttime surveillance to retrieve a specific identity. Previous advanced US-VI-ReID works mainly focus on associating the positive cross-modality identities to optimize the feature extractor by off-line manners, inevitably resulting in error accumulation of incorrect off-line cross-modality associations in each training epoch due to the intra-modality and inter-modality discrepancies. They ignore the direct cross-modality feature interaction in the training process, i.e., the on-line representation learning and updating. Worse still, existing interaction methods are also susceptible to inter-modality differences, leading to unreliable heterogeneous neighborhood learning. To address the above issues, we propose a dual consistency-constrained learning framework (DCCL) simultaneously incorporating off-line cross-modality label refinement and on-line feature interaction learning. The basic idea is that the relations between cross-modality instance-instance and instance-identity should be consistent. More specifically, DCCL constructs an instance memory, an identity memory, and a domain memory for each modality. At the beginning of each training epoch, DCCL explores the off-line consistency of cross-modality instance-instance and instance-identity similarities to refine the reliable cross-modality identities. During the training, DCCL finds credible homogeneous and heterogeneous neighborhoods with on-line consistency between query-instance similarity and query-instance domain probability similarities for feature interaction in one batch, enhancing the robustness against intra-modality and inter-modality variations. Extensive experiments validate that our method significantly outperforms existing works, and even surpasses some supervised counterparts. The source code is available at https://github.com/yangbincv/DCCL .

Dual Pseudo-Labels Interactive Self-Training for Semi-Supervised Visible-Infrared Person Re-Identification

Robust Pseudo-label Learning with Neighbor Relation for Unsupervised Visible-Infrared Person Re-Identification

Semi-Supervised Learning With Heterogeneous Distribution Consistency for Visible Infrared Person Re-Identification

Semi-supervised Visible-Infrared Person Re-identification Via Modality Unification and Confidence Guidance

Inter-Intra Modality Knowledge Learning and Clustering Noise Alleviation for Unsupervised Visible-Infrared Person Re-Identification

Dual Knowledge Distillation on Multiview Pseudo Labels for Unsupervised Person Re-Identification

Unsupervised Visible-Infrared Person ReID by Collaborative Learning with Neighbor-Guided Label Refinement

A NEW PARADIGM FOR CROSS-MODALITY PERSON RE-IDENTIFICATION

SR-VIReID: Super Resolution Assisted Visible-Infrared Person Re-Identification

Unsupervised Visible-Infrared ReID via Pseudo-label Correction and Modality-level Alignment

Credible Dual-X Modality Learning for Visible and Infrared Person Re-Identification.

Visible Embraces Infrared: Cross-Modality Person Re-Identification with Single-Modality Supervision

Cooperative Separation of Modality Shared-Specific Features for Visible-Infrared Person Re-Identification

Learning with Twin Noisy Labels for Visible-Infrared Person Re-Identification

Relieving Universal Label Noise for Unsupervised Visible-Infrared Person Re-Identification by Inferring from Neighbors

Pseudo-Label Noise Prevention, Suppression and Softening for Unsupervised Person Re-Identification.

Dual Consistency-Constrained Learning for Unsupervised Visible-Infrared Person Re-Identification

DMA: Dual Modality-Aware Alignment for Visible-Infrared Person Re-Identification

Multi-Stage Auxiliary Learning for Visible-Infrared Person Re-identification

Feature Affinity-Based Pseudo Labeling for Semi-Supervised Person Re-Identification

Video-based Person Re-Identification by Semi-Supervised Adaptive Stepwise Learning