Abstract:Visible-infrared person re-identification (VIReID) has attracted increasing attention due to the requirements for 24-hour intelligent surveillance systems. In this task, one of the major challenges is the modality discrepancy between the visible (VIS) and infrared (NIR) images. Most conventional methods try to design complex networks or generative models to mitigate the cross-modality discrepancy while ignoring the fact that the modality gaps differ between the different VIS and NIR images. Different from existing methods, in this paper, we propose an Adaptive Middle-modality Alignment Learning (AMML) method, which can effectively reduce the modality discrepancy via an adaptive middle modality learning strategy at both image level and feature level. The proposed AMML method enjoys several merits. First, we propose an Adaptive Middle-modality Generator (AMG) module to reduce the modality discrepancy between the VIS and NIR images from the image level, which can effectively project the VIS and NIR images into a unified middle modality image (UMMI) space to adaptively generate middle-modality (M-modality) images. Second, we propose a feature-level Adaptive Distribution Alignment (ADA) loss to force the distribution of the VIS features and NIR features adaptively align with the distribution of M-modality features. Moreover, we also propose a novel Center-based Diverse Distribution Learning (CDDL) loss, which can effectively learn diverse cross-modality knowledge from different modalities while reducing the modality discrepancy between the VIS and NIR modalities. Extensive experiments on three challenging VIReID datasets show the superiority of the proposed AMML method over the other state-of-the-art methods. More remarkably, our method achieves 77.8% in terms of Rank-1 and 74.8% in terms of mAP on the SYSU-MM01 dataset for all search mode, and 86.6% in terms of Rank-1 and 88.3% in terms of mAP on the SYSU-MM01 dataset for indoor search mode. The code is released at: https://github.com/ZYK100/MMN.

Inter-Modality Similarity Learning for Unsupervised Multi-Modality Person Re-Identification

RGB-IR Person Re-identification by Cross-Modality Similarity Preservation

Multi-Memory Matching for Unsupervised Visible-Infrared Person Re-Identification

A NEW PARADIGM FOR CROSS-MODALITY PERSON RE-IDENTIFICATION

Modality-Adaptive Mixup and Invariant Decomposition for RGB-Infrared Person Re-Identification

A Similarity Inference Metric for RGB-Infrared Cross-Modality Person Re-identification

Towards a Unified Middle Modality Learning for Visible-Infrared Person Re-Identification

Self-Supervised Modality-Aware Multiple Granularity Pre-Training for RGB-Infrared Person Re-Identification

Cross‐modality Person Re‐identification Using Hybrid Mutual Learning

Adaptive Middle Modality Alignment Learning for Visible-Infrared Person Re-identification

Efficient Bilateral Cross-Modality Cluster Matching for Unsupervised Visible-Infrared Person ReID

Asymmetric Mutual Learning for Unsupervised Transferable Visible-Infrared Re-Identification

LRMM: Low Rank Multi-Scale Multi-Modal Fusion for Person Re-Identification Based on RGB-NI-TI

Multi-Stage Auxiliary Learning for Visible-Infrared Person Re-identification

Cross-modality disentanglement and shared feedback learning for infrared-visible person re-identification

Learning Memory-Augmented Unidirectional Metrics for Cross-modality Person Re-identification

Semi-supervised Visible-Infrared Person Re-identification Via Modality Unification and Confidence Guidance

Mix-Modality Person Re-Identification: A New and Practical Paradigm

Cross-Modality Person Re-identification with Memory-Based Contrastive Embedding

Joint Color-irrelevant Consistency Learning and Identity-aware Modality Adaptation for Visible-infrared Cross Modality Person Re-identification.

Dual Mutual Learning for Cross-modality Person Re-identification