Abstract:Visible-infrared person re-identification (VIReID) has attracted increasing attention due to the requirements for 24-hour intelligent surveillance systems. In this task, one of the major challenges is the modality discrepancy between the visible (VIS) and infrared (NIR) images. Most conventional methods try to design complex networks or generative models to mitigate the cross-modality discrepancy while ignoring the fact that the modality gaps differ between the different VIS and NIR images. Different from existing methods, in this paper, we propose an Adaptive Middle-modality Alignment Learning (AMML) method, which can effectively reduce the modality discrepancy via an adaptive middle modality learning strategy at both image level and feature level. The proposed AMML method enjoys several merits. First, we propose an Adaptive Middle-modality Generator (AMG) module to reduce the modality discrepancy between the VIS and NIR images from the image level, which can effectively project the VIS and NIR images into a unified middle modality image (UMMI) space to adaptively generate middle-modality (M-modality) images. Second, we propose a feature-level Adaptive Distribution Alignment (ADA) loss to force the distribution of the VIS features and NIR features adaptively align with the distribution of M-modality features. Moreover, we also propose a novel Center-based Diverse Distribution Learning (CDDL) loss, which can effectively learn diverse cross-modality knowledge from different modalities while reducing the modality discrepancy between the VIS and NIR modalities. Extensive experiments on three challenging VIReID datasets show the superiority of the proposed AMML method over the other state-of-the-art methods. More remarkably, our method achieves 77.8% in terms of Rank-1 and 74.8% in terms of mAP on the SYSU-MM01 dataset for all search mode, and 86.6% in terms of Rank-1 and 88.3% in terms of mAP on the SYSU-MM01 dataset for indoor search mode. The code is released at: https://github.com/ZYK100/MMN.

Diffusion Augmentation and Pose Generation Based Pre-Training Method for Robust Visible-Infrared Person Re-Identification

Modality-transfer Generative Adversarial Network and Dual-Level Unified Latent Representation for Visible Thermal Person Re-Identification

VI-Diff: Unpaired Visible-Infrared Translation Diffusion Model for Single Modality Labeled Visible-Infrared Person Re-identification

Translation, Association and Augmentation: Learning Cross-Modality Re-Identification From Single-Modality Annotation

Unified pre-training with pseudo infrared images for visible-infrared person re-identification

Pose Attention-Guided Paired-Images Generation for Visible-Infrared Person Re-Identification

Unsupervised Visible-Infrared Person ReID by Collaborative Learning with Neighbor-Guided Label Refinement

Progressive Discriminative Feature Learning for Visible-Infrared Person Re-Identification

Mutual Information Guided Optimal Transport for Unsupervised Visible-Infrared Person Re-identification

Synthesizing Efficient Data with Diffusion Models for Person Re-Identification Pre-Training

Learning Progressive Modality-shared Transformers for Effective Visible-Infrared Person Re-identification

Stronger Heterogeneous Feature Learning for Visible-Infrared Person Re-Identification

Dynamic Weighted Gradient Reversal Network for Visible-infrared Person Re-identification

An Efficient Framework for Visible-Infrared Cross Modality Person Re-Identification

MIMR: Modality-Invariance Modeling and Refinement for unsupervised visible-infrared person re-identification

Dual adaptive alignment and partitioning network for visible and infrared cross-modality person re-identification

Adaptive Middle Modality Alignment Learning for Visible-Infrared Person Re-identification

Knowledge self-distillation for visible-infrared cross-modality person re-identification

Robust Visible-Infrared Person Re-Identification Based on Polymorphic Mask and Wavelet Graph Convolutional Network

On exploring pose estimation as an auxiliary learning task for Visible–Infrared Person Re-identification

CycleTrans: Learning Neutral Yet Discriminative Features via Cycle Construction for Visible-Infrared Person Re-Identification