Abstract:Visible-infrared person re-identification (VIReID) has attracted increasing attention due to the requirements for 24-hour intelligent surveillance systems. In this task, one of the major challenges is the modality discrepancy between the visible (VIS) and infrared (NIR) images. Most conventional methods try to design complex networks or generative models to mitigate the cross-modality discrepancy while ignoring the fact that the modality gaps differ between the different VIS and NIR images. Different from existing methods, in this paper, we propose an Adaptive Middle-modality Alignment Learning (AMML) method, which can effectively reduce the modality discrepancy via an adaptive middle modality learning strategy at both image level and feature level. The proposed AMML method enjoys several merits. First, we propose an Adaptive Middle-modality Generator (AMG) module to reduce the modality discrepancy between the VIS and NIR images from the image level, which can effectively project the VIS and NIR images into a unified middle modality image (UMMI) space to adaptively generate middle-modality (M-modality) images. Second, we propose a feature-level Adaptive Distribution Alignment (ADA) loss to force the distribution of the VIS features and NIR features adaptively align with the distribution of M-modality features. Moreover, we also propose a novel Center-based Diverse Distribution Learning (CDDL) loss, which can effectively learn diverse cross-modality knowledge from different modalities while reducing the modality discrepancy between the VIS and NIR modalities. Extensive experiments on three challenging VIReID datasets show the superiority of the proposed AMML method over the other state-of-the-art methods. More remarkably, our method achieves 77.8% in terms of Rank-1 and 74.8% in terms of mAP on the SYSU-MM01 dataset for all search mode, and 86.6% in terms of Rank-1 and 88.3% in terms of mAP on the SYSU-MM01 dataset for indoor search mode. The code is released at: https://github.com/ZYK100/MMN.

Adaptive Margin Nearest Neighbor for Person Re-Identification

Joint Uneven Channel Information Network with Blend Metric Loss for Person Re-Identification

Gaussian-based Probability Fusion for Person Re-Identification with Taylor Angular Margin Loss

Joining Features by Global Guidance with Bi-Relevance Trihard Loss for Person Re-Identification

Contribution-Based Multi-Stream Feature Distance Fusion Method with ${k}$ -Distribution Re-Ranking for Person Re-Identification

Contribution-Based Multi-Stream Feature Distance Fusion Method With <inline-formula> <tex-math notation="LaTeX">${k}$ </tex-math></inline-formula>-Distribution Re-Ranking for Person Re-Identification

A New Date-Balanced Method Based on Adaptive Asymmetric and Diversity Regularization in Person Re-Identification.

Adaptive Metric Learning and Probe-Specific Reranking for Person Reidentification

Adaptive Domain-Specific Normalization for Generalizable Person Re-Identification

Adaptive Deep Metric Embeddings for Person Re-Identification under Occlusions

Non-Contrastive Nearest Neighbor Identity-Guided Method for Unsupervised Object Re-identification

Adaptive Middle Modality Alignment Learning for Visible-Infrared Person Re-identification

Nonlinear Local Metric Learning for Person Re-identification.

Kernelized View Adaptive Subspace Learning for Person Re-identification

Deep ranking model by large adaptive margin learning for person re-identification

Discriminative multi-scale adjacent feature for person re-identification

Integrated Metric Learning with Adaptive Constraints for Person Re-Identification

Efficient Online Local Metric Adaptation Via Negative Samples for Person Re-identification.

VMRFANet:View-Specific Multi-Receptive Field Attention Network for Person Re-identification

Online learning on incremental distance metric for person re-identification

Asymmetric double networks mutual teaching for unsupervised person Re-identification