Abstract:Visible-infrared person re-identification (VI-ReID) aims to identify the same person across visible and infrared images. Its main challenge is how to extract modality-irrelevant person identity information. To alleviate cross-modality discrepancies, existing methods typically follow two paradigms: 1) Transform visible images into gray-scale color space and map them into the infrared domain. 2) Stack infrared images into RGB color space and map them into the visible domain. However, limited by different optical properties of visible and infrared waves, such mapping commonly leads to information asymmetry. Although some efforts prevent such discrepancies by data-level alignment, they typically meanwhile introduce misleading information and bring extra divergence. Therefore, existing methods fail on effectively eliminating the modality discrepancies. In this paper, we first analyze the essential factors to the generation of modality discrepancies. Secondly, we propose a novel Dual Modality-aware Alignment (DMA) model for VI-ReID, which can preserve discriminative identity information and suppress the misleading information within a uniform scheme. Particularly, based on the intrinsic optical properties of both modalities, a Dual Modality Transfer (DMT) module is proposed to perform compensation for the information asymmetry in HSV color space, thereby effectively alleviating cross-modality discrepancies and better preserving discriminative identity features. Further, an Intra-local Alignment (IA) module is proposed to suppress the misleading information, where a fine-grained local consistency objective function is designed to achieve more compact intra-class representations. Extensive experiments on several benchmark datasets demonstrate the effectiveness of our method and competitive performance with state-of-the-art methods. The source code of this paper is available at https://github.com/PKU-ICST-MIPL/DMA_TIFS2023.

An aligned bidirectional feature representation for person re-identification

Joining Features by Global Guidance with Bi-Relevance Trihard Loss for Person Re-Identification

Contribution-Based Multi-Stream Feature Distance Fusion Method with ${k}$ -Distribution Re-Ranking for Person Re-Identification

Orientation Driven Bag of Appearances for Person Re-identification.

DMM: Dual-Modal Model for Person Re-Identification

Dual Attention Matching Network for Context-Aware Feature Sequence based Person Re-Identification

Body-Structure Based Feature Representation For Person Re-Identification

Deeply-Learned Part-Aligned Representations for Person Re-identification.

Densely Semantically Aligned Person Re-Identification

Cd-Abm: Curriculum Design With Attention Branch Model For Person Re-Identification

Improving Description-based Person Re-identification by Multi-granularity Image-text Alignments

Hierarchical Bi-Directional Feature Perception Network for Person Re-Identification

Person Reidentification by Multiscale Feature Representation Learning With Random Batch Feature Mask

MAENet: Boosting Feature Representation for Cross-Modal Person Re-Identification with Pairwise Supervision

Part-Weighted Deep Representation Learning for Person Re-Identification

DMA: Dual Modality-Aware Alignment for Visible-Infrared Person Re-Identification

Discriminative multi-scale adjacent feature for person re-identification

Pose-Guided Feature Alignment for Occluded Person Re-Identification

Exploiting feature representations through similarity learning, post-ranking and ranking aggregation for person re-identification

AlignedReID++: Dynamically matching local information for person re-identification

A multi-branch attention and alignment network for person re-identification