Abstract:With the increasing demand for person re-identification (Re-ID) tasks, the need for all-day retrieval has become an inevitable trend. Nevertheless, single-modal Re-ID is no longer sufficient to meet this requirement, making Multi-Modal Data crucial in Re-ID. Consequently, a Visible-Infrared Person Re-Identification (VI Re-ID) task is proposed, which aims to match pairs of person images from the visible and infrared modalities. The significant modality discrepancy between the modalities poses a major challenge. Existing VI Re-ID methods focus on cross-modal feature learning and modal transformation to alleviate the discrepancy but overlook the impact of person contour information. Contours exhibit modality invariance, which is vital for learning effective identity representations and cross-modal matching. In addition, due to the low intra-modal diversity in the visible modality, it is difficult to distinguish the boundaries between some hard samples. To address these issues, we propose the Graph Sampling-based Multi-stream Enhancement Network (GSMEN). Firstly, the Contour Expansion Module (CEM) incorporates the contour information of a person into the original samples, further reducing the modality discrepancy and leading to improved matching stability between image pairs of different modalities. Additionally, to better distinguish cross-modal hard sample pairs during the training process, an innovative Cross-modality Graph Sampler (CGS) is designed for sample selection before training. The CGS calculates the feature distance between samples from different modalities and groups similar samples into the same batch during the training process, effectively exploring the boundary relationships between hard classes in the cross-modal setting. Some experiments conducted on the SYSU-MM01 and RegDB datasets demonstrate the superiority of our proposed method. Specifically, in the VIS→IR task, the experimental results on the RegDB dataset achieve 93.69% for Rank-1 and 92.56% for mAP.

Cross-modal Local Shortest Path and Global Enhancement for Visible-Thermal Person Re-Identification

Modality-transfer Generative Adversarial Network and Dual-Level Unified Latent Representation for Visible Thermal Person Re-Identification

Joining Features by Global Guidance with Bi-Relevance Trihard Loss for Person Re-Identification

A NEW PARADIGM FOR CROSS-MODALITY PERSON RE-IDENTIFICATION

Cross-Modality Person Re-Identification Via Modality-aware Collaborative Ensemble Learning.

Modality-aware Collaborative Learning for Visible Thermal Person Re-Identification.

Dual adaptive alignment and partitioning network for visible and infrared cross-modality person re-identification

Joint Robust Representation And Generalization Enhancement For Cross-Modality Person Re-Identification

Learning Fine-Grained Modality-Invariant Feature Via Wasserstein Distance for Visible-Thermal Person Re-Identification

Dual-Path Part-Level Method for Visible–Infrared Person Re-identification

A Spatial-Channel Multi-Attention Parallel Network for Visible-Infrared Person Re-identification

Feature separation and double causal comparison loss for visible and infrared person re-identification

Global-Local Multiple Granularity Learning for Cross-Modality Visible-Infrared Person Reidentification

Hierarchical Discriminative Learning for Visible Thermal Person Re-Identification.

Visible Thermal Person Re-Identification Via Dual-Constrained Top-Ranking

Graph Sampling-Based Multi-Stream Enhancement Network for Visible-Infrared Person Re-Identification

MSO: Multi-Feature Space Joint Optimization Network for RGB-Infrared Person Re-Identification

A Local-Global Self-attention Interaction Network for RGB-D Cross-Modal Person Re-identification.

Deep Multi-Patch Matching Network for Visible Thermal Person Re-Identification

Multi-stage Feature Interaction Network for Masked Visible-thermal Person Re-identification

Cross modality person re-identification via mask-guided dynamic dual-task collaborative learning