Abstract:For robust multi-modal person re-identification (re-ID) models, it is crucial to effectively utilize the complementary information and constraint relationships among different modalities. However, current multi-modal methods often overlook the correlation between modalities at the feature fusion stage. To address this issue, we propose a novel multimodal person re-ID method called Transformer Relation Regularization (TRR). Firstly, we introduce an adaptive collaborative matching module that facilitates the exchange of useful information by mining feature correspondences between modalities. This module allows for the integration of complementary information, enhancing the re-ID performance. Secondly, we propose an enhanced embedded module that corrects general information using discriminative information within each modality. By leveraging this approach, we improve the model’s stability in challenging multi-modal environments. Lastly, we propose an adaptive triple loss to enhance sample utilization efficiency and mitigate the problem of inconsistent representation among multimodal samples. This loss function optimizes the model’s ability to distinguish between different individuals, leading to improved re-ID accuracy. Experimental results on several challenging visible-infrared person re-ID benchmark datasets demonstrate that our proposed TRR method achieves optimal performance. Additionally, extensive ablation studies validate the effective contribution of each component to the overall model. In , our proposed TRR method effectively leverages complementary information, addresses the correlation between modalities, and improves the re-ID performance in multi-modal scenarios. The results obtained from various benchmark datasets and the comprehensive analysis support the efficacy of our approach.

Tensor Multi-task Learning for Person Re-identification

Deep Siamese Network with Multi-level Similarity Perception for Person Re-identification

Person Re-identification Based on Transform Algorithm

Joining Features by Global Guidance with Bi-Relevance Trihard Loss for Person Re-Identification

Transformer-based Feature Interactor for Person Re-Identification with Margin Self-Punishment Loss

Contribution-Based Multi-Stream Feature Distance Fusion Method with ${k}$ -Distribution Re-Ranking for Person Re-Identification

MSTN: A Multi-granular Spatial–Temporal Network for video-based person re-identification

Adaptive multi-task learning for cross domain and modal person re-identification

Multi-Task Learning with Low Rank Attribute Embedding for Multi-Camera Person Re-Identification

Spatial-Temporal Correlation and Topology Learning for Person Re-Identification in Videos

Learning transformer-based attention region with multiple scales for occluded person re-identification

Person Re-Identification with Joint Verification and Identification of Identity-Attribute Labels

Multi-Scale Triplet CNN for Person Re-Identification.

Multi-modal person re-identification based on transformer relational regularization

Discriminative feature extraction for video person re-identification via multi-task network

Cross-modality neighbor constraints based unbalanced multi-view text–image re-identification

Discriminative Spatial Feature Learning for Person Re-Identification

Advancing Person Re-Identification: Tensor-based Feature Fusion and Multilinear Subspace Learning

Enhancing Person Re-Identification through Tensor Feature Fusion

Multi-scale Deep Learning Architectures for Person Re-identification

State-aware Re-identification Feature for Multi-target Multi-camera Tracking.