Abstract:Visible-infrared person re-identification (RGB-IR ReID) has now attracted increasing attention due to its surveillance applications under low-light environments. However, the large intra-class variations between different domains are still a challenging issue in the field of computer vision. To address the above issue, we propose a novel adversarial Decoupling and Modality-invariant Representation learning (DMiR) method to explore potential spectrum-invariant yet identity-discriminative representations for cross-modality pedestrians. Our model consists of three key components, including Domain-related Representation Disentanglement (DrRD), Modality-invariant Discriminative Representation (MiDR) and Representation Orthogonal Decorrelation (ROD). First, two subnets named Identity-Net and Domain-Net are designed to extract identity-related features and domain-related features, respectively. Given this two-stream structure, the DrRD is introduced to achieve adversarial decoupling against domain-specific features via a min-max disentanglement process. Specifically, the classification objective function on Domain-Net is minimized to extract spectrum-specific information while maximizing it to reduce domain-specific information. Second, in Identity-Net, we introduce MiDR to enhance intra-class compactness and reduce domain variations by exploring positive and negative pair variations, semantic-wise differences, and pair-wise semantic variations. Finally, the correlation between the two decomposed features, i.e., identity-related features and domain-related features, may lead to the introduction of modal information in identity representations, and vice versa. Therefore, we present the ROD constraint to make the two decomposed features unrelated to each other, which can more effectively separate the two-component features and enhance feature representations. Practically, we construct ROD at the feature-level and parameter-level, and finally select feature-level ROD as the decorrelation strategy because of its superior decorrelation performance. The whole scheme leads to disentangling spectrum-dependent information, as well as purifying identity information. Extensive experiments are carried out on two mainstream RGB-IR ReID datasets, and the results demonstrate the effectiveness of our method.

Adversarial Disentanglement and Correlation Network for Rgb-Infrared Person Re-Identification.

Modality-transfer Generative Adversarial Network and Dual-Level Unified Latent Representation for Visible Thermal Person Re-Identification

Adversarial Recovery Network for Low-Light Person Re-Identification.

Joining Features by Global Guidance with Bi-Relevance Trihard Loss for Person Re-Identification

Joint Uneven Channel Information Network with Blend Metric Loss for Person Re-Identification

Modality-Adaptive Mixup and Invariant Decomposition for RGB-Infrared Person Re-Identification

RGB-IR Person Re-identification by Cross-Modality Similarity Preservation

Adversarial Decoupling and Modality-invariant Representation Learning for Visible-Infrared Person Re-identification

Dual Attention Matching Network for Context-Aware Feature Sequence based Person Re-Identification

Cross-Spectrum Dual-Subspace Pairing for RGB-infrared Cross-Modality Person Re-Identification

Bi-directional Exponential Angular Triplet Loss for RGB-Infrared Person Re-Identification

Multi-Scale Cascading Network with Compact Feature Learning for RGB-Infrared Person Re-Identification.

Modality Bias Calibration Network Via Information Disentanglement for Visible–Infrared Person Reidentification

Cross-modality paired-images generation and augmentation for RGB-infrared person re-identification

Dual adaptive alignment and partitioning network for visible and infrared cross-modality person re-identification

DF^2AM: Dual-level Feature Fusion and Affinity Modeling for RGB-Infrared Cross-modality Person Re-identification

RGB-Infrared Cross-Modality Person Re-Identification via Joint Pixel and Feature Alignment

Adversarial Learning Based on Global and Local Features for Cross-Modal Person Re-identification

Neural Feature Search for RGB-Infrared Person Re-Identification

Cross-Modality Person Re-Identification with Generative Adversarial Training

Cross-modality disentanglement and shared feedback learning for infrared-visible person re-identification