Abstract:Visible-infrared person re-identification (RGB-IR ReID) has now attracted increasing attention due to its surveillance applications under low-light environments. However, the large intra-class variations between different domains are still a challenging issue in the field of computer vision. To address the above issue, we propose a novel adversarial Decoupling and Modality-invariant Representation learning (DMiR) method to explore potential spectrum-invariant yet identity-discriminative representations for cross-modality pedestrians. Our model consists of three key components, including Domain-related Representation Disentanglement (DrRD), Modality-invariant Discriminative Representation (MiDR) and Representation Orthogonal Decorrelation (ROD). First, two subnets named Identity-Net and Domain-Net are designed to extract identity-related features and domain-related features, respectively. Given this two-stream structure, the DrRD is introduced to achieve adversarial decoupling against domain-specific features via a min-max disentanglement process. Specifically, the classification objective function on Domain-Net is minimized to extract spectrum-specific information while maximizing it to reduce domain-specific information. Second, in Identity-Net, we introduce MiDR to enhance intra-class compactness and reduce domain variations by exploring positive and negative pair variations, semantic-wise differences, and pair-wise semantic variations. Finally, the correlation between the two decomposed features, i.e., identity-related features and domain-related features, may lead to the introduction of modal information in identity representations, and vice versa. Therefore, we present the ROD constraint to make the two decomposed features unrelated to each other, which can more effectively separate the two-component features and enhance feature representations. Practically, we construct ROD at the feature-level and parameter-level, and finally select feature-level ROD as the decorrelation strategy because of its superior decorrelation performance. The whole scheme leads to disentangling spectrum-dependent information, as well as purifying identity information. Extensive experiments are carried out on two mainstream RGB-IR ReID datasets, and the results demonstrate the effectiveness of our method.

Learning Disentangled Representation for Robust Person Re-identification

Disentangled Representations for Short-Term and Long-Term Person Re-Identification

Hierarchical and Efficient Learning for Person Re-Identification

A Unified Generative Adversarial Framework for Image Generation and Person Re-identification.

FD-GAN: Pose-guided Feature Distilling GAN for Robust Person Re-identification

Learning Disentangled Features for Person Re-identification under Clothes Changing

Calibrated Feature Decomposition for Generalizable Person Re-Identification

Pose Invariant Person Re-Identification using Robust Pose-transformation GAN

Camera-Agnostic Person Re-Identification Via Adversarial Disentangling Learning.

Disentangled Sample Guidance Learning for Unsupervised Person Re-Identification

Pose Transferrable Person Re-Identification

Object and Background Disentanglement for Unsupervised Cross-Domain Person Re-Identification

Learning Camera-Invariant Representation For Person Re-Identification

Learning Sparse and Identity-Preserved Hidden Attributes for Person Re-Identification

Horizontal Flipping Assisted Disentangled Feature Learning for Semi-supervised Person Re-identification.

Semantics-Aligned Representation Learning for Person Re-Identification

Adversarial Decoupling and Modality-invariant Representation Learning for Visible-Infrared Person Re-identification

Improving Person Re-identification by Body Parts Segmentation Generated by GAN.

Pose Variation Adaptation for Person Re- Identification.

Deep Group-Shuffling Dual Random Walks with Label Smoothing for Person Reidentification

Multi-granularity Partial and Identity-aware Global Feature Learning for RGB-Infrared Person Re-identification