Abstract:Person re-identification (Re-ID) is an important problem in video surveillance for matching pedestrian images across non-overlapping camera views. Currently, most works focus on RGB-based Re-ID. However, RGB images are not well suited to a dark environment; consequently, infrared (IR) imaging becomes necessary for indoor scenes with low lighting and 24-h outdoor scene surveillance systems. In such scenarios, matching needs to be performed between RGB images and IR images, which exhibit different visual characteristics; this cross-modality matching problem is more challenging than RGB-based Re-ID due to the lack of visible colour information in IR images. To address this challenge, we study the RGB-IR cross-modality Re-ID (RGB-IR Re-ID) problem. Rather than applying existing cross-modality matching models that operate under the assumption of identical data distributions between training and testing sets to handle the discrepancy between RGB and IR modalities for Re-ID, we cast learning shared knowledge for cross-modality matching as the problem of cross-modality similarity preservation. We exploit same-modality similarity as the constraint to guide the learning of cross-modality similarity along with the alleviation of modality-specific information, and finally propose a Focal Modality-Aware Similarity-Preserving Loss. To further assist the feature extractor in extracting shared knowledge, we design a modality-gated node as a universal representation of both modality-specific and shared structures for constructing a structure-learnable feature extractor called Modality-Gated Extractor. For validation, we construct a new multi-modality Re-ID dataset, called SYSU-MM01, to enable wider study of this problem. Extensive experiments on this SYSU-MM01 dataset show the effectiveness of our method. Download link of dataset: <a href="https://github.com/wuancong/SYSU-MM01">https://github.com/wuancong/SYSU-MM01</a>.

Cross-dataset Person Re-Identification Using Similarity Preserved Generative Adversarial Networks.

Crossing Generative Adversarial Networks for Cross-View Person Re-identification

Similarity Preserved Camera-to-Camera Gan for Person Re-Identification.

Cross-Modality Person Re-Identification with Generative Adversarial Training

Similarity-preserving Image-image Domain Adaptation for Person Re-identification

PAC-GAN: an Effective Pose Augmentation Scheme for Unsupervised Cross-View Person Re-identification

RGB-IR Person Re-identification by Cross-Modality Similarity Preservation

Image-Image Domain Adaptation with Preserved Self-Similarity and Domain-Dissimilarity for Person Re-identification

Identity Preserving Generative Adversarial Network for Cross-Domain Person Re-Identification

Cross-domain Person Re-Identification by Hybrid Supervised and Unsupervised Learning

Feature preserving GAN and multi-scale feature enhancement for domain adaption person Re-identification

A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification

Cross-Domain Person Re-Identification Based on Feature Fusion

A Unified Generative Adversarial Framework for Image Generation and Person Re-identification.

Deep Siamese Network with Multi-level Similarity Perception for Person Re-identification

CGAN-TM: A Novel Domain-to-domain Transferring Method for Person Re-Identification.

FD-GAN: Pose-guided Feature Distilling GAN for Robust Person Re-identification

RGB-Infrared Cross-Modality Person Re-Identification via Joint Pixel and Feature Alignment

Unsupervised Person Re-identification Via Cross-camera Similarity Exploration.

Generated Data With Sparse Regularized Multi-Pseudo Label for Person Re-Identification

Unlabeled Samples Generated by GAN Improve the Person Re-identification Baseline in Vitro