Abstract:With the prevalence of dual-mode cameras in surveillance systems, visible-infrared person re-identification (VI-ReID) has become an emerging topic. Existing studies of VI-ReID roughly fall into three categories: straightforwardly extracting features, improving loss functions, and conducting visible-infrared modality generation. The generation methods avoid the shortcoming of the former two that training models are generally vulnerable to parameter changes. However, these generation methods are usually based on spatial domain and are unavoidable to damage the original information of images. To tackle these limitations, we propose a novel frequency-domain simulated multispectral (FSMS) modality and visible-FSMS-infrared collaborative learning. FSMS modality consists of three-channel images generated by a channel-level reconstruction of visible images, primarily based on the nonsubsampled contourlet transform (NSCT) cooperating with a lightweight network. The generation exploits crucial spectral information and edge information contained in frequency domain. Then, we design a multi-modality network to conduct the tri-modality collaborative learning where FSMS modality is utilized as an intermediate, thereby preserving the original spatial structure of images. Additionally, a dynamic-weight tri-modality heterogeneous retrieval (THR) loss and a modality-shared classification (MSI) loss are devised to mine discriminative modality-invariant features. A cross-modality invariant (CMI) constraint for further exploring triplet-wise relationships and an intra-modality regularizer for relatively stable convergence are introduced. Finally, experimental results show that our algorithm significantly outperforms the latest state-of-the-arts by 5.7% and 4.4% CMC-1 accuracy on two mainstream benchmark datasets, respectively. And the reasons underlying the observed increase in performance are deeply discussed.

Knowledge self-distillation for visible-infrared cross-modality person re-identification

Implicit Discriminative Knowledge Learning for Visible-Infrared Person Re-Identification

Multi-knowledge-driven enhanced module for visible-infrared cross-modal person Re-identification

Inter-Intra Modality Knowledge Learning and Clustering Noise Alleviation for Unsupervised Visible-Infrared Person Re-Identification

Co-segmentation assisted cross-modality person re-identification

Hi-CMD: Hierarchical Cross-Modality Disentanglement for Visible-Infrared Person Re-Identification

Cross-modality disentanglement and shared feedback learning for infrared-visible person re-identification

Cooperative Separation of Modality Shared-Specific Features for Visible-Infrared Person Re-Identification

Dual Knowledge Distillation on Multiview Pseudo Labels for Unsupervised Person Re-Identification

Pose-Guided Feature Learning with Knowledge Distillation for Occluded Person Re-Identification.

Joint Color-irrelevant Consistency Learning and Identity-aware Modality Adaptation for Visible-infrared Cross Modality Person Re-identification.

Feature separation and double causal comparison loss for visible and infrared person re-identification

Stronger Heterogeneous Feature Learning for Visible-Infrared Person Re-Identification

Dual adaptive alignment and partitioning network for visible and infrared cross-modality person re-identification

Progressive Discriminative Feature Learning for Visible-Infrared Person Re-Identification

Deep learning for visible-infrared cross-modality person re-identification: A comprehensive review

Cross-Modality Person Re-identification with Memory-Based Contrastive Embedding

Implicit Modality Knowledge Alignment and Uncertainty Estimation for visible-infrared person re-identification

Visible-Infrared Person Re-Identification Based on Frequency-Domain Simulated Multispectral Modality for Dual-Mode Cameras

Infrared-Visible Cross-Modal Person Re-Identification with an X Modality

Unsupervised Visible-Infrared Person ReID by Collaborative Learning with Neighbor-Guided Label Refinement