Abstract:Video-based visible-infrared person re-identification (VVI-ReID) aims to match the identity of a person captured in video sequences from both visible and infrared cameras. The VVI-ReID task requires considering both the spatial relationship between body parts within each frame and the temporal change of appearance between successive frames. Existing VVI Re-ID methods employ Convolutional Neural Networks to extract local spatial features and Long Short-Term Memory to form temporal associations. However, these methods can not effectively capture the global spatial feature and the long-range temporal dependencies in ultra-long sequences. In this paper, we propose a Cross-modality Spatial-temporal Transformer (CST) including a Cross-frame Tube Transformer Module (CTTM) and a Multi-frame Transformer Fusion Module (MTFM) to address these challenges. Firstly, CTTM tokenizes a video clip into multiple 3D tubes, each encapsulating local spatial-temporal information of pedestrians, and then obtains global spatial-temporal representations by establishing the relationship between tubes. Secondly, we design MTFM to exchange information between multiple frames using message tokens, thus modeling the long-range temporal dependencies of features of pedestrians. In addition, to prevent the potential representation collapse caused by triplet-based loss functions, we propose a diversity-consistency (DC) loss function to preserve the diversity and consistency of cross-modality feature representations by imposing variance, invariance, and covariance constraints in feature representations. Extensive benchmark experiments demonstrate that our approach outperforms the state-of-the-art methods with large margins.

Viewpoint Transform Matching Model for Person Re-Identification.

Person Re-identification Based on Transform Algorithm

RETRACTED CHAPTER: Person Re-identification Based on Transform Algorithm

Boosting Person Re-Identification with Viewpoint Contrastive Learning and Adversarial Training

Person Re-Identification Based On Viewpoint Correspondence Pattern

Consistent Iterative Multi-view Transfer Learning for Person Re-identification

Generalizable Person Re-Identification via Viewpoint Alignment and Fusion

Point-level feature learning based on vision transformer for occluded person re-identification

A Video Is Worth Three Views: Trigeminal Transformers for Video-Based Person Re-Identification

Viewpoint-Aware Loss with Angular Regularization for Person Re-Identification

Cross-Modality Spatial-Temporal Transformer for Video-Based Visible-Infrared Person Re-Identification

Multi-view Information Integration and Propagation for Occluded Person Re-identification

Kernelized View Adaptive Subspace Learning for Person Re-identification

Tensor Multi-task Learning for Person Re-identification

View-decoupled Transformer for Person Re-identification under Aerial-ground Camera Network

Ranking-Embedded Transfer Canonical Correlation Analysis for Person Re-Identification

Enhanced visible–infrared person re-identification based on cross-attention multiscale residual vision transformer

VMRFANet:View-Specific Multi-Receptive Field Attention Network for Person Re-identification

Viewpoint Disentangling and Generation for Unsupervised Object Re-ID

Lpcv: Learning Projections From Corresponding Views For Person Re-Identification

Learning Correspondence Structures for Person Re-identification