Abstract:In recent years, significant progress has been made in video-based person re-identification (Re-ID). The key challenge in video person Re-ID lies in effectively constructing discriminative and robust person feature representations. Methods based on local regions utilize spatial and temporal attention to extract representative local features. However, prior approaches often overlook the correlations between local regions. To leverage relationships among different local regions, we have proposed a novel video person Re-ID representation learning approach based on a graph transformer, which facilitates contextual interactions between relevant region features. Specifically, we construct a local relation graph to model intrinsic relationships between nodes representing local regions. This graph employs the architecture of a transformer for feature propagation, iteratively refining region features and considering information from adjacent nodes to obtain partial feature representations. To learn compact and discriminative representations, we have further proposed a global feature learning branch based on a vision transformer to capture the relationships between different frames in a sequence. Additionally, we designed a dual-branch interaction network based on multi-head fusion attention to integrate frame-level features extracted by both local and global branches. Finally, the concatenated global and local features, after interaction, are used for testing. We evaluated the proposed method on three datasets, namely iLIDS-VID, MARS, and DukeMTMC-VideoReID. Experimental results demonstrate competitive performance, validating the effectiveness of our proposed approach.

Decoupled Pose and Similarity Based Graph Neural Network for Video Person Re-Identification

Pose-Aided Video-based Person Re-Identification via Recurrent Graph Convolutional Network

Deep Siamese Network with Multi-level Similarity Perception for Person Re-identification

Learning global and local features using graph neural networks for person re-identification

Spatial-Temporal Correlation and Topology Learning for Person Re-Identification in Videos

Adaptive Graph Representation Learning for Video Person Re-identification

Dense 3D-Convolutional Neural Network for Person Re-Identification in Videos

Person Re-identification with Deep Similarity-Guided Graph Neural Network

Learning Compact Appearance Representation for Video-Based Person Re-Identification

Person Re-Identification Using Local Relation-Aware Graph Convolutional Network

Multi-Level Fusion Temporal-Spatial Co-Attention for Video-Based Person Re-Identification

Parallel Attention with Weighted Efficient Network for Video-Based Person Re-Identification.

Discriminative feature extraction for video person re-identification via multi-task network

Tran-GCN: A Transformer-Enhanced Graph Convolutional Network for Person Re-Identification in Monitoring Videos

An Unbiased Temporal Representation for Video-Based Person Re-Identification

A Unified Generative Adversarial Framework for Image Generation and Person Re-identification.

Adaptive Feature Fusion Via Graph Neural Network for Person Re-identification.

Deep Recurrent Convolutional Networks for Video-based Person Re-identification: An End-to-End Approach

Video-based Person Re-identification with Two-stream Convolutional Network and Co-attentive Snippet Embedding

Attribute-Guided Collaborative Learning for Partial Person Re-Identification

Video-based person re-identification with complementary local and global features using a graph transformer