Abstract:Video-based person re-identification (Re-ID) is designed to retrieve target pedestrians in video sequences under non-overlapping cameras. At present, mainstream approaches post-process the feature map extracted by the convolutional neural network backbone to obtain a global representation or a fine-grained local representation for higher accuracy. However, they still suffer from challenges, such as information loss for global-based methods and spatio-temporal feature fragmentation for local-based methods. To alleviate these problems, this paper proposes a Spatio-Temporal Feature Enhancement (STFE) network from a spatio-temporal comprehensive perspective, combining the advantages of the above methods to obtain more comprehensive information from video tracklets. STFE consists of two main modules: Feature Space Projection Module (FSPM) and Global Low-frequency Enhancement Module (GLEM). FSPM mathematically converts continuous video information into a discrete feature space and selectively retains more useful information, thus avoiding spatio-temporal information loss. Meanwhile, FSPM applies global features instead of dividing feature maps spatially, thereby avoiding spatio-temporal feature fragmentation. In addition, GLEM which is based on transformer, acts as a broadband low-pass filter to mine richer global comprehensive information. Finally, by combining FSPM with GLEM, STFE can obtain spatio-temporal comprehensive video representation. Extensive experiments were conducted on two widely-used video Re-ID datasets. The experimental results verify our idea and demonstrate the effectiveness of the proposed STFE with 95.5% Rank-1 accuracy on MARS benchmarks, which surpasses previous state-of-the-arts by a large margin of +4%.

Flow-guided Feature Enhancement Network for Video-Based Person Re-Identification

Joint Uneven Channel Information Network with Blend Metric Loss for Person Re-Identification

Person Re-identification Network Based on Multi-Level Feature Fusion

Joining Features by Global Guidance with Bi-Relevance Trihard Loss for Person Re-Identification

Feature Refinement and Filter Network for Person Re-Identification

Discriminative feature extraction for video person re-identification via multi-task network

Spatial and Temporal Mutual Promotion for Video-Based Person Re-Identification.

Dual Attention Matching Network for Context-Aware Feature Sequence based Person Re-Identification

STFE: A Comprehensive Video-Based Person Re-Identification Network Based on Spatio-Temporal Feature Enhancement

Deep Recurrent Convolutional Networks for Video-based Person Re-identification: An End-to-End Approach

Spatial-Temporal Correlation and Topology Learning for Person Re-Identification in Videos

Video-based Person re-identification with parallel correction and fusion of pedestrian area features

Temporal Complementarity-Guided Reinforcement Learning for Image-to-Video Person Re-Identification

MSTN: A Multi-granular Spatial–Temporal Network for video-based person re-identification

Adaptive Graph Representation Learning for Video Person Re-identification

Video-based Person Re-identification with Two-stream Convolutional Network and Co-attentive Snippet Embedding

Effective Similarity Measurement for Video-based Person Re-identification

Multi-Level Fusion Temporal-Spatial Co-Attention for Video-Based Person Re-Identification

Parallel Attention with Weighted Efficient Network for Video-Based Person Re-Identification.

Relation-Guided Spatial Attention and Temporal Refinement for Video-Based Person Re-Identification.

Adaptive Feature Fusion Via Graph Neural Network for Person Re-identification.