Abstract:In recent years, the field of video-based person re-identification (re-ID) has conducted in-depth research on how to effectively utilize spatiotemporal clues, which has attracted attention for its potential in providing comprehensive view representations of pedestrians. However, although the discriminability and correlation of spatiotemporal features are often studied, the exploration of the complex relationships between these features has been relatively neglected. Especially when dealing with multi-granularity features, how to depict the different spatial representations of the same person under different perspectives becomes a challenge. To address this challenge, this paper proposes a multi-granularity inter-frame relationship exploration and global residual embedding network specifically designed to solve the above problems. This method successfully extracts more comprehensive and discriminative feature representations by deeply exploring the interactions and global differences between multi-granularity features. Specifically, by simulating the dynamic relationship of different granularity features in long video sequences and using a structured perceptual adjacency matrix to synthesize spatiotemporal information, cross-granularity information is effectively integrated into individual features. In addition, by introducing a residual learning mechanism, this method can also guide the diversified development of global features and reduce the negative impacts caused by factors such as occlusion. Experimental results verify the effectiveness of this method on three mainstream benchmark datasets, significantly surpassing state-of-the-art solutions. This shows that this paper successfully solves the challenging problem of how to accurately identify and utilize the complex relationships between multi-granularity spatiotemporal features in video-based person re-ID.

Combine Coarse and Fine Cues: Multi-grained Fusion Network for Video-Based Person Re-identification

Person Re-identification Network Based on Multi-Level Feature Fusion

Contribution-Based Multi-Stream Feature Distance Fusion Method With <inline-formula> <tex-math notation="LaTeX">${k}$ </tex-math></inline-formula>-Distribution Re-Ranking for Person Re-Identification

Gaussian-based Probability Fusion for Person Re-Identification with Taylor Angular Margin Loss

Contribution-Based Multi-Stream Feature Distance Fusion Method with ${k}$ -Distribution Re-Ranking for Person Re-Identification

MSTN: A Multi-granular Spatial–Temporal Network for video-based person re-identification

Multi-Level Fusion Temporal-Spatial Co-Attention for Video-Based Person Re-Identification

Multi-granular inter-frame relation exploration and global residual embedding for video-based person re-identification

Multi-scale spatio-temporal feature adaptive aggregation for video-based Person Re -identification

Multi-granularity Pose Fusion Network with Views for Person Re-identification

Deep Spatial-Temporal Fusion Network for Video-Based Person Re-identification.

Video-based Person re-identification with parallel correction and fusion of pedestrian area features

Fine-Grained Fusion with Distractor Suppression for Video-Based Person Re-Identification

Person Re-Identification by Optimizing and Integrating Multiple Feature Representations

Multi-Granularity Reference-Aided Attentive Feature Aggregation for Video-based Person Re-identification

Graph based Spatial-temporal Fusion for Multi-modal Person Re-identification

Adaptive Multi-Metric Fusion for Person Re-identification.

Adaptive Feature Fusion Via Graph Neural Network for Person Re-identification.

Multi‐scale Feature Combination for Person Re‐identification

Learning Multi-Granular Hypergraphs for Video-Based Person Re-Identification

Multitask Multigranularity Aggregation With Global-Guided Attention for Video Person Re-Identification