Abstract:Person re-identification (Re-ID) via gait features within 3D skeleton sequences is a newly-emerging topic with several advantages. Existing solutions either rely on hand-crafted descriptors or supervised gait representation learning. This paper proposes a self-supervised gait encoding approach that can leverage unlabeled skeleton data to learn gait representations for person Re-ID. Specifically, we first create self-supervision by learning to reconstruct unlabeled skeleton sequences reversely, which involves richer high-level semantics to obtain better gait representations. Other pretext tasks are also explored to further improve self-supervised learning. Second, inspired by the fact that motion's continuity endows adjacent skeletons in one skeleton sequence and temporally consecutive skeleton sequences with higher correlations (referred as locality in 3D skeleton data), we propose a locality-aware attention mechanism and a locality-aware contrastive learning scheme, which aim to preserve locality-awareness on intra-sequence level and inter-sequence level respectively during self-supervised learning. Last, with context vectors learned by our locality-aware attention mechanism and contrastive learning scheme, a novel feature named Constrastive Attention-based Gait Encodings (CAGEs) is designed to represent gait effectively. Empirical evaluations show that our approach significantly outperforms skeleton-based counterparts by 15-40 percent Rank-1 accuracy, and it even achieves superior performance to numerous multi-modal methods with extra RGB or depth information. Our codes are available at https://github.com/Kali-Hac/Locality-Awareness-SGE.

GLAD: Global–Local-Alignment Descriptor for Scalable Person Re-Identification

Glad: Global-Local-Alignment Descriptor For Pedestrian Retrieval

People Re-Identification with Local Distance Comparison Using Learned Metric.

Pose-Guided Representation Learning for Person Re-Identification

Cluster-Based Distribution Alignment For Generalizable Person Re-Identification

Person Re-Identification Based on Diversified Local Attention Network

Appearance and Gait-Based Progressive Person Re-Identification for Surveillance Systems

Multi-scale local-global architecture for person re-identification

3D Person Re-identification Based on Global Semantic Guidance and Local Feature Aggregation

Long-Term Person Re-Identification Based on Appearance and Gait Feature Fusion under Covariate Changes

Self-Supervised Gait Encoding with Locality-Aware Attention for Person Re-Identification

Local-Global Extraction Unit for Person Re-identification.

Ensemble of pose aligned features for person re-identification

Generalizable Person Re-Identification via Viewpoint Alignment and Fusion

Pose-Guided Attention and Alignment (PGAA) for Dislocated Target Person Re-Identification Based on Multi-feature Fusion

GLSFF: Global–local Specific Feature Fusion for Cross-Modality Pedestrian Re-Identification

Combined Salience Based Person Re-Identification

A Self-Supervised Gait Encoding Approach with Locality-Awareness for 3D Skeleton Based Person Re-Identification

Person Re-Identification Based on Multi-Scale Global Feature and Weight-Driven Part Feature.

Deeply-Learned Spatial Alignment For Person Re-Identification