Abstract:Existing studies for gait recognition primarily utilized sequences of either binary silhouette or human parsing to encode the shapes and dynamics of persons during walking. Silhouettes exhibit accurate segmentation quality and robustness to environmental variations, but their low information entropy may result in sub-optimal performance. In contrast, human parsing provides fine-grained part segmentation with higher information entropy, but the segmentation quality may deteriorate due to the complex environments. To discover the advantages of silhouette and parsing and overcome their limitations, this paper proposes a novel cross-granularity alignment gait recognition method, named XGait, to unleash the power of gait representations of different granularity. To achieve this goal, the XGait first contains two branches of backbone encoders to map the silhouette sequences and the parsing sequences into two latent spaces, respectively. Moreover, to explore the complementary knowledge across the features of two representations, we design the Global Cross-granularity Module (GCM) and the Part Cross-granularity Module (PCM) after the two encoders. In particular, the GCM aims to enhance the quality of parsing features by leveraging global features from silhouettes, while the PCM aligns the dynamics of human parts between silhouette and parsing features using the high information entropy in parsing sequences. In addition, to effectively guide the alignment of two representations with different granularity at the part level, an elaborate-designed learnable division mechanism is proposed for the parsing features. Finally, comprehensive experiments on two large-scale gait datasets not only show the superior performance of XGait with the Rank-1 accuracy of 80.5% on Gait3D and 88.3% CCPG but also reflect the robustness of the learned features even under challenging conditions like occlusions and cloth changes

Subspace Ensemble Learning Via Totally-Corrective Boosting for Gait Recognition

Cross-view Gait Recognition Through Ensemble Learning

Human Identification Based on Gait Manifold

Human Gait Recognition Based on Frame-by-Frame Gait Energy Images and Convolutional Long Short-Term Memory

Human Gait Recognition Based on Self-Adaptive Hidden Markov Model

Non-local Gait Feature Extraction and Human Identification

Learning Efficient Spatial-Temporal Gait Features with Deep Learning for Human Identification.

Gait Recognition Via Cross Walking Condition Constraint

Gait Recognition Using Optical Motion Capture: A Decision Fusion Based Method

GaitCTCG: cross-view gait recognition via cascaded residual temporal shift and comprehensive multi-granularity learning

SSGait: enhancing gait recognition via semi-supervised self-supervised learning

GaitSet: Cross-view Gait Recognition through Utilizing Gait as a Deep Set

Learning Temporal Attention Based Keypoint-Guided Embedding for Gait Recognition

On Learning Disentangled Representations for Gait Recognition

It Takes Two: Accurate Gait Recognition in the Wild Via Cross-granularity Alignment

Human Gait Recognition by Integrating Motion Feature and Shape Feature

GaitTAKE: Gait Recognition by Temporal Attention and Keypoint-guided Embedding

Sparse Tensor Discriminative Locality Alignment For Gait Recognition

TriGait: Aligning and Fusing Skeleton and Silhouette Gait Data via a Tri-Branch Network

GaitSet: Regarding Gait as a Set for Cross-View Gait Recognition

Human Gait Recognition with Matrix Representation