Abstract:Gait recognition is a promising biometric technology that aims to identify the target subject via walking pattern. Most existing appearance-based methods focus on learning discriminative spatio-temporal representations from gait silhouettes. However, these methods pay less attention to probing the causality between identity factors and identity labels, which often mislead the model to learn gait representations that are susceptible to identity-irrelevant factors. In this paper, we attribute the cause that leads to the decline of model generalization under different external conditions to identity-irrelevant factors. We formulate the causalities among the identity factors, identity-irrelevant factors, and identity labels as a structural causal model (SCM). We accordingly propose a novel gait recognition framework named GaitSCM to learn covariate invariant gait representations, which is mainly composed of three components, including feature extraction module, feature disentanglement module, and backdoor adjustment. Specifically, we design a feature extractor with regard to the movement patterns of different body parts to learn fine-grained gait motion features, and then present a two-branch feature decoupling module to disentangle identity features and identity-irrelevant features with the aid of the classification confusion loss. To relieve the negative effect of identity-irrelevant factors, we develop a backdoor adjustment strategy to eliminate spurious associations between identity and identity-irrelevant features, which further facilitates the proposed framework to generate more powerful identity representations. Extensive experiments conducted on two public datasets validate the effectiveness of our method. The average Rank-1 can reach 93.2% and 90.4% on CASIA-B and OU-MVLP datasets, respectively, which verifies the superiority of GaitSCM. Source code is released at: https://github.com/HuoweiCode/GaitSCM .

Importance-Aware Spatial-Temporal Representation Learning for Gait Recognition

Human Identification Based on Gait Manifold

Learning Temporal Attention Based Keypoint-Guided Embedding for Gait Recognition

Human Gait Recognition Based on Frame-by-Frame Gait Energy Images and Convolutional Long Short-Term Memory

Adaptive Spatiotemporal Feature Learning for Gait Recognition

GaitCTCG: cross-view gait recognition via cascaded residual temporal shift and comprehensive multi-granularity learning

Context-Sensitive Temporal Feature Learning for Gait Recognition

Gait Recognition Based on Margin Sample Mining Loss

GaitTAKE: Gait Recognition by Temporal Attention and Keypoint-guided Embedding

GaitFormer: Revisiting Intrinsic Periodicity for Gait Recognition

Gait Recognition Via Effective Global-Local Feature Representation and Local Temporal Aggregation

GaitGS: Temporal Feature Learning in Granularity and Span Dimension for Gait Recognition

MetaGait: Learning to Learn an Omni Sample Adaptive Representation for Gait Recognition

Spatio-temporal Gait Feature with Global Distance Alignment

GLGait: A Global-Local Temporal Receptive Field Network for Gait Recognition in the Wild

Gaitts: indoor gait recognition with multi-scale temporal-spatial information aggregation

TAG: A Temporal AttentiveGait Network for Cross-View Gait Recognition

TAG: A Temporal Attentive Gait Network for Cross-View Gait Recognition

Multiple Temporal Aggregation Embedding for Gait Recognition in the Wild.

On Learning Disentangled Representations for Gait Recognition

GaitSCM: Causal representation learning for gait recognition