Abstract:Gait recognition is a promising biometric technology that aims to identify the target subject via walking pattern. Most existing appearance-based methods focus on learning discriminative spatio-temporal representations from gait silhouettes. However, these methods pay less attention to probing the causality between identity factors and identity labels, which often mislead the model to learn gait representations that are susceptible to identity-irrelevant factors. In this paper, we attribute the cause that leads to the decline of model generalization under different external conditions to identity-irrelevant factors. We formulate the causalities among the identity factors, identity-irrelevant factors, and identity labels as a structural causal model (SCM). We accordingly propose a novel gait recognition framework named GaitSCM to learn covariate invariant gait representations, which is mainly composed of three components, including feature extraction module, feature disentanglement module, and backdoor adjustment. Specifically, we design a feature extractor with regard to the movement patterns of different body parts to learn fine-grained gait motion features, and then present a two-branch feature decoupling module to disentangle identity features and identity-irrelevant features with the aid of the classification confusion loss. To relieve the negative effect of identity-irrelevant factors, we develop a backdoor adjustment strategy to eliminate spurious associations between identity and identity-irrelevant features, which further facilitates the proposed framework to generate more powerful identity representations. Extensive experiments conducted on two public datasets validate the effectiveness of our method. The average Rank-1 can reach 93.2% and 90.4% on CASIA-B and OU-MVLP datasets, respectively, which verifies the superiority of GaitSCM. Source code is released at: https://github.com/HuoweiCode/GaitSCM .

Cloth-Imbalanced Gait Recognition via Hallucination

Collaborative Feature Learning for Gait Recognition under Cloth Changes

HybridGait: A Benchmark for Spatial-Temporal Cloth-Changing Gait Recognition with Hybrid Explorations

Human Gait Recognition Based on Self-Adaptive Hidden Markov Model

Cross-view Gait Recognition Through Ensemble Learning

Progressive Feature Learning for Realistic Cloth-Changing Gait Recognition

Condition-Aware Comparison Scheme for Gait Recognition

Cloth-Changing Person Re-identification from A Single Image with Gait Prediction and Regularization

CLASH: Complementary Learning with Neural Architecture Search for Gait Recognition

Gait Recognition Using Multichannel Convolution Neural Networks

Unsupervised Gait Recognition with Selective Fusion

GaitSet: Cross-view Gait Recognition through Utilizing Gait as a Deep Set

Identity-Guided Collaborative Learning for Cloth-Changing Person Reidentification

GaitSCM: Causal representation learning for gait recognition

GaitSet: Regarding Gait as a Set for Cross-View Gait Recognition

On Learning Disentangled Representations for Gait Recognition

GaitCTCG: cross-view gait recognition via cascaded residual temporal shift and comprehensive multi-granularity learning

Gait Recognition Via Cross Walking Condition Constraint

It Takes Two: Accurate Gait Recognition in the Wild Via Cross-granularity Alignment

Attention-based Shape and Gait Representations Learning for Video-based Cloth-Changing Person Re-Identification