Abstract:Gait recognition is a promising biometric technology that aims to identify the target subject via walking pattern. Most existing appearance-based methods focus on learning discriminative spatio-temporal representations from gait silhouettes. However, these methods pay less attention to probing the causality between identity factors and identity labels, which often mislead the model to learn gait representations that are susceptible to identity-irrelevant factors. In this paper, we attribute the cause that leads to the decline of model generalization under different external conditions to identity-irrelevant factors. We formulate the causalities among the identity factors, identity-irrelevant factors, and identity labels as a structural causal model (SCM). We accordingly propose a novel gait recognition framework named GaitSCM to learn covariate invariant gait representations, which is mainly composed of three components, including feature extraction module, feature disentanglement module, and backdoor adjustment. Specifically, we design a feature extractor with regard to the movement patterns of different body parts to learn fine-grained gait motion features, and then present a two-branch feature decoupling module to disentangle identity features and identity-irrelevant features with the aid of the classification confusion loss. To relieve the negative effect of identity-irrelevant factors, we develop a backdoor adjustment strategy to eliminate spurious associations between identity and identity-irrelevant features, which further facilitates the proposed framework to generate more powerful identity representations. Extensive experiments conducted on two public datasets validate the effectiveness of our method. The average Rank-1 can reach 93.2% and 90.4% on CASIA-B and OU-MVLP datasets, respectively, which verifies the superiority of GaitSCM. Source code is released at: https://github.com/HuoweiCode/GaitSCM .

Condition-Aware Comparison Scheme for Gait Recognition

Gait Recognition Via Cross Walking Condition Constraint

Human Gait Recognition Based on Self-Adaptive Hidden Markov Model

Cross-view Gait Recognition Through Ensemble Learning

Gait Recognition Using Multichannel Convolution Neural Networks

Human Gait Recognition Based on Frame-by-Frame Gait Energy Images and Convolutional Long Short-Term Memory

GaitCTCG: cross-view gait recognition via cascaded residual temporal shift and comprehensive multi-granularity learning

Condition-Adaptive Graph Convolution Learning for Skeleton-Based Gait Recognition

CLASH: Complementary Learning with Neural Architecture Search for Gait Recognition

Human Identification Based on Gait Manifold

Cloth-Imbalanced Gait Recognition via Hallucination

HybridGait: A Benchmark for Spatial-Temporal Cloth-Changing Gait Recognition with Hybrid Explorations

GaitSCM: Causal representation learning for gait recognition

GaitSet: Regarding Gait as a Set for Cross-View Gait Recognition

GaitContour: Efficient Gait Recognition based on a Contour-Pose Representation

GaitSet: Cross-view Gait Recognition through Utilizing Gait as a Deep Set

Gaitts: indoor gait recognition with multi-scale temporal-spatial information aggregation

Multi-scale Context-aware Network with Transformer for Gait Recognition

On Learning Disentangled Representations for Gait Recognition

Spatio-temporal Gait Feature with Global Distance Alignment

Joint Metric Learning and Hierarchical Network for Gait Recognition