Abstract:Existing studies for gait recognition primarily utilized sequences of either binary silhouette or human parsing to encode the shapes and dynamics of persons during walking. Silhouettes exhibit accurate segmentation quality and robustness to environmental variations, but their low information entropy may result in sub-optimal performance. In contrast, human parsing provides fine-grained part segmentation with higher information entropy, but the segmentation quality may deteriorate due to the complex environments. To discover the advantages of silhouette and parsing and overcome their limitations, this paper proposes a novel cross-granularity alignment gait recognition method, named XGait, to unleash the power of gait representations of different granularity. To achieve this goal, the XGait first contains two branches of backbone encoders to map the silhouette sequences and the parsing sequences into two latent spaces, respectively. Moreover, to explore the complementary knowledge across the features of two representations, we design the Global Cross-granularity Module (GCM) and the Part Cross-granularity Module (PCM) after the two encoders. In particular, the GCM aims to enhance the quality of parsing features by leveraging global features from silhouettes, while the PCM aligns the dynamics of human parts between silhouette and parsing features using the high information entropy in parsing sequences. In addition, to effectively guide the alignment of two representations with different granularity at the part level, an elaborate-designed learnable division mechanism is proposed for the parsing features. Finally, comprehensive experiments on two large-scale gait datasets not only show the superior performance of XGait with the Rank-1 accuracy of 80.5% on Gait3D and 88.3% CCPG but also reflect the robustness of the learned features even under challenging conditions like occlusions and cloth changes

Multi-gait identification based on multilinear analysis and multi-target tracking

Gait Recognition Using Multichannel Convolution Neural Networks

Human Identification Based on Gait Manifold

Human Gait Recognition Based on Frame-by-Frame Gait Energy Images and Convolutional Long Short-Term Memory

Human Gait Recognition Based on Self-Adaptive Hidden Markov Model

Non-local Gait Feature Extraction and Human Identification

Studies of dentine and pulp in deep caries.

Cross-view Gait Recognition Through Ensemble Learning

GaitAMR: Cross-view gait recognition via aggregated multi-feature representation

It Takes Two: Accurate Gait Recognition in the Wild Via Cross-granularity Alignment

Human Gait Recognition with Matrix Representation

GMSN: An efficient multi-scale feature extraction network for gait recognition

GaitCTCG: cross-view gait recognition via cascaded residual temporal shift and comprehensive multi-granularity learning

Multi-Task GANs for View-Specific Feature Learning in Gait Recognition

Robust Gait Recognition Via Discriminative Set Matching.

Robust Gait Recognition based on Deep CNNs with Camera and Radar Sensor Fusion

GaitSet: Cross-view Gait Recognition through Utilizing Gait as a Deep Set

GaitMA: Pose-guided Multi-modal Feature Fusion for Gait Recognition

JointsGait:A model-based Gait Recognition Method based on Gait Graph Convolutional Networks and Joints Relationship Pyramid Mapping

Spatiotemporal multi-scale bilateral motion network for gait recognition

Towards Complete-View and High-Level Pose-based Gait Recognition