Abstract:Gait recognition, as an attractive task in biometrics, remains challenging due to significant intra-class changes of clothing and pose variations across different cameras. Recent approaches mainly focus on silhouette-based gait mode, which is easy to model in Convolutional Neural Networks (CNNs). Compared with silhouettes, the dynamics of skeletons essentially convey more robust information, which is invariant to view and clothing changes. Conventional approaches for modeling skeletons usually rely on handcrafted features or traversal rules, thus resulting in limited expressive power and difficulties of generalization. In this work, we address the skeleton-based gait recognition task with a novel Symmetry-Driven Hyper Feature Graph Convolutional Network (SDHF-GCN), which goes beyond the limitations of previous approaches by automatically learning multiple dynamic patterns and hierarchical semantic features in a unified Graph Convolutional Network (GCN). This model involves three dynamic patterns: natural connection, temporal correlation and symmetric interaction, which enriches the description of dynamic patterns by exploiting symmetry perceptual principles. Furthermore, a hyper feature network is proposed to aggregate the hierarchical semantic features, including dynamic features at the high level, structured features at the intermediate level, and static features at the low level, which complement each other to enhance the discriminative ability. By integrating different patterns in the hierarchical structure, the model is able to generate versatile and discriminative representations, thus improving the recognition rate. On the CASIA-B and OUMVLP-Pose datasets, the proposed SDHF-GCN renders substantial improvements over mainstream methods, especially in the coat-wearing scenario, with superior robustness to covariate factors. (c) 2022 Elsevier Ltd. All rights reserved.

Combining the Silhouette and Skeleton Data for Gait Recognition

Combining the Silhouette and Skeleton Data for Gait Recognition

Hybrid Silhouette-skeleton Body Representation for Gait Recognition

Gait Recognition Based on 3D Skeleton Data and Graph Convolutional Network

Gait Recognition Using Multichannel Convolution Neural Networks

TriGait: Aligning and Fusing Skeleton and Silhouette Gait Data via a Tri-Branch Network

Learning Rich Features for Gait Recognition by Integrating Skeletons and Silhouettes

A novel gait recognition method via fusing shape and kinematics features

Symmetry-Driven Hyper Feature GCN for Skeleton-Based Gait Recognition

Gait Recognition Based on Local Graphical Skeleton Descriptor with Pairwise Similarity Network.

Gait Pyramid Attention Network: Toward Silhouette Semantic Relation Learning for Gait Recognition

Cross-view Gait Recognition Through Ensemble Learning

Human Gait Recognition Based on Frame-by-Frame Gait Energy Images and Convolutional Long Short-Term Memory

GaitMA: Pose-guided Multi-modal Feature Fusion for Gait Recognition

SkeletonGait: Gait Recognition Using Skeleton Maps

Gait‐D: Skeleton‐based Gait Feature Decomposition for Gait Recognition

Different gait combinations based on multi-modal deep CNN architectures

Robust gait recognition using hybrid descriptors based on Skeleton Gait Energy Image

GaitSTR: Gait Recognition with Sequential Two-stream Refinement

Multi-scale Spatio-Temporal Network for Skeleton-Based Gait Recognition.

Gait Lateral Network: Learning Discriminative and Compact Representations for Gait Recognition