Abstract:Gait recognition, as an attractive task in biometrics, remains challenging due to significant intra-class changes of clothing and pose variations across different cameras. Recent approaches mainly focus on silhouette-based gait mode, which is easy to model in Convolutional Neural Networks (CNNs). Compared with silhouettes, the dynamics of skeletons essentially convey more robust information, which is invariant to view and clothing changes. Conventional approaches for modeling skeletons usually rely on handcrafted features or traversal rules, thus resulting in limited expressive power and difficulties of generalization. In this work, we address the skeleton-based gait recognition task with a novel Symmetry-Driven Hyper Feature Graph Convolutional Network (SDHF-GCN), which goes beyond the limitations of previous approaches by automatically learning multiple dynamic patterns and hierarchical semantic features in a unified Graph Convolutional Network (GCN). This model involves three dynamic patterns: natural connection, temporal correlation and symmetric interaction, which enriches the description of dynamic patterns by exploiting symmetry perceptual principles. Furthermore, a hyper feature network is proposed to aggregate the hierarchical semantic features, including dynamic features at the high level, structured features at the intermediate level, and static features at the low level, which complement each other to enhance the discriminative ability. By integrating different patterns in the hierarchical structure, the model is able to generate versatile and discriminative representations, thus improving the recognition rate. On the CASIA-B and OUMVLP-Pose datasets, the proposed SDHF-GCN renders substantial improvements over mainstream methods, especially in the coat-wearing scenario, with superior robustness to covariate factors. (c) 2022 Elsevier Ltd. All rights reserved.

AST-GCN: Augmented Spatial Temporal Graph Convolutional Neural Network for Gait Emotion Recognition

G-GCSN: Global Graph Convolution Shrinkage Network for Emotion Perception from Gait

A Multi-Head Pseudo Nodes Based Spatial–temporal Graph Convolutional Network for Emotion Perception from GAIT

TT-GCN: Temporal-Tightly Graph Convolutional Network for Emotion Recognition from Gaits

Gait-based Emotion Recognition Using Spatial Temporal Graph Convolutional Networks

Looking into Gait for Perceiving Emotions via Bilateral Posture and Movement Graph Convolutional Networks

Multi-task Learning for Gait-Based Identity Recognition and Emotion Recognition Using Attention Enhanced Temporal Graph Convolutional Network.

Skeleton-based abnormal gait recognition with spatio-temporal attention enhanced gait-structural graph convolutional networks

Spatiotemporal smoothing aggregation enhanced multi-scale residual deep graph convolutional networks for skeleton-based gait recognition

Hierarchical-Attention-Based Neural Network for Gait Emotion Recognition

Condition-Adaptive Graph Convolution Learning for Skeleton-Based Gait Recognition

STEP: Spatial Temporal Graph Convolutional Networks for Emotion Perception from Gaits

Two Feature Fusion Network Based on Efficient Deep Residual Shrinkage Spatial-Temporal Graph Convolution for Emotion Recognition from Gaits

Symmetry-Driven Hyper Feature GCN for Skeleton-Based Gait Recognition

Multi-scale Spatio-Temporal Network for Skeleton-Based Gait Recognition.

ST-Gait++: Leveraging spatio-temporal convolutions for gait-based emotion recognition on videos

Gait Recognition Algorithm Based on Spatial-temporal Graph Neural Network

Dynamic Semantic-Based Spatial-Temporal Graph Convolution Network for Skeleton-Based Human Action Recognition

Spatial and temporal attention embedded spatial temporal graph convolutional networks for skeleton based gait recognition with multiple IMUs

Enhanced Spatial and Extended Temporal Graph Convolutional Network for Skeleton-Based Action Recognition

An improved spatial temporal graph convolutional network for robust skeleton-based action recognition