Abstract:Gait, as one of unique biometric features, has the advantage of being recognized from a long distance away, can be widely used in public security. Considering 3D pose estimation is more challenging than 2D pose estimation in practice , we research on using 2D joints to recognize gait in this paper, and a new model-based gait recognition method JointsGait is put forward to extract gait information from 2D human body joints. Appearance-based gait recognition algorithms are prevalent before. However, appearance features suffer from external factors which can cause drastic appearance variations, e.g. clothing. Unlike previous approaches, JointsGait firstly extracted spatio-temporal features from 2D joints using gait graph convolutional networks, which are less interfered by external factors. Secondly, Joints Relationship Pyramid Mapping (JRPM) are proposed to map spatio-temporal gait features into a discriminative feature space with biological advantages according to the relationship of human joints when people are walking at various scales. Finally, we design a fusion loss strategy to help the joints features to be insensitive to cross-view. Our method is evaluated on two large datasets, Kinect Gait Biometry Dataset and CASIA-B. On Kinect Gait Biometry Dataset database, JointsGait only uses corresponding 2D coordinates of joints, but achieves satisfactory recognition accuracy compared with those model-based algorithms using 3D joints. On CASIA-B database, the proposed method greatly outperforms advanced model-based methods in all walking conditions, even performs superior to state-of-art appearance-based methods when clothing seriously affect people's appearance. The experimental results demonstrate that JointsGait achieves the state-of-art performance despite the low dimensional feature (2D body joints) and is less affected by the view variations and clothing variation.

Gait Recognition on Features Fusion Using Kinect

GaitMA: Pose-guided Multi-modal Feature Fusion for Gait Recognition

3D Gait Recognition Based on a CNN-LSTM Network with the Fusion of SkeGEI and DA Features

Gait Recognition Via Multiple Features and Views Information Fusion

Learning Rich Features for Gait Recognition by Integrating Skeletons and Silhouettes

A Multi-Stage Adaptive Feature Fusion Neural Network for Multimodal Gait Recognition

Gait recognition based on 3D human body reconstruction and multi-granular feature fusion

Gait Recognition Using Multichannel Convolution Neural Networks

JointsGait:A model-based Gait Recognition Method based on Gait Graph Convolutional Networks and Joints Relationship Pyramid Mapping

Gait Recognition Using Optical Motion Capture: A Decision Fusion Based Method

Fusion of Spatial-Temporal and Kinematic Features for Gait Recognition with Deterministic Learning.

Human Gait Phases Recognition Based on Multi-Source Data Fusion and BILSTM Attention Neural Network

Gait Recognition Based on 3D Skeleton Data and Graph Convolutional Network

Human Gait Recognition Based on Frame-by-Frame Gait Energy Images and Convolutional Long Short-Term Memory

Non-local Gait Feature Extraction and Human Identification

TriGait: Aligning and Fusing Skeleton and Silhouette Gait Data via a Tri-Branch Network

Frontal-view Human Gait Recognition Based on Kinect Features and Deterministic Learning

AdaptiveGait: adaptive feature fusion network for gait recognition

GaitFFDA: Feature Fusion and Dual Attention Gait Recognition Model

Human Gait Recognition by Integrating Motion Feature and Shape Feature

Human Gait Recognition Based on Deterministic Learning and Kinect Sensor