Abstract:Gait recognition is one of the important research directions of biometric authentication technology. However, in practical applications, the original gait data is often short, and a long and complete gait video is required for successful recognition. Also, the gait images from different views have a great influence on the recognition effect. To address the above problems, we designed a gait data generation network for expanding the cross-view image data required for gait recognition, which provides sufficient data input for feature extraction branching with gait silhouette as the criterion. In addition, we propose a gait motion feature extraction network based on regional time-series coding. By independently time-series coding the joint motion data within different regions of the body, and then combining the time-series data features of each region with secondary coding, we obtain the unique motion relationships between regions of the body. Finally, bilinear matrix decomposition pooling is used to fuse spatial silhouette features and motion time-series features to obtain complete gait recognition under shorter time-length video input. We use the OUMVLP-Pose and CASIA-B datasets to validate the silhouette image branching and motion time-series branching, respectively, and employ evaluation metrics such as IS entropy value and Rank-1 accuracy to demonstrate the effectiveness of our design network. Finally, we also collect gait-motion data in the real world and test them in a complete two-branch fusion network. The experimental results show that the network we designed can effectively extract the time-series features of human motion and achieve the expansion of multi-view gait data. The real-world tests also prove that our designed method has good results and feasibility in the problem of gait recognition with short-time video as input data.

Sequential Convolutional Network for Behavioral Pattern Extraction in Gait Recognition

Gait Recognition Using Multichannel Convolution Neural Networks

Human Gait Recognition Based on Frame-by-Frame Gait Energy Images and Convolutional Long Short-Term Memory

Gait Recognition with Multiple-Temporal-Scale 3D Convolutional Neural Network

Spatiotemporal multi-scale bilateral motion network for gait recognition

Novel Deep Learning Network for Gait Recognition Using Multimodal Inertial Sensors

GaitCTCG: cross-view gait recognition via cascaded residual temporal shift and comprehensive multi-granularity learning

Multi-scale Spatio-Temporal Network for Skeleton-Based Gait Recognition.

On Learning Disentangled Representations for Gait Recognition

Gait Feature Learning Via Spatio-Temporal Two-Branch Networks

Regional Time-Series Coding Network and Multi-View Image Generation Network for Short-Time Gait Recognition

3D Gait Recognition Based on a CNN-LSTM Network with the Fusion of SkeGEI and DA Features

Two-branch 3D Convolution Neural Network for Gait Recognition.

3D Local Convolutional Neural Networks for Gait Recognition.

Gait Identification by Joint Spatial-Temporal Feature.

Siamese Neural Network Based Gait Recognition For Human Identification

Gait Recognition by Jointing Transformer and CNN

Multi-Scale Temporal Information Extractor for Gait Recognition.

Multiscale Temporal Network for Video-Based Gait Recognition.

Gait Lateral Network: Learning Discriminative and Compact Representations for Gait Recognition

LFN: Based on the Convolutional Neural Network of Gait Recognition Method