Abstract:Gait is a unique biometric feature that can be recognized at a distance; thus, it has broad applications in crime prevention, forensic identification, and social security. To portray a gait, existing gait recognition methods utilize either a gait template which makes it difficult to preserve temporal information, or a gait sequence that maintains unnecessary sequential constraints and thus loses the flexibility of gait recognition. In this paper, we present a novel perspective that utilizes gait as a deep set, which means that a set of gait frames are integrated by a global-local fused deep network inspired by the way our left- and right-hemisphere processes information to learn information that can be used in identification. Based on this deep set perspective, our method is immune to frame permutations, and can naturally integrate frames from different videos that have been acquired under different scenarios, such as diverse viewing angles, different clothes, or different item-carrying conditions. Experiments show that under normal walking conditions, our single-model method achieves an average rank-1 accuracy of 96.1 percent on the CASIA-B gait dataset and an accuracy of 87.9 percent on the OU-MVLP gait dataset. Under various complex scenarios, our model also exhibits a high level of robustness. It achieves accuracies of 90.8 and 70.3 percent on CASIA-B under bag-carrying and coat-wearing walking conditions respectively, significantly outperforming the best existing methods. Moreover, the proposed method maintains a satisfactory accuracy even when only small numbers of frames are available in the test samples; for example, it achieves 85.0 percent on CASIA-B even when using only 7 frames. The source code has been released at https://github.com/AbnerHqC/GaitSet.

Multi-View Gait Identification Based on Stacked Sparse Auto-Encoders

Cross-view Gait Recognition Through Ensemble Learning

Human Gait Recognition Based on Frame-by-Frame Gait Energy Images and Convolutional Long Short-Term Memory

View Invariant Gait Recognition Using Only One Uniform Model

Multi-view Multi-Stance Gait Identification

Gait Recognition Using Multichannel Convolution Neural Networks

Multi-view Gait Recognition Using NMF and 2DLDA

Decomposing Identity and View for Cross-View Gait Recognition

Causal Intervention for Sparse-View Gait Recognition

Multi-View Pedestrian Recognition Using Shared Dictionary Learning with Group Sparsity

Multi-view Gait Recognition Based on Tensor Analysis

GaitSet: Cross-view Gait Recognition through Utilizing Gait as a Deep Set

Dense-View GEIs Set: View Space Covering for Gait Recognition based on Dense-View GAN

Invariant Feature Extraction for Gait Recognition Using Only One Uniform Model.

End-to-end Model-based Gait Recognition Using Synchronized Multi-view Pose Constraint

Cross-View Gait Recognition with Short Probe Sequences: from View Transformation Model to View-Independent Stance-Independent Identity Vector.

Multi-view Gait Recognition with Joint Local Multi-Scale and Global Contextual Spatio-Temporal Features

Multi-View Gait Image Generation for Cross-View Gait Recognition

Cross-View Gait Identification with Embedded Learning

A General Tensor Representation Framework for Cross-View Gait Recognition

Multi-Task GANs for View-Specific Feature Learning in Gait Recognition