Abstract:The performance of human gait recognition (HGR) is affected by the partial obstruction of the human body caused by the limited field of view in video surveillance. The traditional method required the bounding box to recognize human gait in the video sequences accurately; however, it is a challenging and time-consuming approach. Due to important applications, such as biometrics and video surveillance, HGR has improved performance over the last half-decade. Based on the literature, the challenging covariant factors that degrade gait recognition performance include walking while wearing a coat or carrying a bag. This paper proposed a new two-stream deep learning framework for human gait recognition. The first step proposed a contrast enhancement technique based on the local and global filters information fusion. The high-boost operation is finally applied to highlight the human region in a video frame. Data augmentation is performed in the second step to increase the dimension of the preprocessed dataset (CASIA-B). In the third step, two pre-trained deep learning models—MobilenetV2 and ShuffleNet—are fine-tuned and trained on the augmented dataset using deep transfer learning. Features are extracted from the global average pooling layer instead of the fully connected layer. In the fourth step, extracted features of both streams are fused using a serial-based approach and further refined in the fifth step by using an improved equilibrium state optimization-controlled Newton–Raphson (ESOcNR) selection method. The selected features are finally classified using machine learning algorithms for the final classification accuracy. The experimental process was conducted on 8 angles of the CASIA-B dataset and obtained an accuracy of 97.3, 98.6, 97.7, 96.5, 92.9, 93.7, 94.7, and 91.2%, respectively. Comparisons were conducted with state-of-the-art (SOTA) techniques, and showed improved accuracy and reduced computational time.

Human Gait Recognition Using Bag of Words Feature Representation Method

Accelerometer-based Gait Recognition Via Voting by Signature Points

Video2mmPoint: Synthesizing Mmwave Point Cloud Data from Videos for Gait Recognition

Human Gait Recognition Based on Self-Adaptive Hidden Markov Model

Non-local Gait Feature Extraction and Human Identification

Human Gait Recognition Based on Frame-by-Frame Gait Energy Images and Convolutional Long Short-Term Memory

Human Gait Recognition by Integrating Motion Feature and Shape Feature

Gait Recognition Using Multichannel Convolution Neural Networks

Human Identification Based on Gait Manifold

Multi-level features fusion and selection for human gait recognition: an optimized framework of Bayesian model and binomial distribution

Human Gait Recognition by using Two Stream Neural Network along with Spatial and Temporal Features

Human Gait Recognition using Machine Learning Teachnolgies for Inclusive Innovation

Human Gait Recognition with Matrix Representation

Gait recognition using wavelet descriptors and independent component analysis

Gait recognition via independent component analysis based on support vector machine and neural network

DeepGait: A Learning Deep Convolutional Representation for View-Invariant Gait Recognition Using Joint Bayesian

Pose-based Deep Gait Recognition

A Fusion-Assisted Multi-Stream Deep Learning and ESO-Controlled Newton–Raphson-Based Feature Selection Approach for Human Gait Recognition

Human Gait Recognition Based on Frontal-View Walking Sequences Using Multi-modal Feature Representations and Learning

Gait Recognition for Human Identification Based on Ica and Fuzzy Svm Through Multiple Views Fusion

DeepGait: A Learning Deep Convolutional Representation for Gait Recognition