Abstract:This paper addresses the problem of feature encoding for gait analysis using multimodal time series sensory data. In recent years, the dramatic increase in the use of numerous sensors, e.g., inertial measurement unit (IMU), in our daily wearable devices has gained the interest of the research community to collect kinematic and kinetic data to analyze the gait. The most crucial step for gait analysis is to find the set of appropriate features from continuous time series data to accurately represent human locomotion. This paper presents a systematic assessment of numerous feature extraction techniques. In particular, three different feature encoding techniques are presented to encode multimodal time series sensory data. In the first technique, we utilized eighteen different handcrafted features which are extracted directly from the raw sensory data. The second technique follows the Bag-of-Visual-Words model; the raw sensory data are encoded using a pre-computed codebook and a locality-constrained linear encoding (LLC)-based feature encoding technique. We evaluated two different machine learning algorithms to assess the effectiveness of the proposed features in the encoding of raw sensory data. In the third feature encoding technique, we proposed two end-to-end deep learning models to automatically extract the features from raw sensory data. A thorough experimental evaluation is conducted on four large sensory datasets and their outcomes are compared. A comparison of the recognition results with current state-of-the-art methods demonstrates the computational efficiency and high efficacy of the proposed feature encoding method. The robustness of the proposed feature encoding technique is also evaluated to recognize human daily activities. Additionally, this paper also presents a new dataset consisting of the gait patterns of 42 individuals, gathered using IMU sensors.

A frequency domain analysis based gait feature representation

A novel gait recognition method via fusing shape and kinematics features

A Novel Human Gait Recognition Method by Segmenting and Extracting the Region Variance Feature

Gait recognition based on the Fast Fourier Transform and SVM

Gait recognition via independent component analysis based on support vector machine and neural network

Gait Representation and Recognition Using Haar Wavelet and Radon Transform

Human Gait Signal Analysis Using Time-Frequency Distribution with Complex-Lag

Model-based Gait Representation Via Spatial Point Reconstruction

A Method for Human Gait Recognition Using Spatial-Temporal Analysis

Human Gait Recognition Based on X-T Plane Energy Images

Human Gait Recognition by Integrating Motion Feature and Shape Feature

Effective Gait Feature Extraction Using Temporal Fusion and Spatial Partial.

Walking pattern discrimination based on wavelet and fractal analysis

Human Gait Recognition Based on Frontal-View Walking Sequences Using Multi-modal Feature Representations and Learning

Gait Recognition Based on Gabor Wavelet and Local Binary Pattern

A Systematic Evaluation of Feature Encoding Techniques for Gait Analysis Using Multimodal Sensory Data

Gabor-Based Discriminative Common Vectors for Gait Recognition

Automated Classification of Gait Patterns Based on Time-Frequency Analysis

Progressive Spatio-Temporal Feature Extraction Model for Gait Recognition

Gait Recognition by Fitting Moment Invariants

Fast communication: Gait recognition based on dynamic region analysis