Abstract:Global aging leads to a surge in neurological diseases. Quantitative gait analysis for the early detection of neurological diseases can effectively reduce the impact of the diseases. Recently, extensive research has focused on gait-abnormality-recognition algorithms using a single type of portable sensor. However, these studies are limited by the sensor's type and the task specificity, constraining the widespread application of quantitative gait recognition. In this study, we propose a multimodal gait-abnormality-recognition framework based on a Convolutional Neural Network-Bidirectional Long Short-Term Memory (CNN-BiLSTM) network. The as-established framework effectively addresses the challenges arising from smooth data interference and lengthy time series by employing an adaptive sliding window technique. Then, we convert the time series into time–frequency plots to capture the characteristic variations in different abnormality gaits and achieve a unified representation of the multiple data types. This makes our signal processing method adaptable to several types of sensors. Additionally, we use a pre-trained Deep Convolutional Neural Network (DCNN) for feature extraction, and the consequently established CNN-BiLSTM network can achieve high-accuracy recognition by fusing and classifying the multi-sensor input data. To validate the proposed method, we conducted diversified experiments to recognize the gait abnormalities caused by different neuropathic diseases, such as amyotrophic lateral sclerosis (ALS), Parkinson's disease (PD), and Huntington's disease (HD). In the PDgait dataset, the framework achieved an accuracy of 98.89% in the classification of Parkinson's disease severity, surpassing DCLSTM's 96.71%. Moreover, the recognition accuracy of ALS, PD, and HD on the PDgait dataset was 100%, 96.97%, and 95.43% respectively, surpassing the majority of previously reported methods. These experimental results strongly demonstrate the potential of the proposed multimodal framework for gait abnormality identification. Due to the advantages of the framework, such as its suitability for different types of sensors and fewer training parameters, it is more suitable for gait monitoring in daily life and the customization of medical rehabilitation schedules, which will help more patients alleviate the harm caused by their diseases.

EMG-based Abnormal Gait Detection and Recognition

Gait Phase Recognition of Lower Limb Based on GA Optimized BP Neural Network

Ankle Foot Motion Recognition Based on Wireless Wearable Semg and Acceleration Sensors for Smart AFO

Abnormal Gait Recognition Algorithm Based on LSTM-CNN Fusion Network

Deep Learning based Gait Abnormality Detection using Wearable Sensor System

Cross-Subject and Cross-Modal Transfer for Generalized Abnormal Gait Pattern Recognition

Human Gait Recognition Based on Self-Adaptive Hidden Markov Model

Analysis and Recognition of Human Lower Limb Motions Based on Electromyography (EMG) Signals

A Low-Cost End-to-End Semg-Based Gait Sub-Phase Recognition System.

Prediction of Lower Limb Action Intention Based on Surface EMG Signal

Human Gait Recognition Based on Frame-by-Frame Gait Energy Images and Convolutional Long Short-Term Memory

In-home Gait Abnormality Detection through Footstep-Induced Floor Vibration Sensing and Person-Invariant Contrastive Learning

Classification of anomalous gait using Machine Learning techniques and embedded sensors

Multimodal Gait Abnormality Recognition Using a Convolutional Neural Network–Bidirectional Long Short-Term Memory (CNN-BiLSTM) Network Based on Multi-Sensor Data Fusion

Machine Learning Based Abnormal Gait Classification with IMU Considering Joint Impairment

Effective Gait Abnormality Detection in Parkinson's Patients for Multi-Sensors Surveillance System

A Recurrent Deep Network for Gait Phase Identification from EMG Signals During Exoskeleton-Assisted Walking

Human Posture Detection Method Based on Wearable Devices

An Advanced Technique for the Detection of Pathological Gaits from Electromyography Signals: A Comprehensive Approach

Detection of Gait Abnormalities caused by Neurological Disorders

Evaluation of Three Machine Learning Algorithms for the Automatic Classification of EMG Patterns in Gait Disorders