Abstract:Global aging leads to a surge in neurological diseases. Quantitative gait analysis for the early detection of neurological diseases can effectively reduce the impact of the diseases. Recently, extensive research has focused on gait-abnormality-recognition algorithms using a single type of portable sensor. However, these studies are limited by the sensor's type and the task specificity, constraining the widespread application of quantitative gait recognition. In this study, we propose a multimodal gait-abnormality-recognition framework based on a Convolutional Neural Network-Bidirectional Long Short-Term Memory (CNN-BiLSTM) network. The as-established framework effectively addresses the challenges arising from smooth data interference and lengthy time series by employing an adaptive sliding window technique. Then, we convert the time series into time–frequency plots to capture the characteristic variations in different abnormality gaits and achieve a unified representation of the multiple data types. This makes our signal processing method adaptable to several types of sensors. Additionally, we use a pre-trained Deep Convolutional Neural Network (DCNN) for feature extraction, and the consequently established CNN-BiLSTM network can achieve high-accuracy recognition by fusing and classifying the multi-sensor input data. To validate the proposed method, we conducted diversified experiments to recognize the gait abnormalities caused by different neuropathic diseases, such as amyotrophic lateral sclerosis (ALS), Parkinson's disease (PD), and Huntington's disease (HD). In the PDgait dataset, the framework achieved an accuracy of 98.89% in the classification of Parkinson's disease severity, surpassing DCLSTM's 96.71%. Moreover, the recognition accuracy of ALS, PD, and HD on the PDgait dataset was 100%, 96.97%, and 95.43% respectively, surpassing the majority of previously reported methods. These experimental results strongly demonstrate the potential of the proposed multimodal framework for gait abnormality identification. Due to the advantages of the framework, such as its suitability for different types of sensors and fewer training parameters, it is more suitable for gait monitoring in daily life and the customization of medical rehabilitation schedules, which will help more patients alleviate the harm caused by their diseases.

Classification of Abnormal Gait Based on Improved Two-Stream CNN

Abnormal Gait Recognition Algorithm Based on LSTM-CNN Fusion Network

Multimodal Gait Abnormality Recognition Using a Convolutional Neural Network–Bidirectional Long Short-Term Memory (CNN-BiLSTM) Network Based on Multi-Sensor Data Fusion

Gait Phase Recognition of Lower Limb Based on GA Optimized BP Neural Network

Neural Networks for Pathological Gait Classification Using Wearable Motion Sensors

Gait Recognition Using Multichannel Convolution Neural Networks

Classification of Gait Anomalies from Kinect

Classification of Neurological Gait Disorders Using Multi-task Feature Learning

Skeleton-based abnormal gait recognition with spatio-temporal attention enhanced gait-structural graph convolutional networks

Scalogram-Based Gait Abnormalities Classification Using Deep Convolutional Networks for Neurological and Non-Neurological Disorders

Benchmarking Reliability of Deep Learning Models for Pathological Gait Classification

Classification of Neurodegenerative Diseases Based on CNN and LSTM

GaitRec-Net: A Deep Neural Network for Gait Disorder Detection Using Ground Reaction Force

Gait Recognition based on Two-Stream CNNs with Multisensor Progressive Feature Fusion

Gait Classification and Identity Authentication Using CNN

Assessing gait dysfunction severity in Parkinson's Disease using 2-Stream Spatial-Temporal Neural Network

Machine Learning Based Abnormal Gait Classification with IMU Considering Joint Impairment

Detection of Gait Abnormalities caused by Neurological Disorders

FP-GCN: Frequency Pyramid Graph Convolutional Network for Enhancing Pathological Gait Classification

Cross-Subject and Cross-Modal Transfer for Generalized Abnormal Gait Pattern Recognition

Evaluation of Three Machine Learning Algorithms for the Automatic Classification of EMG Patterns in Gait Disorders