Abstract:Global aging leads to a surge in neurological diseases. Quantitative gait analysis for the early detection of neurological diseases can effectively reduce the impact of the diseases. Recently, extensive research has focused on gait-abnormality-recognition algorithms using a single type of portable sensor. However, these studies are limited by the sensor's type and the task specificity, constraining the widespread application of quantitative gait recognition. In this study, we propose a multimodal gait-abnormality-recognition framework based on a Convolutional Neural Network-Bidirectional Long Short-Term Memory (CNN-BiLSTM) network. The as-established framework effectively addresses the challenges arising from smooth data interference and lengthy time series by employing an adaptive sliding window technique. Then, we convert the time series into time–frequency plots to capture the characteristic variations in different abnormality gaits and achieve a unified representation of the multiple data types. This makes our signal processing method adaptable to several types of sensors. Additionally, we use a pre-trained Deep Convolutional Neural Network (DCNN) for feature extraction, and the consequently established CNN-BiLSTM network can achieve high-accuracy recognition by fusing and classifying the multi-sensor input data. To validate the proposed method, we conducted diversified experiments to recognize the gait abnormalities caused by different neuropathic diseases, such as amyotrophic lateral sclerosis (ALS), Parkinson's disease (PD), and Huntington's disease (HD). In the PDgait dataset, the framework achieved an accuracy of 98.89% in the classification of Parkinson's disease severity, surpassing DCLSTM's 96.71%. Moreover, the recognition accuracy of ALS, PD, and HD on the PDgait dataset was 100%, 96.97%, and 95.43% respectively, surpassing the majority of previously reported methods. These experimental results strongly demonstrate the potential of the proposed multimodal framework for gait abnormality identification. Due to the advantages of the framework, such as its suitability for different types of sensors and fewer training parameters, it is more suitable for gait monitoring in daily life and the customization of medical rehabilitation schedules, which will help more patients alleviate the harm caused by their diseases.

Classification of Neurodegenerative Diseases Based on CNN and LSTM

Classification of Abnormal Gait Based on Improved Two-Stream CNN

Neural Networks for Pathological Gait Classification Using Wearable Motion Sensors

Early Diagnosis of Alzheimer's Disease Using Deep Learning

CNN‐Based Neurodegenerative Disease Classification Using QR‐Represented Gait Data

Multimodal Gait Abnormality Recognition Using a Convolutional Neural Network–Bidirectional Long Short-Term Memory (CNN-BiLSTM) Network Based on Multi-Sensor Data Fusion

An efficient ranking-based ensembled multiclassifier for neurodegenerative diseases classification using deep learning

Alzheimer's Disease Classification With a Cascade Neural Network

A data science approach for reliable classification of neuro-degenerative diseases using gait patterns

Classification of Neurological Gait Disorders Using Multi-task Feature Learning

Assessment of Parkinson's Motor Severity by Multi-feature and Multi-scale Motion Convolutional Neural Network with Positional Encoding

Late feature fusion using neural network with voting classifier for Parkinson's disease detection

Comparative Analysis of the Classification Performance of Machine Learning Classifiers and Deep Neural Network Classifier for Prediction of Parkinson Disease

Diagnosis and classification of Alzheimer's disease by using a convolution neural network algorithm

A novel hybrid ensemble based Alzheimer's identification system using deep learning technique

Integrative Deep Learning Framework for Parkinson's Disease Early Detection using Gait Cycle Data Measured by Wearable Sensors: A CNN-GRU-GNN Approach

Multimodal Gait Recognition for Neurodegenerative Diseases

EMG Signal Classification for Neuromuscular Disorders with Attention-Enhanced CNN

Classification of Alzheimer's Disease Using the Convolutional Neural Network (CNN) with Transfer Learning and Weighted Loss

Detecting Parkinson's disease from shoe-mounted accelerometer sensors using convolutional neural networks optimized with modified metaheuristics

Development of a Neurodegenerative Disease Gait Classification Algorithm Using Multiscale Sample Entropy and Machine Learning Classifiers