Abstract:Global aging leads to a surge in neurological diseases. Quantitative gait analysis for the early detection of neurological diseases can effectively reduce the impact of the diseases. Recently, extensive research has focused on gait-abnormality-recognition algorithms using a single type of portable sensor. However, these studies are limited by the sensor's type and the task specificity, constraining the widespread application of quantitative gait recognition. In this study, we propose a multimodal gait-abnormality-recognition framework based on a Convolutional Neural Network-Bidirectional Long Short-Term Memory (CNN-BiLSTM) network. The as-established framework effectively addresses the challenges arising from smooth data interference and lengthy time series by employing an adaptive sliding window technique. Then, we convert the time series into time–frequency plots to capture the characteristic variations in different abnormality gaits and achieve a unified representation of the multiple data types. This makes our signal processing method adaptable to several types of sensors. Additionally, we use a pre-trained Deep Convolutional Neural Network (DCNN) for feature extraction, and the consequently established CNN-BiLSTM network can achieve high-accuracy recognition by fusing and classifying the multi-sensor input data. To validate the proposed method, we conducted diversified experiments to recognize the gait abnormalities caused by different neuropathic diseases, such as amyotrophic lateral sclerosis (ALS), Parkinson's disease (PD), and Huntington's disease (HD). In the PDgait dataset, the framework achieved an accuracy of 98.89% in the classification of Parkinson's disease severity, surpassing DCLSTM's 96.71%. Moreover, the recognition accuracy of ALS, PD, and HD on the PDgait dataset was 100%, 96.97%, and 95.43% respectively, surpassing the majority of previously reported methods. These experimental results strongly demonstrate the potential of the proposed multimodal framework for gait abnormality identification. Due to the advantages of the framework, such as its suitability for different types of sensors and fewer training parameters, it is more suitable for gait monitoring in daily life and the customization of medical rehabilitation schedules, which will help more patients alleviate the harm caused by their diseases.

Wavelet-based Multi-branch Convolutional Neural Network for Cross-individual ALS Disease Identification with EMG Signal.

Selective Ensemble Learning for Cross-Muscle ALS Disease Identification with EMG Signal.

Omics Feature Learning for Cross Individual ALS Disease Identification with EMG Signal

Domain Contrast Network for Cross-Muscle ALS Disease Identification with EMG Signal

EMG Signal Classification for Neuromuscular Disorders with Attention-Enhanced CNN

ResEMGNet: A Lightweight Residual Deep Learning Architecture for Neuromuscular Disorder Detection from Raw EMG Signals

Gesture Classification in Electromyography Signals for Real-Time Prosthetic Hand Control Using a Convolutional Neural Network-Enhanced Channel Attention Model

An Ensemble of Long Short-Term Memory Networks with an Attention Mechanism for Upper Limb Electromyography Signal Classification

Multiple-feature-branch Convolutional Neural Network for Myocardial Infarction Diagnosis Using Electrocardiogram

EMG SIGNAL CLASSIFICATION FOR NEUROMUSCULAR DISORDERS DIAGNOSIS USING TQWT AND BAGGING

EMG gesture signal analysis towards diagnosis of upper limb using dual-pathway convolutional neural network

Electromyography Signal Classification Using Deep Learning

Multi-kernel Convolutional Neural Network for Wrist Pulse Signal Classification

Multimodal Gait Abnormality Recognition Using a Convolutional Neural Network–Bidirectional Long Short-Term Memory (CNN-BiLSTM) Network Based on Multi-Sensor Data Fusion

Decoding Simultaneous Multi-DOF Wrist Movements From Raw EMG Signals Using a Convolutional Neural Network

Classification of multichannel surface-electromyography signals based on convolutional neural networks

A Multi-Task Group Bi-LSTM Networks Application on Electrocardiogram Classification

A Joint SSA and CNN Algorithm to Remove EMG Artifacts from Single Channel EEG

A Compact Multi-Branch 1D Convolutional Neural Network for EEG-based Motor Imagery Classification

Multiple Sclerosis Detection via Wavelet Entropy and Feedforward Neural Network Trained by Adaptive Genetic Algorithm

Fine-Grained and Multiple Classification for Alzheimer's Disease With Wavelet Convolution Unit Network