Abstract:Gait phase recognition is of great importance in the development of rehabilitation devices. The advantages of Long Short-Term Memory (LSTM) and Convolutional Neural Network (CNN) are combined (LSTM-CNN) in this paper, then a gait phase recognition method based on LSTM-CNN neural network model is proposed. In the LSTM-CNN model, the LSTM layer is used to process temporal sequences and the CNN layer is used to extract features A wireless sensor system including six inertial measurement units (IMU) fixed on the six positions of the lower limbs was developed. The difference in the gait recognition performance of the LSTM-CNN model was estimated using different groups of input data collected by seven different IMU grouping methods. Four phases in a complete gait were considered in this paper including the supporting phase with the right hill strike (SU-RHS), left leg swimming phase (SW-L), the supporting phase with the left hill strike (SU-LHS), and right leg swimming phase (SW-R). The results show that the best performance of the model in gait recognition appeared based on the group of data from all the six IMUs, with the recognition precision and macro-F1 unto 95.03% and 95.29%, respectively. At the same time, the best phase recognition accuracy for SU-RHS and SW-R appeared and up to 96.49% and 95.64%, respectively. The results also showed the best phase recognition accuracy (97.22%) for SW-L was acquired based on the group of data from four IMUs located at the left and right thighs and shanks. Comparably, the best phase recognition accuracy (97.86%) for SU-LHS was acquired based on the group of data from four IMUs located at left and right shanks and feet. Ulteriorly, a novel gait recognition method based on Data Pre-Filtering Long Short-Term Memory and Convolutional Neural Network (DPF-LSTM-CNN) model was proposed and its performance for gait phase recognition was evaluated. The experiment results showed that the recognition accuracy reached 97.21%, which was the highest compared to Deep convolutional neural networks (DCNN) and CNN-LSTM.

IMU-based Locomotion Mode Recognition by Deep Convolutional Neural Networks with Wide First-layer Kernels

Real-Time Onboard Human Motion Recognition Based On Inertial Measurement Units

Multimodal Sensor Motion Intention Recognition Based on Three-Dimensional Convolutional Neural Network Algorithm

Novel Deep Learning Network for Gait Recognition Using Multimodal Inertial Sensors

Gait Recognition Using Multichannel Convolution Neural Networks

IMU Based Deep Stride Length Estimation With Self-Supervised Learning

Construction of Human Digital Twin Model Based on Multimodal Data and Its Application in Locomotion Mode Identification

Deep Gait Tracking With Inertial Measurement Unit

A Strain Gauge Based Locomotion Mode Recognition Method Using Convolutional Neural Network

Research on motion recognition based on multi-dimensional sensing data and deep learning algorithms

Intelligent Fault Diagnosis for Inertial Measurement Unit through Deep Residual Convolutional Neural Network and Short-Time Fourier Transform

Real-Time Continuous Locomotion Mode Recognition and Transition Prediction for Human With Lower Limb Exoskeleton

IMFi: IMU-WiFi based Cross-modal Gait Recognition System with Hot-Deployment

Estimation of Lower Limb Joint Angles and Joint Moments during Different Locomotive Activities Using the Inertial Measurement Units and a Hybrid Deep Learning Model

A Novel Gait Phase Recognition Method Based on DPF-LSTM-CNN Using Wearable Inertial Sensors

An enhanced ResNet deep learning method for multimodal signal-based locomotion intention recognition

A Novel Gait Pattern Recognition Method Based on LSTM-CNN for Lower Limb Exoskeleton

Motion Sequence Recognition with Multi-sensors Using Deep Convolutional Neural Network.

Real-time Recognition of Multi-category Human Motion Using Μimu Data

Classification of Hand Gestures from Wearable IMUs using Deep Neural Network

Human Activity Recognition with Convolutional Neural Netowrks