Abstract:Real-time continuous locomotion mode recognition and seamless timely transition detection is critical for the exoskeleton robot. This study aims to present a comprehensive and innovative framework for locomotion mode recognition and transition prediction, exclusively utilizing inertial measurement unit (IMU) signals from the exoskeleton. In this framework, a CNN-BiLSTM model was developed and trained to be the classifier and a novel majority filter was designed to reduce the transition misjudgment rate. Moreover, a comprehensive evaluation system encompassing eight dimensions for the classifier, incorporating evaluation metrics specifically for transition misjudgment, was proposed. We collected locomotion motion data from six subjects wearing a rigid exoskeleton robot using six IMU sensors on the exoskeleton. The proposed method achieves a high level of recognition accuracy, with an overall average of 99.58% for the five steady locomotion modes (level ground walking (LG), stair ascent/descent (SA/SD), and ramp ascent/descent (RA/RD)) across six subjects following the transition decision. All transitions are recognizable, and the majority can be predicted in advance, with an average prediction time of 353ms. Furthermore, the implementation of majority filter resulted in an average 87.04% reduction in the transition misjudgment rate among six subjects, thereby decreasing the average transition misjudgment rate to 4.82%. Finally, the model was tested on a Jetson Nano to verify its real-time performance. The results presented above were obtained under the condition where either leg could function as the first transition leg and revealed that the developed system was capable of achieving precise locomotion mode recognition and timely transition prediction, with high real-time performance.

On the Design of a Wearable Multi-sensor System for Recognizing Motion Modes and Sit-to-stand Transition

A Wearable Capacitive Sensing System with Phase-Dependent Classifier for Locomotion Mode Recognition

A Wearable Multi-sensor System for Classification of Multiple System Atrophy and Parkinson's Disease

A Locomotion Intent Prediction System Based on Multi-Sensor Fusion.

A Gait Recognition System for Interaction with a Homecare Mobile Robot

Locomotion mode classification using a wearable capacitive sensing system.

Real-Time Onboard Human Motion Recognition Based On Inertial Measurement Units

On-board Training Strategy for IMU-Based Real-Time Locomotion Recognition of Transtibial Amputees with Robotic Prostheses

Wearable Surface Deformation Myography (sDMG) System for Recognition of Locomotion Modes

A Foot-Wearable Interface for Locomotion Mode Recognition Based on Discrete Contact Force Distribution

Multi-class SVM Based Real-Time Recognition of Sit-to-Stand and Stand-to-Sit Transitions for a Bionic Knee Exoskeleton in Transparent Mode.

Recognizing Sit-Stand and Stand-Sit Transitions for a Bionic Knee Exoskeleton

Inertial sensors-based torso motion mode recognition for an active postural support brace*

Locomotion Mode Recognition with Inertial Signals for Hip Joint Exoskeleton

BPNN-Based Real-Time Recognition of Locomotion Modes for an Active Pelvis Orthosis with Different Assistive Strategies

Real-Time Continuous Locomotion Mode Recognition and Transition Prediction for Human With Lower Limb Exoskeleton

An Automatic Labeling Strategy for Locomotion Mode Recognition with Robotic Transtibial Prosthesis

Recognizing Continuous Multiple Degrees of Freedom Foot Movements with Inertial Sensors.

Non-contact capacitance sensing for continuous locomotion mode recognition: design specifications and experiments with an amputee

Real-time Onboard SVM-based Human Locomotion Recognition for a Bionic Knee Exoskeleton on Different Terrains

Real-Time Hybrid Locomotion Mode Recognition for Lower Limb Wearable Robots