Abstract:In the lower limb exoskeleton assistance system, motion intention understanding based on biological signals is the human–computer interface's (HMIs) key technology. Due to the close coupling of human and machine, wheelchair-type control modes (combination of motion intentions and switches of different actions) are not applicable. For example, the right-/left-hand motor imagery (MI) controls the exoskeleton to move forward/stop. There is a mismatch between MI-based control instructions and actual actions because the forward process alternates between left and right. Therefore, this study aims to design a reasonable HMI for a lower limb exoskeleton assistance system and to prove its rationality and effectiveness. We have designed a new HMI combining the human walking process and multimodal biosignals. Experimental data were collected from 14 subjects. We use feature-based and end-to-end analysis methods to analyze multimode signals. In a feature-based analysis, the advantage of using surface electromyographic (sEMG) to distinguish between different movements does not apply to distinguishing different magnitudes of the same movement. A time-frequency subband selection method based on difference patterns is designed for electroencephalogram (EEG) signals in the feature-based analysis. The fusion of EEG and sEMG is implemented to complement each other. The average recognition rate of the multimodal HMI was evaluated to be up to 89.5%, which is 12% and 7.8% higher than that of EEG and sEMG, respectively. Based on end-to-end analysis, a time-domain (TD) translation strategy was used to expand the sample and obtain a cross-subject identification rate of 83.6%. All the results indicate that the designed HMI is rational and effective, and there exists potential for practical application.

A Brain-Inspired Decision-Making Method for Upper Limb Exoskeleton Based on Multi-Brain-Region Structure and Multimodal Information Fusion

Research on Control Method of Upper Limb Exoskeleton Based on Mixed Perception Model.

Design of Exoskeleton Brain-Like Intelligent Trajectory Prediction Model Based on Echo State Network

A Brain-Machine Interface Based on ERD/ERS for an Upper-Limb Exoskeleton Control

A Novel Fatigue Detection Method for Rehabilitation Training of Upper Limb Exoskeleton Robot Using Multi-Information Fusion

Bionic Control of Exoskeleton Robot Based on Motion Intention for Rehabilitation Training.

Motion intensity modeling and trajectory control of upper limb rehabilitation exoskeleton robot based on multi-modal information

A Novel Multimodal Human-Exoskeleton Interface Based on EEG and Semg Activity for Rehabilitation Training.

Channel Synergy-based Human-Robot Interface for a Lower Limb Walking Assistance Exoskeleton

Multimodal Human-Exoskeleton Interface for Lower Limb Movement Prediction Through a Dense Co-Attention Symmetric Mechanism.

A New EEG-based Paradigm for Classifying Intention of Compound-Limbs Movement

An Assistive System for Upper Limb Motion Combining Functional Electrical Stimulation and Robotic Exoskeleton

The Human–Machine Interface Design Based on sEMG and Motor Imagery EEG for Lower Limb Exoskeleton Assistance System

Research on Multimodal Fusion Recognition Method of Upper Limb Motion Patterns

Adaptive Neural Control of a Kinematically Redundant Exoskeleton Robot Using Brain–Machine Interfaces

A Brain-Controlled Lower-Limb Exoskeleton for Human Gait Training.

Neuro-Mechanical Synergy: A Smart Idea of Intelligent Exoskeletons for Stroke Rehabilitation

Motion Estimation for the Control of Upper Limb Wearable Exoskeleton Robot with Electroencephalography Signals.

Control of Upper-Limb Power-Assist Exoskeleton Based on Motion Intention Recognition.

Human-robot Cooperative Control Based on Semg for the Upper Limb Exoskeleton Robot

EMG-Based Continuous and Simultaneous Estimation of Arm Kinematics in Able-Bodied Individuals and Stroke Survivors