Abstract:An exoskeleton is a kind of intelligent wearable device with bioelectronics and biomechanics. To realize its effective assistance to the human body, an exoskeleton needs to recognize the real time movement pattern of the human body in order to make corresponding movements at the right time. However, it is of great difficulty for an exoskeleton to fully identify human motion patterns, which are mainly manifested as incomplete acquisition of lower limb motion information, poor feature extraction ability, and complicated steps. Aiming at the above consideration, the motion mechanisms of human lower limbs have been analyzed in this paper, and a set of wearable bioelectronics devices are introduced based on an electromyography (EMG) sensor and inertial measurement unit (IMU), which help to obtain biological and kinematic information of the lower limb. Then, the Dual Stream convolutional neural network (CNN)-ReliefF was presented to extract features from the fusion sensors' data, which were input into four different classifiers to obtain the recognition accuracy of human motion patterns. Compared with a single sensor (EMG or IMU) and single stream CNN or manual designed feature extraction methods, the feature extraction based on Dual Stream CNN-ReliefF shows better performance in terms of visualization performance and recognition accuracy. This method was used to extract features from EMG and IMU data of six subjects and input these features into four different classifiers. The motion pattern recognition accuracy of each subject under the four classifiers is above 97%, with the highest average recognition accuracy reaching 99.12%. It can be concluded that the wearable bioelectronics device and Dual Stream CNN-ReliefF feature extraction method proposed in this paper enhanced an exoskeleton's ability to capture human movement patterns, thus providing optimal assistance to the human body at the appropriate time. Therefore, it can provide a novel approach for improving the human-machine interaction of exoskeletons.

Improvement of an Arm Exoskeleton by Data Fusion with an Inertial Measurement Unit

A Sensor Glove Based on Inertial Measurement Unit for Robot Teleoperetion.

Physical Extraction and Feature Fusion for Multi-Mode Signals in a Measurement System for Patients in Rehabilitation Exoskeleton

A Robust Optical/inertial Data Fusion System for Motion Tracking of the Robot Manipulator

A Sensor Fusion Algorithm: Improving State Estimation Accuracy for a Quadruped Robot Dog

Adaptive Robust Invariant Extended Kalman filtering for Biped Robot.

Improved Estimation of Elbow Flexion Angle from IMU Measurements Using Anatomical Constraints

Improved extended Kalman fusion method for upper limb motion estimation with inertial sensors

Research on the sensing system of lower limb exoskeleton robot based on multi-information fusion

Integration of Inertial Sensors in a Lower Limb Robotic Exoskeleton

Online Identification of Inertial Parameters of a Robot with Partially Combined Links Using IMU Sensing

Sensor Fusion-Based Anthropomorphic Control of a Robotic Arm

Statistical Sensor Fusion of a 9-DoF MEMS IMU for Indoor Navigation

Adaptive Expectation–Maximization-Based Kalman Filter/Finite Impulse Response Filter for MEMS-INS-Based Posture Capture of Human Upper Limbs

Sensor Fusion Based Humanoid Robotic arm Control*

Improved Transfer Learning for Detecting Upper-Limb Movement Intention Using Mechanical Sensors in an Exoskeletal Rehabilitation System

Inertial sensor-based humanoid joint state estimation

Human Motion Pattern Recognition and Feature Extraction: An Approach Using Multi-Information Fusion

Sensor-Movement-Robust Angle Estimation for 3-DoF Lower Limb Joints Without Calibration

Development and Validation of a Data Fusion Algorithm with Low-Cost Inertial Measurement Units to Analyze Shoulder Movements in Manual Workers

Dance Motion Capture Based on Data Fusion Algorithm and Wearable Sensor Network