Abstract:In this study, we proposed a novel human-machine interface (HMI) for robotic manipulator control. The specific target was to adjust the impedance coefficients of the robot controller in real time by measuring the human forearm muscle contractions. We firstly designed a HMI system. Different from the frequently used sEMG technologies, the interface in our study could detect muscle morphological changes within the skin by the electrical impedance tomography (EIT). The sensing front-end was a soft elastic fabric band which was compatible to different arm shapes. With the specific designed sensing hardware and the re-construction algorithms, EIT images indicating forearm muscle shapes were obtained. We then designed a hybrid positon/impedance controller on a UR5 with the impedance coefficients being tuned in real time by the grasp force estimation. A sigmoid regression algorithm was used to map the EIT images to the grasp forces. After implementation of the whole system, two experiments were carried out. The first experiment was the off-line grasp force estimation. With the 1:1 cross validation, an average R 2 of 0.83±0.04 and an average of the relative root mean square error (RRMSE) of 0.31±0.10 across 5 subjects were yielded. The second experiment was the real-time robot control. Trajectory tracking task with dynamic uncertainties were investigated and grasp forces were estimated in real-time. With higher muscle contraction levels, smaller position errors were observed and shorter time was needed to return to the expected trajectory when there were external disturbances. The results proved the feasibility of the new approach on human-robot interaction tasks. Future endeavours will be made to get more promising results.

Human-machine interfaces based on EMG and Kinect applied to teleoperation of a mobile humanoid robot

Development of human-machine interface for teleoperation of a mobile manipulator

The Design and Implementation of Natural Human-Robot Interaction System Based on Kinect Sensor

A Human-Machine Interface Based on an EOG and a Gyroscope for Humanoid Robot Control and Its Application to Home Services.

A Human–robot Interface for Mobile Manipulator

Markerless human-robot interface for dual robot manipulators using Kinect sensor

An sEMG-Based Human–Robot Interface for Robotic Hands Using Machine Learning and Synergies

Toward a Human-Machine Interface Based on Electrical Impedance Tomography for Robotic Manipulator Control.

A Feasibility Study On An Intuitive Teleoperation System Combining Imu With Semg Sensors

A Multi‐Module Sensing and Bi‐Directional HMI Integrating Interaction, Recognition, and Feedback for Intelligent Robots

Human-machine Interaction System Based on Surface EMG Signals

Interface Design of a Human-Robot Interaction System for Dual-Manipulators Teleoperation Based on Virtual Reality *

Kinect-Based Hand Tracking for First-Person-Perspective Robotic Arm Teleoperation

An EMG-Based Robot Control Scheme Robust to Time-Varying EMG Signal Features

Developing a Gesture Based Remote Human-Robot Interaction System Using Kinect

A novel human-robot interface based on low-cost sEMG device designed for the collaborative wearable robot

Human-Machine Interface for Remote Training of Robot Tasks

A Robotic Ultrasound System Controlled by Human Semg Signals

An EEG/EMG/EOG-Based Multimodal Human-Machine Interface to Real-Time Control of a Soft Robot Hand.

An Agile Large-Workspace Teleoperation Interface Based on Human Arm Motion and Force Estimation

Human-Manipulator Interface Using Hybrid Sensors Via CMAC for Dual Robots.