Abstract:In this study, we proposed a novel human-machine interface (HMI) for robotic manipulator control. The specific target was to adjust the impedance coefficients of the robot controller in real time by measuring the human forearm muscle contractions. We firstly designed a HMI system. Different from the frequently used sEMG technologies, the interface in our study could detect muscle morphological changes within the skin by the electrical impedance tomography (EIT). The sensing front-end was a soft elastic fabric band which was compatible to different arm shapes. With the specific designed sensing hardware and the re-construction algorithms, EIT images indicating forearm muscle shapes were obtained. We then designed a hybrid positon/impedance controller on a UR5 with the impedance coefficients being tuned in real time by the grasp force estimation. A sigmoid regression algorithm was used to map the EIT images to the grasp forces. After implementation of the whole system, two experiments were carried out. The first experiment was the off-line grasp force estimation. With the 1:1 cross validation, an average R 2 of 0.83±0.04 and an average of the relative root mean square error (RRMSE) of 0.31±0.10 across 5 subjects were yielded. The second experiment was the real-time robot control. Trajectory tracking task with dynamic uncertainties were investigated and grasp forces were estimated in real-time. With higher muscle contraction levels, smaller position errors were observed and shorter time was needed to return to the expected trajectory when there were external disturbances. The results proved the feasibility of the new approach on human-robot interaction tasks. Future endeavours will be made to get more promising results.

A Feasibility Study On An Intuitive Teleoperation System Combining Imu With Semg Sensors

A Sensor Glove Based on Inertial Measurement Unit for Robot Teleoperetion.

An sEMG-Based Human–Robot Interface for Robotic Hands Using Machine Learning and Synergies

An Agile Large-Workspace Teleoperation Interface Based on Human Arm Motion and Force Estimation

IMU Motion Capture Method with Adaptive Tremor Attenuation in Teleoperation Robot System

An IMUs and potentiometer-based controller for robotic arm-hand teleoperation

Robotic Teleoperation Systems Using a Wearable Multimodal Fusion Device

A Robotic Teleoperation System for Precise Robotic Manipulation by Human-Machine Interaction

Toward a Human-Machine Interface Based on Electrical Impedance Tomography for Robotic Manipulator Control.

Aging in vitro. Effect of low dose rate irradiation on the division potential of chick embryonic fibroblasts.

A Multi‐Module Sensing and Bi‐Directional HMI Integrating Interaction, Recognition, and Feedback for Intelligent Robots

Synchronized Control of Robotic Arm based on Virtual Reality and IMU Sensing

Combining haptics and inertial motion capture to enhance remote control of a dual-arm robot

Robotic telemanipulation with EMG-driven strategy-assisted shared control method

A novel human-robot interface based on low-cost sEMG device designed for the collaborative wearable robot

Seamless Robot Teleoperation: Intuitive Control Through Hand Gestures and Neural Network Decoding

EMG-Controlled Non-Anthropomorphic Hand Teleoperation Using a Continuous Teleoperation Subspace

Human-Manipulator Interface Using Hybrid Sensors Via CMAC for Dual Robots.

Non-invasive Human-machine Interface (HMI) Systems with Hybrid On-body Sensors for Controlling Upper-limb Prosthesis: A Review

A Wearable Upper Limb Exoskeleton for Intuitive Teleoperation of Anthropomorphic Manipulators

A Mobile Robot Hand-Arm Teleoperation System by Vision and IMU