Abstract:In this study, we proposed a novel human-machine interface (HMI) for robotic manipulator control. The specific target was to adjust the impedance coefficients of the robot controller in real time by measuring the human forearm muscle contractions. We firstly designed a HMI system. Different from the frequently used sEMG technologies, the interface in our study could detect muscle morphological changes within the skin by the electrical impedance tomography (EIT). The sensing front-end was a soft elastic fabric band which was compatible to different arm shapes. With the specific designed sensing hardware and the re-construction algorithms, EIT images indicating forearm muscle shapes were obtained. We then designed a hybrid positon/impedance controller on a UR5 with the impedance coefficients being tuned in real time by the grasp force estimation. A sigmoid regression algorithm was used to map the EIT images to the grasp forces. After implementation of the whole system, two experiments were carried out. The first experiment was the off-line grasp force estimation. With the 1:1 cross validation, an average R 2 of 0.83±0.04 and an average of the relative root mean square error (RRMSE) of 0.31±0.10 across 5 subjects were yielded. The second experiment was the real-time robot control. Trajectory tracking task with dynamic uncertainties were investigated and grasp forces were estimated in real-time. With higher muscle contraction levels, smaller position errors were observed and shorter time was needed to return to the expected trajectory when there were external disturbances. The results proved the feasibility of the new approach on human-robot interaction tasks. Future endeavours will be made to get more promising results.

Human Palpation Behavior Modeling with Mixture Models: Towards Autonomous Robotic Palpation

Human Demonstration Trajectory Refinement for Redundant Manipulators.

Anthropomorphic Reaching Movement Generating Method for Human-Like Upper Limb Robot

Action Augmentation of Tactile Perception for Soft-Body Palpation

MimicTouch: Leveraging Multi-modal Human Tactile Demonstrations for Contact-rich Manipulation

Biologically Inspired Motion Modeling and Neural Control for Robot Learning From Demonstrations

Haptic-ACT: Bridging Human Intuition with Compliant Robotic Manipulation via Immersive VR

Dynamic Modeling of Hand-Object Interactions via Tactile Sensing

Skill Learning in Robot-Assisted Micro-Manipulation Through Human Demonstrations with Attention Guidance

Biomimetic learning of hand gestures in a humanoid robot

Toward a Human-Machine Interface Based on Electrical Impedance Tomography for Robotic Manipulator Control.

IMU Motion Capture Method with Adaptive Tremor Attenuation in Teleoperation Robot System

An Anthropomorphic Motion Retargeting Method Based on an Adaptive Genetic Algorithm

Model-Based Visual Hand Posture Tracking for Guiding A Dexterous Robotic Hand

Motion Similarity Evaluation between Human and a Tri-Co Robot during Real-Time Imitation with a Trajectory Dynamic Time Warping Model

Safe and Individualized Motion Planning for Upper-limb Exoskeleton Robots Using Human Demonstration and Interactive Learning

Reinforcement Learning Based Manipulation Skill Transferring for Robot-assisted Minimally Invasive Surgery.

Human-Manipulator Interface Using Hybrid Sensors Via CMAC for Dual Robots.

BiRP: Learning Robot Generalized Bimanual Coordination using Relative Parameterization Method on Human Demonstration

Natural Gesture Modeling and Recognition Approach Based on Joint Movements and Arm Orientations

Sampling-Based Model Predictive Control for Dexterous Manipulation on a Biomimetic Tendon-Driven Hand