Abstract:Recent developments in the non-muscular human-robot interface (HRI) and shared control strategies have shown potential for controlling the assistive robotic arm by people with no residual movement or muscular activity in upper limbs. However, most non-muscular HRIs only produce discrete-valued commands, resulting in non-intuitive and less effective control of the dexterous assistive robotic arm. Furthermore, the user commands and the robot autonomy commands usually switch in the shared control strategies of such applications. This characteristic has been found to yield a reduced sense of agency as well as frustration for the user according to previous user studies. In this study, we firstly propose an intuitive and easy-to-learn-and-use hybrid HRI by combing the Brain-machine interface (BMI) and the gaze-tracking interface. For the proposed hybrid gaze-BMI, the continuous modulation of the movement speed via the motor intention occurs seamlessly and simultaneously to the unconstrained movement direction control with the gaze signals. We then propose a shared control paradigm that always combines user input and the autonomy with the dynamic combination regulation. The proposed hybrid gaze-BMI and shared control paradigm were validated for a robotic arm reaching task performed with healthy subjects. All the users were able to employ the hybrid gaze-BMI for moving the end-effector sequentially to reach the target across the horizontal plane while also avoiding collisions with obstacles. The shared control paradigm maintained as much volitional control as possible, while providing the assistance for the most difficult parts of the task. The presented semi-autonomous robotic system yielded continuous, smooth, and collision-free motion trajectories for the end effector approaching the target. Compared to a system without assistances from robot autonomy, it significantly reduces the rate of failure as well as the time and effort spent by the user to complete the tasks.

Vision-based human–machine interface for a robotic exoskeleton glove designed for patients with brachial plexus injuries

Development and Experimental Evaluation of a Novel Portable Haptic Robotic Exoskeleton Glove System for Patients with Brachial Plexus Injuries

Design, Control, and Experimental Evaluation of A Novel Robotic Glove System for Patients with Brachial Plexus Injuries

EMG-Driven Machine Learning Control of a Soft Glove for Grasping Assistance and Rehabilitation

Control of Newly-Designed Wearable Robotic Hand Exoskeleton Based on Surface Electromyographic Signals

Hand Exoskeleton Design and Human–Machine Interaction Strategies for Rehabilitation

An Attention-Controlled Hand Exoskeleton for the Rehabilitation of Finger Extension and Flexion Using a Rigid-Soft Combined Mechanism

Assist-as-needed Control with a Soft Robotic Glove Based on Human-Object Contact Estimation

A Vision-Driven Collaborative Robotic Grasping System Tele-Operated by Surface Electromyography

Soft Exoskeleton Glove for Hand Assistance Based on Human-machine Interaction and Machine Learning

Semi-Autonomous Robotic Arm Reaching With Hybrid Gaze-Brain Machine Interface

A Multipurpose Human–Machine Interface via 3D-Printed Pressure-Based Force Myography

An EMG-Controlled Robotic Hand Exoskeleton for Bilateral Rehabilitation

Multi-Modal Intent Recognition Method For The Soft Hand Rehabilitation Exoskeleton

Vision-Based Pose Estimation for Robot-Mediated Hand Telerehabilitation

Vision-based interface for grasping intention detection and grip selection : towards intuitive upper-limb assistive devices

An sEMG-Based Human–Robot Interface for Robotic Hands Using Machine Learning and Synergies

Visual Cues to Improve Myoelectric Control of Upper Limb Prostheses

An Exoskeleton System For Hand Rehabilitation Based On Master-Slave Control

A Powered Prosthetic Hand with Vision System for Enhancing the Anthropopathic Grasp

Stretchable Human Machine Interface Based on Smart Glove Embedded With PDMS-CB Strain Sensors