Abstract:Objective.Bimanual humanoid platforms for home assistance are nowadays available, both as academic prototypes and commercially. Although they are usually thought of as daily helpers for non-disabled users, their ability to move around, together with their dexterity, makes them ideal assistive devices for upper-limb disabled persons, too. Indeed, teleoperating a bimanual robotic platform via muscle activation could revolutionize the way stroke survivors, amputees and patients with spinal injuries solve their daily home chores. Moreover, with respect to direct prosthetic control, teleoperation has the advantage of freeing the user from the burden of the prosthesis itself, overpassing several limitations regarding size, weight, or integration, and thus enables a much higher level of functionality.Approach.In this study, nine participants, two of whom suffer from severe upper-limb disabilities, teleoperated a humanoid assistive platform, performing complex bimanual tasks requiring high precision and bilateral arm/hand coordination, simulating home/office chores. A wearable body posture tracker was used for position control of the robotic torso and arms, while interactive machine learning applied to electromyography of the forearms helped the robot to build an increasingly accurate model of the participant's intent over time.Main results.All participants, irrespective of their disability, were uniformly able to perform the demanded tasks. Completion times, subjective evaluation scores, as well as energy- and time- efficiency show improvement over time on short and long term.Significance.This is the first time a hybrid setup, involving myoeletric and inertial measurements, is used by disabled people to teleoperate a bimanual humanoid robot. The proposed setup, taking advantage of interactive machine learning, is simple, non-invasive, and offers a new assistive solution for disabled people in their home environment. Additionnally, it has the potential of being used in several other applications in which fine humanoid robot control is required.

Bimanual Motor Strategies and Handedness Role in Human-Robot Haptic Interaction

Bimanual Motor Strategies and Handedness Role During Human-Exoskeleton Haptic Interaction

Dexterous Manipulation Control of a Bionic Prosthesis in Cooperation with Human Upper Limbs

Bilateral Asymmetry of Hand Force Production in Dynamic Physically-Coupled Tasks

A Bimanual Robotic Teleoperation Architecture with Anthropomorphic Hybrid Grippers for Unstructured Manipulation Tasks

Towards Haptic-Based Dual-Arm Manipulation

Haptic Stiffness Perception Using Hand Exoskeletons in Tactile Robotic Telemanipulation

Exploring Stiffness Modulation in Prosthetic Hands and Its Perceived Function in Manipulation and Social Interaction

Mapping Synergies From Human to Robotic Hands With Dissimilar Kinematics: An Approach in the Object Domain

Age-related Facilitation of Bimanual Finger Behaviors by Haptic Augmentation

Kinematically Constrained Human-like Bimanual Robot-to-Human Handovers

Embodied Manipulation with Past and Future Morphologies through an Open Parametric Hand Design

Learning to teleoperate an upper-limb assistive humanoid robot for bimanual daily-living tasks

Asymmetric Bimanual Control of Dual-Arm Exoskeletons for Human-Cooperative Manipulations

A Robotic System to Deliver Multiple Physically Bimanual Tasks via Varying Force Fields

Handy divisions: Hand-specific specialization of prehensile control in bimanual tasks

Teleoperation Control of an Underactuated Bionic Hand: Comparison between Wearable and Vision-Tracking-Based Methods

Asymmetrical Mass Object Manipulations During Dominant and Non-dominant Precision Grip

The Role of Learning and Kinematic Features in Dexterous Manipulation: A Comparative Study with Two Robotic Hands

Haptic Stimulation for Improving Training of a Motor Imagery BCI Developed for a Hand-Exoskeleton in Rehabilitation

Multimodal Sensing and Interaction for a Robotic Hand Orthosis