Collaborative Bimanual Manipulation Using Optimal Motion Adaptation and Interaction Control

Ruoshi Wen,Quentin Rouxel,Michael Mistry,Zhibin Li,Carlo Tiseo

DOI: https://doi.org/10.1109/MRA.2023.3270222

2023-07-18

Abstract:This work developed collaborative bimanual manipulation for reliable and safe human-robot collaboration, which allows remote and local human operators to work interactively for bimanual tasks. We proposed an optimal motion adaptation to retarget arbitrary commands from multiple human operators into feasible control references. The collaborative manipulation framework has three main modules: (1) contact force modulation for compliant physical interactions with objects via admittance control; (2) task-space sequential equilibrium and inverse kinematics optimization, which adapts interactive commands from multiple operators to feasible motions by satisfying the task constraints and physical limits of the robots; and (3) an interaction controller adopted from the fractal impedance control, which is robust to time delay and stable to superimpose multiple control efforts for generating desired joint torques and controlling the dual-arm robots. Extensive experiments demonstrated the capability of the collaborative bimanual framework, including (1) dual-arm teleoperation that adapts arbitrary infeasible commands that violate joint torque limits into continuous operations within safe boundaries, compared to failures without the proposed optimization; (2) robust maneuver of a stack of objects via physical interactions in presence of model inaccuracy; (3) collaborative multi-operator part assembly, and teleoperated industrial connector insertion, which validate the guaranteed stability of reliable human-robot co-manipulation.

Robotics

What problem does this paper attempt to address?

This paper aims to address several key issues in human-robot collaborative dual-arm manipulation, specifically including: 1. **Reliable and Safe Human-Robot Collaborative Dual-Arm Manipulation Framework**: An optimized motion adaptation framework (Task-Space SEIKO) is proposed, which can convert arbitrary commands from multiple operators into feasible control references that comply with the physical limitations and task constraints of the robot. This allows remote and local operators to interactively complete dual-arm tasks. 2. **Contact Force Regulation and Interaction Control**: The contact force is adjusted through an impedance controller to make the physical interaction between the object and the two end-effectors more compliant. Additionally, an interaction controller based on Fractal Impedance Control (FIC) is employed, which can stably superimpose multiple control signals in the presence of time delays to generate the required joint torques, thereby controlling the dual-arm robot. 3. **Multi-Operator Collaborative Assembly Experiment Verification**: The capabilities of the framework are demonstrated through extensive experiments, including dual-arm teleoperation, robust manipulation of stacked objects, and tasks such as inserting industrial connectors, proving the stability of the method in reliable human-robot co-operation. In summary, this research aims to develop an efficient and safe collaborative dual-arm manipulation framework to overcome the complex motion planning challenges in dual-arm tasks, integrating the flexibility of human operators with the high load capacity of robots, thereby enhancing the overall intelligence level of the system.

Collaborative Bimanual Manipulation Using Optimal Motion Adaptation and Interaction Control

Robust Kinematic Calibration for Improving Collaboration Accuracy of Dual-Arm Manipulators with Experimental Validation

Liberating Humanity from Heavy Labor: Dual-Arm Coordination and Teleoperation Control for an Assistive Robot

Dexterous Manipulation Control of a Bionic Prosthesis in Cooperation with Human Upper Limbs

A Safe Shared-Control Framework for Dual-Arm Collaborative Telemanipulation.

A Bimanual Robotic Teleoperation Architecture with Anthropomorphic Hybrid Grippers for Unstructured Manipulation Tasks

Unified Contact Model and Hybrid Motion/force Control for Teleoperated Manipulation in Unknown Environments

Human–Robot Shared Control Based on Locally Weighted Intent Prediction for a Teleoperated Hydraulic Manipulator System

Human-Manipulator Interface Using Hybrid Sensors Via CMAC for Dual Robots.

Enabling Versatility and Dexterity of the Dual-Arm Manipulators: A General Framework Toward Universal Cooperative Manipulation

Beyond End-Effector: Utilizing High-Resolution Tactile Signals for Physical Human–Robot Interaction

Robust Shared Control With Stable Contact Servoing for Enhanced Object Transportation by Telerobotic Bimanual Mobile Manipulators

Asymmetric Bimanual Control of Dual-Arm Exoskeletons for Human-Cooperative Manipulations

Asymmetric Cooperation Control of Dual-Arm Exoskeletons Using Human Collaborative Manipulation Models

A Shared Autonomy Reconfigurable Control Framework for Telemanipulation of Multi-arm Systems

Collaborative Framework for Robot-Assisted Minimally Invasive Surgery Using a 7-Dof Anthropomorphic Robot

Adaptive Coordinated Motion Constraint Control for Cooperative Multi-Manipulator Systems

Adaptive Robust Control for Bimanual Cooperative Contact Teleoperation with Relative Jacobian Matrix

Dual Arm Co-Manipulation Architecture with Enhanced Human-Robot Communication for Large Part Manipulation

Internet of Things (Iot)-Based Collaborative Control of a Redundant Manipulator for Teleoperated Minimally Invasive Surgeries

Multi-Interaction Control for Manipulators in Unknown Environments Based on Hybrid Position-Impedance-Force Control