Abstract:Closed-chain manipulation occurs when several robot arms perform tasks in cooperation. It is complex to control a dual-arm system because it requires flexible and adaptable operation ability to realize closed-chain manipulation. In this study, a deep reinforcement learning (DRL) framework based on actor-critic algorithm is proposed to drive the closed-chain manipulation of a dual-arm robotic system. The proposed framework is designed to train dual robot arms to transport a large object cooperatively. In order to sustain strict constraints of closed-chain manipulation, the actor part of the proposed framework is designed in a leader-follower mode. The leader part consists of a policy trained from the DRL algorithm and works on the leader arm. The follower part consists of an inverse kinematics solver based on Damped Least Squares (DLS) and works on the follower arm. Two experiments are designed to prove the task adaptability, one of which is manipulating an object to a random pose within a defined range, the other is manipulating a delicate structural object within a narrow space Note to Practitioners—In common industrial manipulation scenarios, there are requirements to employ robotic arms to transport a large object relative to the robotic arm, e.g., moving a payload onto a loader and assembling big craft parts. It is a cost-effective way to use a dual-arm system to extend the loading capacity of robotic arms while preserving the flexibility of manipulation. Moreover, the dual-arm system is expected to manipulate different objects without complicated reprogramming, especially in small batch production scenarios. This study proposes a task-adaptive deep reinforcement learning framework for dual-arm robot manipulation. The task adaptability includes two specific aspects, one being adaptability in targeting the pose, such as manipulating an object to a random pose within a specified range. The other is the adaptivity on the task prerequisites such as manipulating a delicate structural object within a narrow space. For future research, the dual-arm system may autonomously plan the grab positions, and additional investigations should address more common scenarios involving various object shapes.

A Novel Meta Control Framework for Robot Arm Reaching with Changeable Configuration

Meta-Reinforcement Learning of Hierarchical Fault-Tolerant Controller for Multiple Leg Failures in Hexapod Robots

Variable Force Tracking Control Via Online Learning

Unified Motion/Force/Impedance Control for Manipulators in Unknown Contact Environments Based on Robust Model-Reaching Approach

Robot Arm Configuration Self-Awareness Via Interacting with Environment

Meta-Control: Automatic Model-based Control Synthesis for Heterogeneous Robot Skills

OCCAM: Online Continuous Controller Adaptation with Meta-Learned Models

Active Admittance Control with Iterative Learning for General-Purpose Contact-Rich Manipulation

A Novel Dual-Arm Adaptive Cooperative Control Framework for Carrying Variable Loads and Active Anti-Overturning

Robot Arm Reaching Based on Inner Rehearsal

Agile Mobility with Rapid Online Adaptation via Meta-learning and Uncertainty-aware MPPI

A Task-Adaptive Deep Reinforcement Learning Framework for Dual-Arm Robot Manipulation

Learning Based Adaptive Force Control of Robotic Manipulation Based on Real-Time Object Stiffness Detection

An End-to-End Differentiable Framework for Contact-Aware Robot Design

Learning compliant grasping and manipulation by teleoperation with adaptive force control

Adaptive Contact-Implicit Model Predictive Control with Online Residual Learning

Adaptive Environment-Aware Robotic Arm Reaching Based on a Bio-Inspired Neurodynamical Computational Framework

Unified Mapping Function-Based Neuroadaptive Control of Constrained Uncertain Robotic Systems

Locally Weighted Learning Robot Control With Improved Parameter Convergence

Arm-Constrained Curriculum Learning for Loco-Manipulation of the Wheel-Legged Robot

Model-free control framework for multi-limb soft robots