Abstract:Closed-chain manipulation occurs when several robot arms perform tasks in cooperation. It is complex to control a dual-arm system because it requires flexible and adaptable operation ability to realize closed-chain manipulation. In this study, a deep reinforcement learning (DRL) framework based on actor-critic algorithm is proposed to drive the closed-chain manipulation of a dual-arm robotic system. The proposed framework is designed to train dual robot arms to transport a large object cooperatively. In order to sustain strict constraints of closed-chain manipulation, the actor part of the proposed framework is designed in a leader-follower mode. The leader part consists of a policy trained from the DRL algorithm and works on the leader arm. The follower part consists of an inverse kinematics solver based on Damped Least Squares (DLS) and works on the follower arm. Two experiments are designed to prove the task adaptability, one of which is manipulating an object to a random pose within a defined range, the other is manipulating a delicate structural object within a narrow space Note to Practitioners—In common industrial manipulation scenarios, there are requirements to employ robotic arms to transport a large object relative to the robotic arm, e.g., moving a payload onto a loader and assembling big craft parts. It is a cost-effective way to use a dual-arm system to extend the loading capacity of robotic arms while preserving the flexibility of manipulation. Moreover, the dual-arm system is expected to manipulate different objects without complicated reprogramming, especially in small batch production scenarios. This study proposes a task-adaptive deep reinforcement learning framework for dual-arm robot manipulation. The task adaptability includes two specific aspects, one being adaptability in targeting the pose, such as manipulating an object to a random pose within a specified range. The other is the adaptivity on the task prerequisites such as manipulating a delicate structural object within a narrow space. For future research, the dual-arm system may autonomously plan the grab positions, and additional investigations should address more common scenarios involving various object shapes.

A Collaborative Control Method of Dual-Arm Robots Based on Deep Reinforcement Learning

A Collaborative Control Method of Dual-Arm Robots Based on Deep Reinforcement Learning

Mapless Collaborative Navigation for a Multi-Robot System Based on the Deep Reinforcement Learning

Liberating Humanity from Heavy Labor: Dual-Arm Coordination and Teleoperation Control for an Assistive Robot

Path Planning Algorithm for Dual-Arm Robot Based on Depth Deterministic Gradient Strategy Algorithm

Coordinated Control Based on Reinforcement Learning for Dual-Arm Continuum Manipulators in Space Capture Missions

Coordinated Transportation of Dual-arm Robot Based on Deep Reinforcement Learning

Robotic Arm Motion Planning with Autonomous Obstacle Avoidance Based on Deep Reinforcement Learning

Cooperative Control of Multiple AGVs Based on Multi-Agent Reinforcement Learning

Coordinated Motion Planning of Dual-arm Space Robot with Deep Reinforcement Learning

Reinforcement learning of dual-arm cooperation for a mobile manipulator with sequences of dynamical movement primitives

A Task-Adaptive Deep Reinforcement Learning Framework for Dual-Arm Robot Manipulation

A Multitasking-Oriented Robot Arm Motion Planning Scheme Based on Deep Reinforcement Learning and Twin Synchro-Control

Human-robot Force Cooperation Analysis by Deep Reinforcement Learning

Reinforcement Learning Based Shared Control: A Novel Teleoperation Strategy for Robotic

Motion Coordination Of Multiple Robots Based On Deep Reinforcement Learning

A Deep Reinforcement Learning Approach Combined with Model-Based Paradigms for Multiagent Formation Control with Collision Avoidance

Mastering the Complex Assembly Task with a Dual-Arm Robot: A Novel Reinforcement Learning Method

Research on Target Trajectory Planning Method of Humanoid Manipulators Based on Reinforcement Learning.

Cooperative Control for Dual-Arm Robots Based on Improved Dynamic Movement Primitives