Abstract:Closed-chain manipulation occurs when several robot arms perform tasks in cooperation. It is complex to control a dual-arm system because it requires flexible and adaptable operation ability to realize closed-chain manipulation. In this study, a deep reinforcement learning (DRL) framework based on actor-critic algorithm is proposed to drive the closed-chain manipulation of a dual-arm robotic system. The proposed framework is designed to train dual robot arms to transport a large object cooperatively. In order to sustain strict constraints of closed-chain manipulation, the actor part of the proposed framework is designed in a leader-follower mode. The leader part consists of a policy trained from the DRL algorithm and works on the leader arm. The follower part consists of an inverse kinematics solver based on Damped Least Squares (DLS) and works on the follower arm. Two experiments are designed to prove the task adaptability, one of which is manipulating an object to a random pose within a defined range, the other is manipulating a delicate structural object within a narrow space Note to Practitioners—In common industrial manipulation scenarios, there are requirements to employ robotic arms to transport a large object relative to the robotic arm, e.g., moving a payload onto a loader and assembling big craft parts. It is a cost-effective way to use a dual-arm system to extend the loading capacity of robotic arms while preserving the flexibility of manipulation. Moreover, the dual-arm system is expected to manipulate different objects without complicated reprogramming, especially in small batch production scenarios. This study proposes a task-adaptive deep reinforcement learning framework for dual-arm robot manipulation. The task adaptability includes two specific aspects, one being adaptability in targeting the pose, such as manipulating an object to a random pose within a specified range. The other is the adaptivity on the task prerequisites such as manipulating a delicate structural object within a narrow space. For future research, the dual-arm system may autonomously plan the grab positions, and additional investigations should address more common scenarios involving various object shapes.

A Robotic Manipulation Framework for Industrial Human–robot Collaboration Based on Continual Knowledge Graph Embedding

A Human-Robot Collaboration System for Object Handover

Hierarchical Understanding in Robotic Manipulation: A Knowledge-Based Framework

A Complementary Framework for Human-Robot Collaboration with a Mixed AR-Haptic Interface

A Universal Self-Adaption Workspace Mapping Method for Human–Robot Interaction Using Kinect Sensor Data

Semantic Representation of Robot Manipulation with Knowledge Graph

Semantic-based Loco-Manipulation for Human-Robot Collaboration in Industrial Environments

A novel task-oriented framework for dual-arm robotic assembly task

An Object Attribute Guided Framework for Robot Learning Manipulations from Human Demonstration Videos

Learning Task-Oriented Dexterous Grasping from Human Knowledge

A Task-Adaptive Deep Reinforcement Learning Framework for Dual-Arm Robot Manipulation

Skill Learning Framework for Human-Robot Interaction and Manipulation Tasks

Framework of knowledge management for human–robot collaborative mold assembly using heterogeneous cobots

Learning Human-to-Robot Dexterous Handovers for Anthropomorphic Hand

Skill Manipulation Method of Industrial Robot Based on Knowledge Graph for Assembly Scene

Collaborative Bimanual Manipulation Using Optimal Motion Adaptation and Interaction Control

Closed-Loop Robotic Arm Manipulation Based on Mixed Reality

Proactive Robot Control for Collaborative Manipulation Using Human Intent

Proactive Human-Robot Co-Assembly: Leveraging Human Intention Prediction and Robust Safe Control

Extended Reality for Enhanced Human-Robot Collaboration: a Human-in-the-Loop Approach

FABRIC: A Framework for the Design and Evaluation of Collaborative Robots with Extended Human Adaptation