Abstract:Robotic manipulators are widely used in modern manufacturing processes. However, their deployment in unstructured environments remains an open problem. To deal with the variety, complexity, and uncertainty of real-world manipulation tasks, it is essential to develop a flexible framework with reduced assumptions on the environment characteristics. In recent years, reinforcement learning (RL) has shown great results for single-arm robotic manipulation. However, research focusing on dual-arm manipulation is still rare. From a classical control perspective, solving such tasks often involves complex modeling of interactions between two manipulators and the objects encountered in the tasks, as well as the two robots coupling at a control level. Instead, in this work, we explore the applicability of model-free RL to dual-arm assembly. As we aim to contribute toward an approach that is not limited to dual-arm assembly but dual-arm manipulation in general, we keep modeling efforts at a minimum. Hence, to avoid modeling the interaction between the two robots and the used assembly tools, we present a modular approach with two decentralized single-arm controllers, which are coupled using a single centralized learned policy. We reduce modeling effort to a minimum by using sparse rewards only. Our architecture enables successful assembly and simple transfer from simulation to the real world. We demonstrate the effectiveness of the framework on dual-arm peg-in-hole and analyze sample efficiency and success rates for different action spaces. Moreover, we compare results on different clearances and showcase disturbance recovery and robustness when dealing with position uncertainties. Finally, we zero-shot transfer policies trained in simulation to the real world and evaluate their performance. Videos of the experiments are available at the project website ( https://sites.google.com/view/dual-arm-assembly/home ).

Learning Multi-Arm Manipulation Through Collaborative Teleoperation

Learning Robust Skills for Tightly Coordinated Arms in Contact-Rich Tasks

Error-Aware Imitation Learning from Teleoperation Data for Mobile Manipulation

Human-in-the-Loop Imitation Learning using Remote Teleoperation

Robust and High-Precision End-to-End Control Policy for Multi-stage Manipulation Task with Behavioral Cloning.

Human-Agent Joint Learning for Efficient Robot Manipulation Skill Acquisition

From One Hand to Multiple Hands: Imitation Learning for Dexterous Manipulation From Single-Camera Teleoperation

A Shared Autonomy Reconfigurable Control Framework for Telemanipulation of Multi-arm Systems

Leveraging the Efficiency of Multi-Task Robot Manipulation Via Task-Evoked Planner and Reinforcement Learning

Learning to Centralize Dual-Arm Assembly

A Multi-Agent Approach for Adaptive Finger Cooperation in Learning-based In-Hand Manipulation

Concept2Robot: Learning Manipulation Concepts from Instructions and Human Demonstrations

TeleMoMa: A Modular and Versatile Teleoperation System for Mobile Manipulation

Polybot: Training One Policy Across Robots While Embracing Variability

Vision-Based Multi-Task Manipulation for Inexpensive Robots Using End-To-End Learning from Demonstration

MimicTouch: Leveraging Multi-modal Human Tactile Demonstrations for Contact-rich Manipulation

Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robots

Enabling Versatility and Dexterity of the Dual-Arm Manipulators: A General Framework Toward Universal Cooperative Manipulation

Collaborative Bimanual Manipulation Using Optimal Motion Adaptation and Interaction Control

Experimental Assessment of Human-Robot Teaming for Multi-Step Remote Manipulation with Expert Operators

Enabling Multi-Robot Collaboration from Single-Human Guidance