Abstract:Achieving human-level dexterity in robotics remains a critical open problem. Even simple dexterous manipulation tasks pose significant difficulties due to the high number of degrees of freedom and the need for cooperation among heterogeneous agents (e.g., finger joints). While some researchers have utilized reinforcement learning (RL) to control a single hand in manipulating objects, tasks that require coordinated bimanual cooperation are still under-explored due to the fewer suitable environments, which can result in difficulties and sub-optimal performance. To address these challenges, we introduce Bi-DexHands, a simulator with two dexterous hands featuring 20 bimanual manipulation tasks and thousands of target objects, designed to match various levels of human motor skills based on cognitive science research. We developed Bi-DexHands in Issac Gym, enabling highly efficient RL training at over 30,000 frames per second using a single NVIDIA RTX 3090. Based on Bi-DexHands, we present a comprehensive evaluation of popular RL algorithms in different settings, including single-agent/multi-agent RL, offline RL, multi-task RL, and meta RL. Our findings show that on-policy algorithms, such as PPO, can master simple manipulation tasks that correspond to those of 48-month-old babies, such as catching a flying object or opening a bottle. Furthermore, multi-agent RL can improve the ability to perform manipulations that require skilled bimanual cooperation, such as lifting a pot or stacking blocks. Despite achieving success in individual tasks, current RL algorithms struggle to learn multiple manipulation skills in most multi-task and few-shot learning scenarios. This highlights the need for further research and development within the RL community.

Two-Layer Attention Optimization for Bimanual Coordination

Learning Robust Skills for Tightly Coordinated Arms in Contact-Rich Tasks

A Haptic Shared Control Architecture for Tracking of a Moving Object.

Adaptive Optimal Control For Coordination In Physical Human-Robot Interaction

Disentangled Attention As Intrinsic Regularization for Bimanual Multi-Object Manipulation

DAIR: Disentangled Attention Intrinsic Regularization for Safe and Efficient Bimanual Manipulation

Stabilize to Act: Learning to Coordinate for Bimanual Manipulation

Human Movement Compensation Control for Supernumerary Limb in Overhead Support Task: A Non-Cooperative Game Theory Approach

Direction-Constrained Control for Efficient Physical Human-Robot Interaction under Hierarchical Tasks

Extended Control with Hybrid Gaze-BCI for Multi-Robot System under Hands-occupied Dual-tasking

Bi-DexHands: Towards Human-Level Bimanual Dexterous Manipulation

Asymmetric Bimanual Control of Dual-Arm Exoskeletons for Human-Cooperative Manipulations

Intelligent Middle-Level Game Control

Human-Agent Coordination in Games under Incomplete Information via Multi-Step Intent

A Semi-Autonomous Hierarchical Control Framework for Prosthetic Hands Inspired by Dual Streams of Human

Bi-Touch: Bimanual Tactile Manipulation With Sim-to-Real Deep Reinforcement Learning

Contact-Implicit Model Predictive Control for Dexterous In-hand Manipulation: A Long-Horizon and Robust Approach

Decentralized approximated optimal control for modular robot manipulations with physical human–robot interaction: a cooperative game-based strategy

Complementarity-Free Multi-Contact Modeling and Optimization for Dexterous Manipulation

InterACT: Inter-dependency Aware Action Chunking with Hierarchical Attention Transformers for Bimanual Manipulation

Human-Manipulator Interface Using Hybrid Sensors Via CMAC for Dual Robots.