Abstract:When a multi-fingered dexterous hand interacts with the external environment, it encounters various challenges, including the utilization of complex control techniques and the intricate coordination of finger motion sequences. Previous studies have primarily concentrated on investigating the interaction between multi-fingered dexterous hands and external objects, usually using model-based control or model-free reinforcement learning techniques. However, during practical implementation, various constraining factors are encountered, such as intricate modeling and limited interaction capabilities. In practical scenarios, the utilization of multi-fingered dexterous hands is imperative for the swift and efficient execution of a wide range of interactive tasks, including but not limited to throwing a ball and playing rock-paper-scissors. These tasks require skilled manual dexterity to demonstrate both precise control and quick responsiveness. To tackle this issue, we propose a hierarchical control approach for multi-fingered dexterous hands with interactive functionalities, utilizing model-free deep reinforcement learning. The complex interaction task is decomposed into simple sub-tasks using hierarchical strategy and action primitive decomposition, which effectively reduces the complexity of the action space, and achieves the motion planning and end finger trajectory control of dexterous hand. In a simulated environment, the aforementioned method has successfully executed interactive tasks, including ball throwing and playing rock-paper-scissors. It achieved a maximum normalized reward of 0.83 and an 84 % success rate. These results are noteworthy in terms of both control accuracy and response speed. This study offers novel insights into the effective resolution of the intricate challenges associated with interactions involving multi-fingered dexterous hands and human-computer interaction.

Dexterous Manipulation with Deep Reinforcement Learning: Efficient, General, and Low-Cost

DexRepNet: Learning Dexterous Robotic Grasping Network with Geometric and Spatial Hand-Object Representations

Dexterous Manipulation from Images: Autonomous Real-World RL via Substep Guidance

Towards Human-Level Bimanual Dexterous Manipulation with Reinforcement Learning

Bi-DexHands: Towards Human-Level Bimanual Dexterous Manipulation

Precise and Dexterous Robotic Manipulation via Human-in-the-Loop Reinforcement Learning

Deep Dynamics Models for Learning Dexterous Manipulation

A High-Efficient Reinforcement Learning Approach for Dexterous Manipulation

Dexterous Manipulation for Multi-Fingered Robotic Hands With Reinforcement Learning: A Review

Learning dexterous in-hand manipulation

Data-efficient Deep Reinforcement Learning for Dexterous Manipulation

Learning Deep Visuomotor Policies for Dexterous Hand Manipulation

Dexterous In-Hand Manipulation of Slender Cylindrical Objects through Deep Reinforcement Learning with Tactile Sensing

Dexterous Imitation Made Easy: A Learning-Based Framework for Efficient Dexterous Manipulation

REBOOT: Reuse Data for Bootstrapping Efficient Real-World Dexterous Manipulation

Dextrous Tactile In-Hand Manipulation Using a Modular Reinforcement Learning Architecture

The Ingredients of Real-World Robotic Reinforcement Learning

Interactive learning for multi-finger dexterous hand: A model-free hierarchical deep reinforcement learning approach

Benchmarking Reinforcement Learning Methods for Dexterous Robotic Manipulation with a Three-Fingered Gripper

Learning a Universal Human Prior for Dexterous Manipulation from Human Preference