Abstract:When a multi-fingered dexterous hand interacts with the external environment, it encounters various challenges, including the utilization of complex control techniques and the intricate coordination of finger motion sequences. Previous studies have primarily concentrated on investigating the interaction between multi-fingered dexterous hands and external objects, usually using model-based control or model-free reinforcement learning techniques. However, during practical implementation, various constraining factors are encountered, such as intricate modeling and limited interaction capabilities. In practical scenarios, the utilization of multi-fingered dexterous hands is imperative for the swift and efficient execution of a wide range of interactive tasks, including but not limited to throwing a ball and playing rock-paper-scissors. These tasks require skilled manual dexterity to demonstrate both precise control and quick responsiveness. To tackle this issue, we propose a hierarchical control approach for multi-fingered dexterous hands with interactive functionalities, utilizing model-free deep reinforcement learning. The complex interaction task is decomposed into simple sub-tasks using hierarchical strategy and action primitive decomposition, which effectively reduces the complexity of the action space, and achieves the motion planning and end finger trajectory control of dexterous hand. In a simulated environment, the aforementioned method has successfully executed interactive tasks, including ball throwing and playing rock-paper-scissors. It achieved a maximum normalized reward of 0.83 and an 84 % success rate. These results are noteworthy in terms of both control accuracy and response speed. This study offers novel insights into the effective resolution of the intricate challenges associated with interactions involving multi-fingered dexterous hands and human-computer interaction.

Within-Hand Manipulation with an Underactuated Dexterous Hand Based on Pre-Trained Reinforcement Learning

DexRepNet: Learning Dexterous Robotic Grasping Network with Geometric and Spatial Hand-Object Representations

Dexterous Manipulation for Multi-Fingered Robotic Hands With Reinforcement Learning: A Review

A High-Efficient Reinforcement Learning Approach for Dexterous Manipulation

Dexterous Manipulation Based on Prior Dexterous Grasp Pose Knowledge

Dexterous Manipulation with Deep Reinforcement Learning: Efficient, General, and Low-Cost

Dexterous In-Hand Manipulation of Slender Cylindrical Objects through Deep Reinforcement Learning with Tactile Sensing

Learning Dexterous Manipulation Policies from Experience and Imitation

Learning Deep Visuomotor Policies for Dexterous Hand Manipulation

Towards Human-Level Bimanual Dexterous Manipulation with Reinforcement Learning

Interactive learning for multi-finger dexterous hand: A model-free hierarchical deep reinforcement learning approach

Contact-Implicit Model Predictive Control for Dexterous In-hand Manipulation: A Long-Horizon and Robust Approach

Grasp with Push Policy for Multi-Finger Dexterity Hand Based on Deep Reinforcement Learning☆

Learning Synergies Based In-Hand Manipulation with Reward Shaping

From One Hand to Multiple Hands: Imitation Learning for Dexterous Manipulation From Single-Camera Teleoperation

Bi-DexHands: Towards Human-Level Bimanual Dexterous Manipulation

Learning dexterous in-hand manipulation

Deep Dynamics Models for Learning Dexterous Manipulation

Non-Parametric Self-Identification and Model Predictive Control of Dexterous In-Hand Manipulation

Dexterous Functional Pre-Grasp Manipulation with Diffusion Policy