Abstract:When a multi-fingered dexterous hand interacts with the external environment, it encounters various challenges, including the utilization of complex control techniques and the intricate coordination of finger motion sequences. Previous studies have primarily concentrated on investigating the interaction between multi-fingered dexterous hands and external objects, usually using model-based control or model-free reinforcement learning techniques. However, during practical implementation, various constraining factors are encountered, such as intricate modeling and limited interaction capabilities. In practical scenarios, the utilization of multi-fingered dexterous hands is imperative for the swift and efficient execution of a wide range of interactive tasks, including but not limited to throwing a ball and playing rock-paper-scissors. These tasks require skilled manual dexterity to demonstrate both precise control and quick responsiveness. To tackle this issue, we propose a hierarchical control approach for multi-fingered dexterous hands with interactive functionalities, utilizing model-free deep reinforcement learning. The complex interaction task is decomposed into simple sub-tasks using hierarchical strategy and action primitive decomposition, which effectively reduces the complexity of the action space, and achieves the motion planning and end finger trajectory control of dexterous hand. In a simulated environment, the aforementioned method has successfully executed interactive tasks, including ball throwing and playing rock-paper-scissors. It achieved a maximum normalized reward of 0.83 and an 84 % success rate. These results are noteworthy in terms of both control accuracy and response speed. This study offers novel insights into the effective resolution of the intricate challenges associated with interactions involving multi-fingered dexterous hands and human-computer interaction.

Dexterous Manipulation for Multi-Fingered Robotic Hands With Reinforcement Learning: A Review

A Survey of Multifingered Robotic Manipulation: Biological Results, Structural Evolvements, and Learning Methods

Dexterous Manipulation with Deep Reinforcement Learning: Efficient, General, and Low-Cost

A High-Efficient Reinforcement Learning Approach for Dexterous Manipulation

Interactive learning for multi-finger dexterous hand: A model-free hierarchical deep reinforcement learning approach

Dexterous Manipulation from Images: Autonomous Real-World RL via Substep Guidance

Dexterous Manipulation Based on Prior Dexterous Grasp Pose Knowledge

Within-Hand Manipulation with an Underactuated Dexterous Hand Based on Pre-Trained Reinforcement Learning

Towards Human-Level Bimanual Dexterous Manipulation with Reinforcement Learning

A Survey on Deep Reinforcement Learning Algorithms for Robotic Manipulation

Dexterous In-Hand Manipulation of Slender Cylindrical Objects through Deep Reinforcement Learning with Tactile Sensing

Reinforcement learning of shared control for dexterous telemanipulation: Application to a page turning skill

Towards Multi-Finger Dexterous Hand Mechanics Control and Tactile Feedback.

Learning Synergies Based In-Hand Manipulation with Reward Shaping

Reinforcement Learning for Robotic Grasping and Manipulation: A Review

Deep Dynamics Models for Learning Dexterous Manipulation

A Review on Robot Manipulation Methods in Human-Robot Interactions

Grasp with Push Policy for Multi-Finger Dexterity Hand Based on Deep Reinforcement Learning☆

Survey of Learning-based Approaches for Robotic In-Hand Manipulation

A review on sensory perception for dexterous robotic manipulation