Abstract:When a multi-fingered dexterous hand interacts with the external environment, it encounters various challenges, including the utilization of complex control techniques and the intricate coordination of finger motion sequences. Previous studies have primarily concentrated on investigating the interaction between multi-fingered dexterous hands and external objects, usually using model-based control or model-free reinforcement learning techniques. However, during practical implementation, various constraining factors are encountered, such as intricate modeling and limited interaction capabilities. In practical scenarios, the utilization of multi-fingered dexterous hands is imperative for the swift and efficient execution of a wide range of interactive tasks, including but not limited to throwing a ball and playing rock-paper-scissors. These tasks require skilled manual dexterity to demonstrate both precise control and quick responsiveness. To tackle this issue, we propose a hierarchical control approach for multi-fingered dexterous hands with interactive functionalities, utilizing model-free deep reinforcement learning. The complex interaction task is decomposed into simple sub-tasks using hierarchical strategy and action primitive decomposition, which effectively reduces the complexity of the action space, and achieves the motion planning and end finger trajectory control of dexterous hand. In a simulated environment, the aforementioned method has successfully executed interactive tasks, including ball throwing and playing rock-paper-scissors. It achieved a maximum normalized reward of 0.83 and an 84 % success rate. These results are noteworthy in terms of both control accuracy and response speed. This study offers novel insights into the effective resolution of the intricate challenges associated with interactions involving multi-fingered dexterous hands and human-computer interaction.

Acquisition of synergy for low-dimensional control of multi-fingered hands by reinforcement learning

Learning Synergies Based In-Hand Manipulation with Reward Shaping

Discovering Synergies for Robot Manipulation with Multi-Task Reinforcement Learning

Object Manipulation with an Anthropomorphic Robotic Hand via Deep Reinforcement Learning with a Synergy Space of Natural Hand Poses

Multifingered Grasping Based on Multimodal Reinforcement Learning

Synergistic Control of Soft Robotic Hands for Human-Like Grasp Postures

Functionally Divided Manipulation Synergy for Controlling Multi-fingered Hands

Reinforcement learning of shared control for dexterous telemanipulation: Application to a page turning skill

Extracting bimanual synergies with reinforcement learning

Dexterous Manipulation with Deep Reinforcement Learning: Efficient, General, and Low-Cost

Leveraging Contact Forces for Learning to Grasp

Multifingered Robot Hand Compliant Manipulation Based on Vision-Based Demonstration and Adaptive Force Control

Dexterous Manipulation from Images: Autonomous Real-World RL via Substep Guidance

Design and Analysis of a Synergy-Inspired Three-Fingered Hand

Dexterous Manipulation for Multi-Fingered Robotic Hands With Reinforcement Learning: A Review

Hand synergies: Integration of robotics and neuroscience for understanding the control of biological and artificial hands

Design and Experiments of a Three-Fingered Dexterous Hand Based on Biomechanical Characteristics of Human Hand Synergies

Hand-arm autonomous grasping: synergistic motions to enhance the learning process

Interactive learning for multi-finger dexterous hand: A model-free hierarchical deep reinforcement learning approach

Adaptive Motion Planning for Multi-fingered Functional Grasp via Force Feedback

A Multi-Agent Approach for Adaptive Finger Cooperation in Learning-based In-Hand Manipulation