Abstract:Background: Manual dexterity is a fundamental motor skill that allows us to perform complex daily tasks. Neuromuscular injuries, however, can lead to the loss of hand dexterity. Although numerous advanced assistive robotic hands have been developed, we still lack dexterous and continuous control of multiple degrees of freedom in real-time. In this study, we developed an efficient and robust neural decoding approach that can continuously decode intended finger dynamic movements for real-time control of a prosthetic hand. Methods: High-density electromyogram (HD-EMG) signals were obtained from the extrinsic finger flexor and extensor muscles, while participants performed either single-finger or multi-finger flexion-extension movements. We implemented a deep learning-based neural network approach to learn the mapping from HD-EMG features to finger-specific population motoneuron firing frequency (i.e., neural-drive signals). The neural-drive signals reflected motor commands specific to individual fingers. The predicted neural-drive signals were then used to continuously control the fingers (index, middle, and ring) of a prosthetic hand in real-time. Results: Our developed neural-drive decoder could consistently and accurately predict joint angles with significantly lower prediction errors across single-finger and multi-finger tasks, compared with a deep learning model directly trained on finger force signals and the conventional EMG-amplitude estimate. The decoder performance was stable over time and was robust to variations of the EMG signals. The decoder also demonstrated a substantially better finger separation with minimal predicted error of joint angle in the unintended fingers. Conclusions: This neural decoding technique offers a novel and efficient neural-machine interface that can consistently predict robotic finger kinematics with high accuracy, which can enable dexterous control of assistive robotic hands.

Enhancing Dexterous Hand Control: a Distributed Architecture for Machine Learning Integration

Dexterous Manoeuvre Through Touch in a Cluttered Scene

A High-Efficient Reinforcement Learning Approach for Dexterous Manipulation

Interactive learning for multi-finger dexterous hand: A model-free hierarchical deep reinforcement learning approach

Contact-Implicit Model Predictive Control for Dexterous In-hand Manipulation: A Long-Horizon and Robust Approach

Development of Robotic Hand Tactile Sensing System for Distributed Contact Force Sensing in Robotic Dexterous Multimodal Grasping

Dexterous Manipulation with Deep Reinforcement Learning: Efficient, General, and Low-Cost

Enhancing Dexterity in Robotic Manipulation via Hierarchical Contact Exploration

Deep Dynamics Models for Learning Dexterous Manipulation

MoDex: Planning High-Dimensional Dexterous Control via Learning Neural Hand Models

DeltaHands: A Synergistic Dexterous Hand Framework Based on Delta Robots

Real-time Dexterous Telemanipulation with an End-Effect-Oriented Learning-based Approach

Dexterous Manipulation from Images: Autonomous Real-World RL via Substep Guidance

Dexterous Imitation Made Easy: A Learning-Based Framework for Efficient Dexterous Manipulation

DexH2R: Task-oriented Dexterous Manipulation from Human to Robots

The Role of Learning and Kinematic Features in Dexterous Manipulation: A Comparative Study with Two Robotic Hands

Robust neural decoding for dexterous control of robotic hand kinematics

Enhancing Dexterity in Confined Spaces: Real-Time Motion Planning for Multi-Fingered In-Hand Manipulation

DexHandDiff: Interaction-aware Diffusion Planning for Adaptive Dexterous Manipulation

Reinforcement learning of shared control for dexterous telemanipulation: Application to a page turning skill