Abstract:Matching the dexterity, versatility, and robustness of the human hand is still an unachieved goal in bionics, robotics, and neural engineering. A major limitation for hand prosthetics lies in the challenges of reliably decoding user intention from muscle signals when controlling complex robotic hands. Most of the commercially available prosthetic hands use muscle-related signals to decode a finite number of predefined motions and some offer proportional control of open/close movements of the whole hand. Here, in contrast, we aim to offer users flexible control of individual joints of their artificial hand. We propose a novel framework for decoding neural information that enables a user to independently control 11 joints of the hand in a continuous manner-much like we control our natural hands. Toward this end, we instructed six able-bodied subjects to perform everyday object manipulation tasks combining both dynamic, free movements (e.g., grasping) and isometric force tasks (e.g., squeezing). We recorded the electromyographic and mechanomyographic activities of five extrinsic muscles of the hand in the forearm, while simultaneously monitoring 11 joints of hand and fingers using a sensorized data glove that tracked the joints of the hand. Instead of learning just a direct mapping from current muscle activity to intended hand movement, we formulated a novel autoregressive approach that combines the context of previous hand movements with instantaneous muscle activity to predict future hand movements. Specifically, we evaluated a linear vector autoregressive moving average model with exogenous inputs and a novel Gaussian process ( ) autoregressive framework to learn the continuous mapping from hand joint dynamics and muscle activity to decode intended hand movement. Our approach achieves high levels of performance (RMSE of 8°/s and ). Crucially, we use a small set of sensors that allows us to control a larger set of independently actuated degrees of freedom of a hand. This novel undersensored control is enabled through the combination of nonlinear autoregressive continuous mapping between muscle activity and joint angles. The system evaluates the muscle signals in the context of previous natural hand movements. This enables us to resolve ambiguities in situations, where muscle signals alone cannot determine the correct action as we evaluate the muscle signals in their context of natural hand movements. autoregression is a particularly powerful approach which makes not only a prediction based on the context but also represents the associated uncertainty of its predictions, thus enabling the novel notion of risk-based control in neuroprosthetics. Our results suggest that autoregressive approaches with exogenous inputs lend themselves for natural, intuitive, and continuous control in neurotechnology, with the particular focus on prosthetic restoration of natural limb function, where high dexterity is required for complex movements.

Proportional and Simultaneous Real-Time Control of the Full Human Hand From High-Density Electromyography

Simultaneous Control of Human Hand Joint Positions and Grip Force via HD-EMG and Deep Learning

Accurate Continuous Prediction of 14 Degrees of Freedom of the Hand from Myoelectrical Signals through Convolutive Deep Learning

Graph-Driven Simultaneous and Proportional Estimation of Wrist Angle and Grasp Force Via High-Density EMG

Influence of spatio-temporal filtering on hand kinematics estimation from high-density EMG signals

A NOVEL PROPORTIONAL AND SIMULTANEOUS CONTROL METHOD FOR PROSTHETIC HAND

Improving the Robustness of Human-Machine Interactive Control for Myoelectric Prosthetic Hand During Arm Position Changing

Gaussian Process Autoregression for Simultaneous Proportional Multi-Modal Prosthetic Control With Natural Hand Kinematics

Simultaneous Estimation of Hand Joints’ Angles Toward Semg-Driven Human–Robot Interaction

Simultaneous and Proportional Control of Wrist and Hand Movements Based on a Neural-Driven Musculoskeletal Model.

Simultaneous Estimation of Digit Tip Forces and Hand Postures in a Simulated Real-Life Condition With High-Density Electromyography and Deep Learning

Online Adaptation for Myographic Control of Natural Dexterous Hand and Finger Movements

Wearable high-density EMG sleeve for complex hand gesture classification and continuous joint angle estimation

Proportional estimation of finger movements from high-density surface electromyography

Unsupervised decoding of spinal motor neuron spike trains for estimating hand kinematics following targeted muscle reinnervation

MyoGestic: EMG Interfacing Framework for Decoding Multiple Spared Degrees of Freedom of the Hand in Individuals with Neural Lesions

Robust neural decoding for dexterous control of robotic hand kinematics

Decoding of Multiple Wrist and Hand Movements Using a Transient EMG Classifier

Improved prosthetic hand control with concurrent use of myoelectric and inertial measurements

Long-Term Upper-Limb Prosthesis Myocontrol via High-Density sEMG and Incremental Learning

EMG-Based Continuous and Simultaneous Estimation of Arm Kinematics in Able-Bodied Individuals and Stroke Survivors