Abstract:Since the advent of computing, humans have sought computer input technologies that are expressive, intuitive, and universal. While diverse modalities have been developed, including keyboards, mice, and touchscreens, they require interaction with an intermediary device that can be limiting, especially in mobile scenarios. Gesture-based systems utilize cameras or inertial sensors to avoid an intermediary device, but they tend to perform well only for unobscured or overt movements. Brain computer interfaces (BCIs) have been imagined for decades to solve the interface problem by allowing for input to computers via thought alone. However high-bandwidth communication has only been demonstrated using invasive BCIs with decoders designed for single individuals, and so cannot scale to the general public. In contrast, neuromotor signals found at the muscle offer access to subtle gestures and force information. Here we describe the development of a noninvasive neuromotor interface that allows for computer input using surface electromyography (sEMG). We developed a highly-sensitive and robust hardware platform that is easily donned/doffed to sense myoelectric activity at the wrist and transform intentional neuromotor commands into computer input. We paired this device with an infrastructure optimized to collect training data from thousands of consenting participants, which allowed us to develop generic sEMG neural network decoding models that work across many people without the need for per-person calibration. Test users not included in the training set demonstrate closed-loop median performance of gesture decoding at 0.5 target acquisitions per second in a continuous navigation task, 0.9 gesture detections per second in a discrete gesture task, and handwriting at 17.0 adjusted words per minute. We demonstrate that input bandwidth can be further improved up to 30% by personalizing sEMG decoding models to the individual, anticipating a future in which humans and machines co-adapt to provide seamless translation of human intent. To our knowledge this is the first high-bandwidth neuromotor interface that directly leverages biosignals with performant out-of-the-box generalization across people.

Intramuscular High-Density Micro-Electrode Arrays Enable High-Precision Decoding and Mapping of Spinal Motor Neurons to Reveal Hand Control

ACCURATE DECODING OF THE SPINAL CORD OUTPUT IN HUMANS WITH IMPLANTED HIGH-DENSITY ELECTRODE ARRAYS

Sensing and decoding the neural drive to paralyzed muscles during attempted movements of a person with tetraplegia using a sleeve array

Neuromorphic Decoding of Spinal Motor Neuron Behaviour During Natural Hand Movements for a New Generation of Wearable Neural Interfaces

Proportional and Simultaneous Real-Time Control of the Full Human Hand From High-Density Electromyography

Decoding a new neural machine interface for control of artificial limbs

Robust and accurate decoding of hand kinematics from entire spiking activity using deep learning

Unsupervised decoding of spinal motor neuron spike trains for estimating hand kinematics following targeted muscle reinnervation

Decoding motor neuron activity from epimysial thin-film electrode recordings following targeted muscle reinnervation

Decoding of Multiple Wrist and Hand Movements Using a Transient EMG Classifier

Long-term decoding of movement force and direction with a wireless myoelectric implant

MyoGestic: EMG Interfacing Framework for Decoding Multiple Spared Degrees of Freedom of the Hand in Individuals with Neural Lesions

Decoding of grasping tasks from intraneural recordings in trans-radial amputee

Microneurography as a tool to develop decoding algorithms for peripheral neuro-controlled hand prostheses

Noninvasive, accurate assessment of the behavior of representative populations of motor units in targeted reinnervated muscles

From monkeys to humans: observation-basedEMGbrain-computer interface decoders for humans with paralysis

A Novel Exoskeleton Neuromuscular Interface Based on Motor Unit Action Potential Model Using High-Density Semg

Decoding Grasp Movement from Monkey Premotor Cortex for Real-time Prothetic Hand Control

Broadband Prosthetic Interfaces: Combining Nerve Transfers and Implantable Multichannel EMG Technology to Decode Spinal Motor Neuron Activity

A generic noninvasive neuromotor interface for human-computer interaction

Peripheral brain interfacing: Reading high-frequency brain signals from the output of the nervous system