Abstract:Since the advent of computing, humans have sought computer input technologies that are expressive, intuitive, and universal. While diverse modalities have been developed, including keyboards, mice, and touchscreens, they require interaction with an intermediary device that can be limiting, especially in mobile scenarios. Gesture-based systems utilize cameras or inertial sensors to avoid an intermediary device, but they tend to perform well only for unobscured or overt movements. Brain computer interfaces (BCIs) have been imagined for decades to solve the interface problem by allowing for input to computers via thought alone. However high-bandwidth communication has only been demonstrated using invasive BCIs with decoders designed for single individuals, and so cannot scale to the general public. In contrast, neuromotor signals found at the muscle offer access to subtle gestures and force information. Here we describe the development of a noninvasive neuromotor interface that allows for computer input using surface electromyography (sEMG). We developed a highly-sensitive and robust hardware platform that is easily donned/doffed to sense myoelectric activity at the wrist and transform intentional neuromotor commands into computer input. We paired this device with an infrastructure optimized to collect training data from thousands of consenting participants, which allowed us to develop generic sEMG neural network decoding models that work across many people without the need for per-person calibration. Test users not included in the training set demonstrate closed-loop median performance of gesture decoding at 0.5 target acquisitions per second in a continuous navigation task, 0.9 gesture detections per second in a discrete gesture task, and handwriting at 17.0 adjusted words per minute. We demonstrate that input bandwidth can be further improved up to 30% by personalizing sEMG decoding models to the individual, anticipating a future in which humans and machines co-adapt to provide seamless translation of human intent. To our knowledge this is the first high-bandwidth neuromotor interface that directly leverages biosignals with performant out-of-the-box generalization across people.

A wireless wearable sEMG and NIRS acquisition system for an enhanced human-computer interface

An enhanced human-computer interface based on simultaneous sEMG and NIRS for prostheses control

Development of A Hybrid Mini-Grid sEMG, NIRS and MMG Sensor System for Human-Machine Interaction

Development of a Multi-Channel Compact-Size Wireless Hybrid sEMG/NIRS Sensor System for Prosthetic Manipulation

Hybrid Semg, NIRS and MMG Sensor System

Toward an Integrated Multi-Modal sEMG/MMG/NIRS Sensing System for Human-Machine Interface Robust to Muscular Fatigue

Toward Portable Hybrid Surface Electromyography/A-Mode Ultrasound Sensing for Human–Machine Interface

A Wireless, High-Quality, Soft and Portable Wrist-Worn System for sEMG Signal Detection

Toward an Enhanced Human–Machine Interface for Upper-Limb Prosthesis Control with Combined EMG and NIRS Signals

Measuring Motor Unit Discharge, Myofiber Vibration, and Haemodynamics for Enhanced Myoelectric Gesture Recognition.

Gesture recognition by instantaneous surface EMG images

Towards Zero Training For Myoelectric Control Based On A Wearable Wireless Semg Armband

A Current-Based Surface Electromyography (semg) System for Human Motion Recognition: Preliminary Study

A Wearable, High-Resolution, and Wireless System for Multichannel Surface Electromyography Detection

Intelligent Human-Computer Interaction Based on Surface EMG Gesture Recognition

Development of a Hybrid Surface EMG and MMG Acquisition System for Human Hand Motion Analysis.

A novel human-robot interface based on low-cost sEMG device designed for the collaborative wearable robot

A New Approach for Hand Gesture Recognition Based on the Fusion of sEMG and Impedance Information

Conformal, Stretchable, Breathable, Wireless Epidermal Surface Electromyography Sensor System for Hand Gesture Recognition and Rehabilitation of Stroke Hand Function

A generic noninvasive neuromotor interface for human-computer interaction

A Surface Electromyography (sEMG) System Applied for Grip Force Monitoring