Abstract:Since the advent of computing, humans have sought computer input technologies that are expressive, intuitive, and universal. While diverse modalities have been developed, including keyboards, mice, and touchscreens, they require interaction with an intermediary device that can be limiting, especially in mobile scenarios. Gesture-based systems utilize cameras or inertial sensors to avoid an intermediary device, but they tend to perform well only for unobscured or overt movements. Brain computer interfaces (BCIs) have been imagined for decades to solve the interface problem by allowing for input to computers via thought alone. However high-bandwidth communication has only been demonstrated using invasive BCIs with decoders designed for single individuals, and so cannot scale to the general public. In contrast, neuromotor signals found at the muscle offer access to subtle gestures and force information. Here we describe the development of a noninvasive neuromotor interface that allows for computer input using surface electromyography (sEMG). We developed a highly-sensitive and robust hardware platform that is easily donned/doffed to sense myoelectric activity at the wrist and transform intentional neuromotor commands into computer input. We paired this device with an infrastructure optimized to collect training data from thousands of consenting participants, which allowed us to develop generic sEMG neural network decoding models that work across many people without the need for per-person calibration. Test users not included in the training set demonstrate closed-loop median performance of gesture decoding at 0.5 target acquisitions per second in a continuous navigation task, 0.9 gesture detections per second in a discrete gesture task, and handwriting at 17.0 adjusted words per minute. We demonstrate that input bandwidth can be further improved up to 30% by personalizing sEMG decoding models to the individual, anticipating a future in which humans and machines co-adapt to provide seamless translation of human intent. To our knowledge this is the first high-bandwidth neuromotor interface that directly leverages biosignals with performant out-of-the-box generalization across people.

A wearable computing system for wireless communication and gesture based human computer interface

Wearable Internet of Things: Concept, Architectural Components and Promises for Person-Centered Healthcare

Wearable-based Human-Computer Interaction with LimbMotion

A Portable Wireless Eye Movement-Controlled Human-Computer Interface for the Disabled

Smart Ring

Micro-Controllable, Multi-Functional Interface Module for Digital MP: A Wearable Computer Security Application

Design of A Compact Low-Power Human-Computer Interaction Equipment for Hand Motion

Communications for Wearable Devices

A wearable general-purpose solution for Human-Swarm Interaction

Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions

Contactless Human–computer Interaction System Based on Three-Dimensional Holographic Display and Gesture Recognition

Invited: Human-Inspired Distributed Wearable AI

HandsInAir: A Wearable System for Remote Collaboration

A generic noninvasive neuromotor interface for human-computer interaction

Biosymbiotic haptic feedback - Sustained long term human machine interfaces

A stand-alone proximity-based gaming wearable for remote physical activity monitoring

A Hands-Free Communication Solution for Wearable Devices

Distributed Gesture Controlled Systems for Human-Machine Interface

Optical‐Nanofiber‐Enabled Gesture‐Recognition Wristband for Human–Machine Interaction with the Assistance of Machine Learning

AR-Enabled Persistent Human-Machine Interfaces via a Scalable Soft Electrode Array

Hybridized wearable patch as a multi-parameter and multi-functional human-machine interface