Abstract:The progression of human-computer interfaces into immersive and touchless realities requires new ways of interacting with machines that are correspondingly intuitive and seamless. Among these are gesture-based systems that use natural hand movements to interact with and control digital devices. Today, these systems are most commonly implemented through the use of cameras or inertial sensors, which have drawbacks in environments that are poorly lit, in conditions where the hands are obscured, or for applications that require fine motor control. More recent studies have advocated for the use of surface electromyography (sEMG) to capture gesture information by sensing electrical activity generated by muscle contraction. While promising demonstrations have been shown, studies have also outlined limitations in sEMG when it comes to generalization across a population, largely due to physiological differences between individuals. Magnetomyography (MMG) is an alternative modality for measuring the same motor signals at the muscle, but is impervious to distortions caused by tissue, hair, and moisture; this indicates potential for lower variability caused by physiological differences and changes in skin conductivity, making MMG a promising generalizable solution for gesture control. To test this theory, we developed wristbands with magnetic sensors and implemented a signal processing pipeline for gesture classification. Using this system, we measured MMG across 30 participants performing a gesture task consisting of nine discrete gestures. We demonstrate average single-participant classification accuracy of 95.4%, rivaling state-of-the-art accuracy with sEMG. In addition, we achieved higher cross-session and cross-participant accuracy compared to sEMG studies. Given that these results were obtained with a non-ideal recording system, we anticipate significantly better results with better sensors. Together, these findings suggest that MMG can provide higher performance for control systems based on gesture recognition by overcoming limitations of existing techniques.

Semg-Based Continuous Hand Gesture Recognition Using Gmm-Hmm And Threshold Model

Dynamic hand gesture recognition using hidden Markov models

CAPG-MYO - A Muscle-Computer Interface Supporting User-defined Gesture Recognition.

Gesture recognition by instantaneous surface EMG images

Improving the Robustness of Human-Machine Interactive Control for Myoelectric Prosthetic Hand During Arm Position Changing

Semg-Based Gesture Recognition with Embedded Virtual Hand Poses and Adversarial Learning.

Gesture Classification in Electromyography Signals for Real-Time Prosthetic Hand Control Using a Convolutional Neural Network-Enhanced Channel Attention Model

Semi-Supervised Learning for Surface EMG-based Gesture Recognition.

Dynamic Gesture Recognition Using Surface EMG Signals Based on Multi-Stream Residual Network

Gesture recognition based on sEMG using multi-attention mechanism for remote control

A Novel EMG-Based Hand Gesture Recognition Framework Based on Multivariate Variational Mode Decomposition

A Novel Myoelectric Control Scheme Supporting Synchronous Gesture Recognition and Muscle Force Estimation

Hardware and Software Design and Implementation of Surface-EMG-Based Gesture Recognition and Control System

Human hand movement recognition using infinite hidden Markov model based sEMG classification

Generalizable gesture recognition using magnetomyography

A Robust and Real-Time Framework of Cross-Subject Myoelectric Control Model Calibration via Multi-Source Domain Adaptation

Continuous Kalman Estimation Method for Finger Kinematics Tracking from Surface Electromyography

Kinetic and Kinematic Sensors-free Approach for Estimation of Continuous Force and Gesture in sEMG Prosthetic Hands

Hand Gesture Recognition Based on High-Density Myoelectricity in Forearm Flexors in Humans

A novel energy-motion model for continuous sEMG decoding: from muscle energy to motor pattern

Intelligent Human-Computer Interaction Based on Surface EMG Gesture Recognition