Abstract:Objective. Accurate decoding of individual finger movements is crucial for advanced prosthetic control. In this work, we introduce the use of Riemannian-space features and temporal dynamics of electrocorticography (ECoG) signal combined with modern machine learning (ML) tools to improve the motor decoding accuracy at the level of individual fingers. Approach. We selected a set of informative biomarkers that correlated with finger movements and evaluated the performance of state-of-the-art ML algorithms on the brain-computer interface (BCI) competition IV dataset (ECoG, three subjects) and a second ECoG dataset with a similar recording paradigm (Stanford, nine subjects). We further explored the temporal concatenation of features to effectively capture the history of ECoG signal, which led to a significant improvement over single-epoch decoding in both classification (p < 0.01) and regression tasks (p < 0.01). Main results. Using feature concatenation and gradient boosted trees (the top-performing model), we achieved a classification accuracy of 77.0% in detecting individual finger movements (six-class task, including rest state), improving over the state-of-the-art conditional random fields by 11.7% on the three BCI competition subjects. In continuous decoding of movement trajectory, our approach resulted in an average Pearson's correlation coefficient (r) of 0.537 across subjects and fingers, outperforming both the BCI competition winner and the state-of-the-art approach reported on the same dataset (CNN + LSTM). Furthermore, our proposed method features a low time complexity, with only <17.2 s required for training and <50 ms for inference. This enables about 250 x speed-up in training compared to previously reported deep learning method with state-of-the-art performance. Significance. The proposed techniques enable fast, reliable, and high-performance prosthetic control through minimally-invasive cortical signals.

FPGA-Based Gesture Recognition with Capacitive Sensor Array using Recurrent Neural Networks

Fast and Accurate Decoding of Finger Movements from ECoG Through Riemannian Features and Modern Machine Learning Techniques

Static Hand Gesture Recognition Using Capacitive Sensing and Machine Learning

Gesture Classification in Electromyography Signals for Real-Time Prosthetic Hand Control Using a Convolutional Neural Network-Enhanced Channel Attention Model

Rapid Decoding of Hand Gestures in Electrocorticography Using Recurrent Neural Networks.

Agile gesture recognition for capacitive sensing devices: adapting on-the-job

Multi-Features Capacitive Hand Gesture Recognition Sensor: A Machine Learning Approach

A Flexible Iontronic Capacitive Sensing Array for Hand Gesture Recognition Using Deep Convolutional Neural Networks

FPGA-based Lightweight QDS-CNN System for sEMG Gesture and Force Level Recognition

A Wireless Multi-Channel Capacitive Sensor System for Efficient Glove-Based Gesture Recognition With AI at the Edge

A Robust Hand Gesture Sensing and Recognition Based on Dual-Flow Fusion with FMCW Radar.

A fully connected deep learning approach to upper limb gesture recognition in a secure FES rehabilitation environment

Motion-Sensor Fusion-Based Gesture Recognition and Its Vlsi Architecture Design for Mobile Devices

Gesture Recognition System Using 24 GHz FMCW Radar Sensor Realized on Real-Time Edge Computing Platform

CAPG-MYO - A Muscle-Computer Interface Supporting User-defined Gesture Recognition.

FPGA Implementation of Convolutional Neural Network for Real-Time Handwriting Recognition

Adaptive and Personalized Gesture Recognition Using Textile Capacitive Sensor Arrays

Hand Gesture Recognition using Deep Feature Fusion Network based on Wearable Sensors

Gesture Recognition Via Flexible Capacitive Touch Electrodes

Real-Time Multiple Gesture Recognition: Application of a Lightweight Individualized 1D CNN Model to an Edge Computing System

Event-Driven Low-Power Gesture Recognition Using Differential Capacitance