Abstract:Objective. Accurate decoding of individual finger movements is crucial for advanced prosthetic control. In this work, we introduce the use of Riemannian-space features and temporal dynamics of electrocorticography (ECoG) signal combined with modern machine learning (ML) tools to improve the motor decoding accuracy at the level of individual fingers. Approach. We selected a set of informative biomarkers that correlated with finger movements and evaluated the performance of state-of-the-art ML algorithms on the brain-computer interface (BCI) competition IV dataset (ECoG, three subjects) and a second ECoG dataset with a similar recording paradigm (Stanford, nine subjects). We further explored the temporal concatenation of features to effectively capture the history of ECoG signal, which led to a significant improvement over single-epoch decoding in both classification (p < 0.01) and regression tasks (p < 0.01). Main results. Using feature concatenation and gradient boosted trees (the top-performing model), we achieved a classification accuracy of 77.0% in detecting individual finger movements (six-class task, including rest state), improving over the state-of-the-art conditional random fields by 11.7% on the three BCI competition subjects. In continuous decoding of movement trajectory, our approach resulted in an average Pearson's correlation coefficient (r) of 0.537 across subjects and fingers, outperforming both the BCI competition winner and the state-of-the-art approach reported on the same dataset (CNN + LSTM). Furthermore, our proposed method features a low time complexity, with only <17.2 s required for training and <50 ms for inference. This enables about 250 x speed-up in training compared to previously reported deep learning method with state-of-the-art performance. Significance. The proposed techniques enable fast, reliable, and high-performance prosthetic control through minimally-invasive cortical signals.

A Database for Learning Numbers by Visual Finger Recognition in Developmental Neuro-Robotics

A Developmental Neuro-Robotics Approach for Boosting the Recognition of Handwritten Digits

Fast and Accurate Decoding of Finger Movements from ECoG Through Riemannian Features and Modern Machine Learning Techniques

A Number Sense as an Emergent Property of the Manipulating Brain

The Challenge of Modeling the Acquisition of Mathematical Concepts

Cognitive Deficit of Deep Learning in Numerosity

Putting a Finger on Numerical Development – Reviewing the Contributions of Kindergarten Finger Gnosis and Fine Motor Skills to Numerical Abilities

Interpreting Hand gestures using Object Detection and Digits Classification

Numerosity discrimination in deep neural networks: Initial competence, developmental refinement and experience statistics

Exploring the Potential of Robot-Collected Data for Training Gesture Classification Systems

A robot that counts like a child: a developmental model of counting and pointing

Assistance System for the Teaching of Natural Numbers to Preschool Children with the Use of Artificial Intelligence Algorithms

On Numerosity of Deep Convolutional Neural Networks.

On Numerosity of Deep Convolutional Neural Networks

Machine Number Sense: A Dataset of Visual Arithmetic Problems for Abstract and Relational Reasoning

SenseNet: 3D Objects Database and Tactile Simulator

Estimating the distribution of numerosity and non-numerical visual magnitudes in natural scenes using computer vision

Investigating the Triple Code Model in Numerical Cognition Using Stereotactic Electroencephalography

Visual Enumeration is Challenging for Large-scale Generative AI

Evaluating Visual Number Discrimination in Deep Neural Networks