Abstract:Objective. Creating an intracortical brain-computer interface (iBCI) capable of seamless transitions between tasks and contexts would greatly enhance user experience. However, the nonlinearity in neural activity presents challenges to computing a global iBCI decoder. We aimed to develop a method that differs from a globally optimized decoder to address this issue. Approach. We devised an unsupervised approach that relies on the structure of a low-dimensional neural manifold to implement a piecewise linear decoder. We created a distinctive dataset in which monkeys performed a diverse set of tasks, some trained, others innate, while we recorded neural signals from the motor cortex (M1) and electromyographs (EMGs) from upper limb muscles. We used both linear and nonlinear dimensionality reduction techniques to discover neural manifolds and applied unsupervised algorithms to identify clusters within those spaces. Finally, we fit a linear decoder of EMG for each cluster. A specific decoder was activated corresponding to the cluster each new neural data point belonged to. Main results. We found clusters in the neural manifolds corresponding with the different tasks or task sub-phases. The performance of piecewise decoding improved as the number of clusters increased and plateaued gradually. With only two clusters it already outperformed a global linear decoder, and unexpectedly, it outperformed even a global recurrent neural network (RNN) decoder with 10-12 clusters. Significance. This study introduced a computationally lightweight solution for creating iBCI decoders that can function effectively across a broad range of tasks. EMG decoding is particularly challenging, as muscle activity is used, under varying contexts, to control interaction forces and limb stiffness, as well as motion. The results suggest that a piecewise linear decoder can provide a good approximation to the nonlinearity between neural activity and motor outputs, a result of our increased understanding of the structure of neural manifolds in motor cortex.

Unsupervised decoding of long-term, naturalistic human neural recordings with automated video and audio annotations

Coarse Behavioral Context Decoding

Decoding the Nonstationary Neural Activity in Motor Cortex for Brain Machine Interfaces

Functional annotation of human cognitive states using deep graph convolution

Decoding speech perception from non-invasive brain recordings

Rapid Decoding of Hand Gestures in Electrocorticography Using Recurrent Neural Networks.

Decoding speech from non-invasive brain recordings

Deep Learning for Micro-Electrocorticographic (µecog) Data

Decoding Continuous Character-based Language from Non-invasive Brain Recordings

Continuous and discrete decoding of overt speech with electroencephalography

Decoding Digital Visual Stimulation From Neural Manifold With Fuzzy Leaning on Cortical Oscillatory Dynamics

Unsupervised, piecewise linear decoding enables an accurate prediction of muscle activity in a multi-task brain computer interface

Continuous and discrete decoding of overt speech with scalp electroencephalography (EEG)

Towards Naturalistic Speech Decoding from Intracranial Brain Data

Identifying Naturalistic Movies from Human Brain Activity with High-Density Diffuse Optical Tomography

Consistent spectro-spatial features of human ECoG successfully decode naturalistic behavioral states

A neural speech decoding framework leveraging deep learning and speech synthesis

NeuroCine: Decoding Vivid Video Sequences from Human Brain Activties

Decoding human brain activity with deep learning

Visual Decoding and Reconstruction via EEG Embeddings with Guided Diffusion