Abstract:OBJECTIVE:The high-dimensional neural recordings bring computational challenges to movement decoding in motor brain machine interfaces (mBMI), especially for portable applications. However, not all recorded neural activities relate to the execution of a certain movement task. This paper proposes to use a local-learning-based method to perform neuron selection for the gesture prediction in a reaching and grasping task.APPROACH:Nonlinear neural activities are decomposed into a set of linear ones in a weighted feature space. A margin is defined to measure the distance between inter-class and intra-class neural patterns. The weights, reflecting the importance of neurons, are obtained by minimizing a margin-based exponential error function. To find the most dominant neurons in the task, 1-norm regularization is introduced to the objective function for sparse weights, where near-zero weights indicate irrelevant neurons.MAIN RESULTS:The signals of only 10 neurons out of 70 selected by the proposed method could achieve over 95% of the full recording's decoding accuracy of gesture predictions, no matter which different decoding methods are used (support vector machine and K-nearest neighbor). The temporal activities of the selected neurons show visually distinguishable patterns associated with various hand states. Compared with other algorithms, the proposed method can better eliminate the irrelevant neurons with near-zero weights and provides the important neuron subset with the best decoding performance in statistics. The weights of important neurons converge usually within 10-20 iterations. In addition, we study the temporal and spatial variation of neuron importance along a period of one and a half months in the same task. A high decoding performance can be maintained by updating the neuron subset.SIGNIFICANCE:The proposed algorithm effectively ascertains the neuronal importance without assuming any coding model and provides a high performance with different decoding models. It shows better robustness of identifying the important neurons with noisy signals presented. The low demand of computational resources which, reflected by the fast convergence, indicates the feasibility of the method applied in portable BMI systems. The ascertainment of the important neurons helps to inspect neural patterns visually associated with the movement task. The elimination of irrelevant neurons greatly reduces the computational burden of mBMI systems and maintains the performance with better robustness.

Learning Shared Semantic Information from Multimodal Bio-signals for Brain-Muscle Modulation Analysis

Speech neuromuscular decoding based on spectrogram images using conformal predictors with Bi-LSTM.

Learning Motor Cues in Brain-Muscle Modulation

Semg-Based Gesture Recognition with Embedded Virtual Hand Poses and Adversarial Learning.

Local-learning-based Neuron Selection for Grasping Gesture Prediction in Motor Brain Machine Interfaces

A Joint Multimodal Group Analysis Framework for Modeling Corticomuscular Activity.

Bio-signal based motion control system using deep learning models: a deep learning approach for motion classification using EEG and EMG signal fusion

Decoding multiclass motor imagery EEG from the same upper limb by combining Riemannian geometry features and partial least squares regression

Decoding finger movement patterns from microscopic neural drive information based on deep learning

Myoelectric Pattern Recognition Using Gramian Angular Field and Convolutional Neural Networks for Muscle–Computer Interface

Multi-scale Learning for Multimodal Neurophysiological Signals: Gait Pattern Classification as an Example

Transfer Learning-Based Muscle Activity Decoding Scheme by Low-frequency sEMG for Wearable Low-cost Application

Multi-View Fusion Network-Based Gesture Recognition Using sEMG Data

A Semi-Supervised Progressive Learning Algorithm for Brain–Computer Interface

Role of Muscle Synergies in Real-Time Classification of Upper Limb Motions using Extreme Learning Machines

Electromyography Based Cross-Subject Limb Angle Estimation via Hierarchical Spiking Attentional Feature Decomposition Network

Research on Multimodal Fusion Recognition Method of Upper Limb Motion Patterns

Temporal Dynamics and Physical Priori Multimodal Network for Rehabilitation Physical Training Evaluation

Innovative use of optical sensors for real-time imaging and diagnosis using enhanced verge denoising and LSTM for sports medicine

EEG-eye movement based subject dependence, cross-subject, and cross-session emotion recognition with multidimensional homogeneous encoding space alignment

Decoding Simultaneous Multi-DOF Wrist Movements From Raw EMG Signals Using a Convolutional Neural Network