Abstract:Motor imagery (MI) based brain computer interface significantly oriented the development of neuro-rehabilitation, and the crucial issue is how to accurately detect the changes of cerebral cortex for MI decoding. The brain activity can be calculated based on the head model and observed scalp EEG, providing insights regarding cortical dynamics by using equivalent current dipoles with high spatial and temporal resolution. Now, all the dipoles within entire cortex or partial regions of interest are directly applied to data representation, this may make the key information weakened or lost, and it is worth studying how to choose the most important from numerous dipoles. In this paper, we devote to building a simplified distributed dipoles model (SDDM), which is combined with convolutional neural network (CNN), generating a MI decoding method at source level (called SDDM-CNN). First, all channels of raw MI-EEG signals are subdivided by a series of bandpass filters with width of 1 Hz, the average energies associated with any sub-band signals are calculated and ranked in a descending order to screen the top n sub-bands; then, the MI-EEG signals over each selected sub-band are mapped into source space by using EEG source imaging technology, and for each scout of neuroanatomical Desikan-Killiany partition, a centered dipole is selected as the most relevant dipole and put together to build a SDDM to reflect the neuroelectric activity of entire cerebral cortex; finally, the 4 dimensional (4D) magnitude matrix is constructed for each SDDM and fused into a novel data representation, which is further input to a well-designed 3DCNN with n parallel branches ( n B3DCNN) to extract and classify the comprehensive features from time–frequency-space dimensions. Experiments are carried out on three public datasets, and the average ten-fold CV decoding accuracies achieve 95.09%, 97.98% and 94.53% respectively, and the statistical analysis is fulfilled by standard deviation, kappa value and confusion matrix. Experiment results suggest that it is beneficial to pick out the most sensitive sub-bands in sensor domain, and SDDM can sufficiently describe the dynamic changing of entire cortex, improving decoding performance while greatly reducing number of source signals. Also, n B3DCNN is capable of exploring spatial–temporal features from multi sub-bands.

Decoding N400m Evoked Component: A Tutorial on Multivariate Pattern Analysis for OP-MEG Data

A Multivariate analysis on evoked components of Chinese semantic congruity: an OP-MEG study with EEG

Decoding multimodal behavior using time differences of MEG events

Decoding the Temporal Structures and Interactions of Multiple Face Dimensions Using Optically Pumped Magnetometer Magnetoencephalography (OPM-MEG)

Application of Empirical Mode Decomposition for Decoding Perception of Faces Using Magnetoencephalography

An introduction to time-resolved decoding analysis for M/EEG

The technique of multivariate empirical mode decomposition and independent component analysis to exactly extract the mismatch negativity from EEG

Rapidly Decoding Image Categories from MEG Data Using a Multivariate Short-Time FC Pattern Analysis Approach

Coherence-based channel selection and Riemannian geometry features for magnetoencephalography decoding

Motor Imagery EEG Signals Decoding by Multivariate Empirical Wavelet Transform-Based Framework for Robust Brain–Computer Interfaces

Optimizing magnetometers arrays and analysis pipelines for multivariate pattern analysis

Multichannel Matching Pursuit of MEG Signals for Discriminative Oscillation Pattern Detection in Depression

Multimodal Neuroimaging with Optically Pumped Magnetometers: A Simultaneous MEG-EEG-fNIRS Acquisition System

Categorizing Objects from MEG Signals Using EEGNet

Decoding SSVEP patterns from EEG via multivariate variational mode decomposition-informed canonical correlation analysis

Decoding of Motor Imagery EEG Based on Brain Source Estimation

Research on the MEG of Depression Patients Based on Multivariate TE Partial Information Decomposition

The best of two worlds: Decoding and source-reconstructing M/EEG oscillatory activity with a unique model

A user-friendly visual brain-computer interface based on high-frequency steady-state visual evoked fields recorded by OPM-MEG

Decoding Motor Imagery with a Simplified Distributed Dipoles Model at Source Level