Abstract:Motor imagery (MI) based brain computer interface significantly oriented the development of neuro-rehabilitation, and the crucial issue is how to accurately detect the changes of cerebral cortex for MI decoding. The brain activity can be calculated based on the head model and observed scalp EEG, providing insights regarding cortical dynamics by using equivalent current dipoles with high spatial and temporal resolution. Now, all the dipoles within entire cortex or partial regions of interest are directly applied to data representation, this may make the key information weakened or lost, and it is worth studying how to choose the most important from numerous dipoles. In this paper, we devote to building a simplified distributed dipoles model (SDDM), which is combined with convolutional neural network (CNN), generating a MI decoding method at source level (called SDDM-CNN). First, all channels of raw MI-EEG signals are subdivided by a series of bandpass filters with width of 1 Hz, the average energies associated with any sub-band signals are calculated and ranked in a descending order to screen the top n sub-bands; then, the MI-EEG signals over each selected sub-band are mapped into source space by using EEG source imaging technology, and for each scout of neuroanatomical Desikan-Killiany partition, a centered dipole is selected as the most relevant dipole and put together to build a SDDM to reflect the neuroelectric activity of entire cerebral cortex; finally, the 4 dimensional (4D) magnitude matrix is constructed for each SDDM and fused into a novel data representation, which is further input to a well-designed 3DCNN with n parallel branches ( n B3DCNN) to extract and classify the comprehensive features from time–frequency-space dimensions. Experiments are carried out on three public datasets, and the average ten-fold CV decoding accuracies achieve 95.09%, 97.98% and 94.53% respectively, and the statistical analysis is fulfilled by standard deviation, kappa value and confusion matrix. Experiment results suggest that it is beneficial to pick out the most sensitive sub-bands in sensor domain, and SDDM can sufficiently describe the dynamic changing of entire cortex, improving decoding performance while greatly reducing number of source signals. Also, n B3DCNN is capable of exploring spatial–temporal features from multi sub-bands.

A novel decoding method for motor imagery tasks with 4D data representation and 3D convolutional neural networks

A Novel Approach to MI-EEG Classification Via 3D Interpolation and 3DCNN

Decoding Motor Imagery with a Simplified Distributed Dipoles Model at Source Level

A Densely Connected Multi-Branch 3D Convolutional Neural Network for Motor Imagery EEG Decoding

Two-branch 3D Convolutional Neural Network for Motor Imagery EEG Decoding.

Decoding motor imagery based on dipole feature imaging and a hybrid CNN with embedded squeeze-and-excitation block

Exploiting Asymmetric EEG Signals with EFD in Deep Learning Domain for Robust BCI

3D Convolution neural network with multiscale spatial and temporal cues for motor imagery EEG classification

A spatial-frequency-temporal 3D convolutional neural network for motor imagery EEG signal classification

A Novel MI-EEG Imaging with the Location Information of Electrodes

Temporal-frequency-phase feature classification using 3D-convolutional neural networks for motor imagery and movement

A Novel Deep Learning Scheme for Motor Imagery EEG Decoding Based on Spatial Representation Fusion.

Decoding Motor Imagery Tasks Using ESI and Hybrid Feature CNN

A Spatial-Spectral and Temporal Dual Prototype Network for Motor Imagery Brain-Computer Interface

A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding

Deep-learning-based motor imagery EEG classification by exploiting the functional connectivity of cortical source imaging

Motor Imagery EEG Decoding Based on Multi-scale Hybrid Networks and Feature Enhancement.

A Multi-Branch 3D Convolutional Neural Network for EEG-Based Motor Imagery Classification.

A new attention-based 3D densely connected cross-stage-partial network for motor imagery classification in BCI

Enhancing EEG Motor Imagery Decoding Performance Via Deep Temporal-domain Information Extraction

Cortical ROI Importance Improves MI Decoding From EEG Using Fused Light Neural Network