Abstract:Abstract Objective . Motor imagery (MI) electroencephalography (EEG) classification is regarded as a promising technology for brain–computer interface (BCI) systems, which help people to communicate with the outside world using neural activities. However, decoding human intent accurately is a challenging task because of its small signal-to-noise ratio and non-stationary characteristics. Methods that directly extract features from raw EEG signals ignores key frequency domain information. One of the challenges in MI classification tasks is finding a way to supplement the frequency domain information ignored by the raw EEG signal. Approach . In this study, we fuse different models using their complementary characteristics to develop a multiscale space-time-frequency feature-guided multitask learning convolutional neural network (CNN) architecture. The proposed method consists of four modules: the space-time feature-based representation module, time-frequency feature-based representation module, multimodal fused feature-guided generation module, and classification module. The proposed framework is based on multitask learning. The four modules are trained using three tasks simultaneously and jointly optimized. Results . The proposed method is evaluated using three public challenge datasets. Through quantitative analysis, we demonstrate that our proposed method outperforms most state-of-the-art machine learning and deep learning techniques for EEG classification, thereby demonstrating the robustness and effectiveness of our method. Moreover, the proposed method is employed to realize control of robot based on EEG signal, verifying its feasibility in real-time applications. Significance . To the best of our knowledge, a deep CNN architecture that fuses different input cases, which have complementary characteristics, has not been applied to BCI tasks. Because of the interaction of the three tasks in the multitask learning architecture, our method can improve the generalization and accuracy of subject-dependent and subject-independent methods with limited annotated data.

A Radial Basis Deformable Residual Convolutional Neural Model Embedded with Local Multi-Modal Feature Knowledge and Its Application in Cross-Subject Classification

A novel AI-driven EEG generalized classification model for cross-subject and cross-scene analysis

Exploiting Asymmetric EEG Signals with EFD in Deep Learning Domain for Robust BCI

A Multi-Scale EEGNet for Cross-Subject RSVP-based BCI System.

Cross-subject dual-domain fusion network with task-related and task-discriminant component analysis enhancing one-shot SSVEP classification.

Multi-source domain adaptation based tempo-spatial convolution network for cross-subject EEG classification in RSVP task

A deep learning method for single-trial EEG classification in RSVP task based on spatiotemporal features of ERPs

Multiscale space-time-frequency feature-guided multitask learning CNN for motor imagery EEG classification

A Relation Feature Comparison Network for Cross-Domain Recognition of Motion Intention

Multi-domain fusion deep graph convolution neural network for EEG emotion recognition

Densely Feature Fusion Based On Convolutional Neural Networks For Motor Imagery Eeg Classification

A Novel Multi-Morphological Representation Approach for Multi-Source EEG Signals

SPD-CNN: A plain CNN-based model using the symmetric positive definite matrices for cross-subject EEG classification with meta-transfer-learning

Cross-Subject Eeg-Based Emotion Recognition With Deep Domain Confusion

Separated Channel Convolutional Neural Network to Realize the Training Free Motor Imagery BCI Systems.

Enhancing Cross-Subject Motor Imagery Classification in EEG-Based Brain-Computer Interfaces by Using Multi-Branch CNN

Cross-Channel Specific-Mutual Feature Transfer Learning for Motor Imagery EEG Signals Decoding.

Cross-subject EEG Emotion Recognition Combined with Connectivity Features and Meta-Transfer Learning

Multi-dimensional Conditional Mutual Information with Application on the EEG Signal Analysis for Spatial Cognitive Ability Evaluation.

Minimizing EEG Human Interference: A Study of an Adaptive EEG Spatial Feature Extraction with Deep Convolutional Neural Networks

Multimodal Classification with Deep Convolutional-Recurrent Neural Networks for Electroencephalography