Abstract:Abstract Objective . Motor imagery (MI) electroencephalography (EEG) classification is regarded as a promising technology for brain–computer interface (BCI) systems, which help people to communicate with the outside world using neural activities. However, decoding human intent accurately is a challenging task because of its small signal-to-noise ratio and non-stationary characteristics. Methods that directly extract features from raw EEG signals ignores key frequency domain information. One of the challenges in MI classification tasks is finding a way to supplement the frequency domain information ignored by the raw EEG signal. Approach . In this study, we fuse different models using their complementary characteristics to develop a multiscale space-time-frequency feature-guided multitask learning convolutional neural network (CNN) architecture. The proposed method consists of four modules: the space-time feature-based representation module, time-frequency feature-based representation module, multimodal fused feature-guided generation module, and classification module. The proposed framework is based on multitask learning. The four modules are trained using three tasks simultaneously and jointly optimized. Results . The proposed method is evaluated using three public challenge datasets. Through quantitative analysis, we demonstrate that our proposed method outperforms most state-of-the-art machine learning and deep learning techniques for EEG classification, thereby demonstrating the robustness and effectiveness of our method. Moreover, the proposed method is employed to realize control of robot based on EEG signal, verifying its feasibility in real-time applications. Significance . To the best of our knowledge, a deep CNN architecture that fuses different input cases, which have complementary characteristics, has not been applied to BCI tasks. Because of the interaction of the three tasks in the multitask learning architecture, our method can improve the generalization and accuracy of subject-dependent and subject-independent methods with limited annotated data.

Multitask Feature Learning Meets Robust Tensor Decomposition for EEG Classification

Tensorized LSSVMS for Multitask Regression

MTLComb: multi-task learning combining regression and classification tasks for joint feature selection

Low-Rank Multitask Learning based on Tensorized SVMs and LSSVMs

Robust Multi-Task Feature Learning

Multi-Task Collaborative Network: Bridge the Supervised and Self-Supervised Learning for EEG Classification in RSVP Tasks

EEGMamba: Bidirectional State Space Model with Mixture of Experts for EEG Multi-task Classification

Multiple Task Learning Using Iteratively Reweighted Least Square.

Multitask Feature Selection by Graph-Clustered Feature Sharing

On Better Exploring and Exploiting Task Relationships in Multitask Learning: Joint Model and Feature Learning.

Multiscale space-time-frequency feature-guided multitask learning CNN for motor imagery EEG classification

Semantic Feature Learning for Heterogeneous Multitask Classification Via Non-Negative Matrix Factorization.

Multitask Learning for EEG-based Biometrics.

Adaptive Multimodel Knowledge Transfer Matrix Machine for EEG Classification

Sparse Multi-kernel Based Multi-task Learning for Joint Prediction of Clinical Scores and Biomarker Identification in Alzheimer's Disease.

Multi-task Learning with Weak Class Labels: Leveraging iEEG to Detect Cortical Lesions in Cryptogenic Epilepsy

Feature-aware Multi-task Feature Learning for Predicting Cognitive Outcomes in Alzheimer's Disease

Multi-subband and Multi-subepoch Time Series Feature Learning for EEG-based Sleep Stage Classification

Heterogeneous Multi-task Semantic Feature Learning for Classification

Selective multi–view time–frequency decomposed spatial feature matrix for motor imagery EEG classification

Robust Estimator Based Adaptive Multi-Task Learning