Abstract:Due to its convenience and safety, electroencephalography (EEG) data is one of the most widely used signals in motor imagery (MI) brain-computer interfaces (BCIs). In recent years, methods based on deep learning have been widely applied to the field of BCIs, and some studies have gradually tried to apply Transformer to EEG signal decoding due to its superior global information focusing ability. However, EEG signals vary from subject to subject. Based on Transformer, how to effectively use data from other subjects (source domain) to improve the classification performance of a single subject (target domain) remains a challenge. To fill this gap, we propose a novel architecture called MI-CAT. The architecture innovatively utilizes Transformer's self-attention and cross-attention mechanisms to interact features to resolve differential distribution between different domains. Specifically, we adopt a patch embedding layer for the extracted source and target features to divide the features into multiple patches. Then, we comprehensively focus on the intra-domain and inter-domain features by stacked multiple Cross-Transformer Blocks (CTBs), which can adaptively conduct bidirectional knowledge transfer and information exchange between domains. Furthermore, we also utilize two non-shared domain-based attention blocks to efficiently capture domain-dependent information, optimizing the features extracted from the source and target domains to assist in feature alignment. To evaluate our method, we conduct extensive experiments on two real public EEG datasets, Dataset IIb and Dataset IIa, achieving competitive performance with an average classification accuracy of 85.26% and 76.81%, respectively. Experimental results demonstrate that our method is a powerful model for decoding EEG signals and facilitates the development of the Transformer for brain-computer interfaces (BCIs).

EEG Classification with Transformer-Based Models

A Transformer-Based Approach Combining Deep Learning Network and Spatial-Temporal Information for Raw EEG Classification

Local and global convolutional transformer-based motor imagery EEG classification

Deep temporal networks for EEG-based motor imagery recognition

EEGformer: A transformer-based brain activity classification method using EEG signal

MI-CAT: A transformer-based domain adaptation network for motor imagery classification

A Novel Hybrid CNN-Transformer Model for EEG Motor Imagery Classification

CTNet: a convolutional transformer network for EEG-based motor imagery classification

EEGEncoder: Advancing BCI with Transformer-Based Motor Imagery Classification

Transformer-Based Network with Optimization for Cross-Subject Motor Imagery Identification

Multiscale Convolutional Transformer for EEG Classification of Mental Imagery in Different Modalities

EMPT: a sparsity Transformer for EEG-based motor imagery recognition

EEG-based Emotion Recognition Via Transformer Neural Architecture Search

MSVTNet: Multi-Scale Vision Transformer Neural Network for EEG-Based Motor Imagery Decoding

Seizure Prediction Based on Transformer Using Scalp Electroencephalogram

MEET: A Multi-Band EEG Transformer for Brain States Decoding.

Transformer-based Spatial-Temporal Feature Learning for EEG Decoding

Emotion Classification Based on Transformer and CNN for EEG Spatial–Temporal Feature Learning

Research on Emotion Classification Recognition Method Based on Vision Transformer Model

Transformer-based Ensemble Deep Learning Model for EEG-based Emotion Recognition

Transformers for EEG-Based Emotion Recognition: A Hierarchical Spatial Information Learning Model