Abstract:Abstract Objective. The class imbalance problem considerably restricts the performance of electroencephalography (EEG) classification in the rapid serial visual presentation (RSVP) task. Existing solutions typically employ re-balancing strategies (e.g. re-weighting and re-sampling) to alleviate the impact of class imbalance, which enhances the classifier learning of deep networks but unexpectedly damages the representative ability of the learned deep features as original distributions become distorted. Approach. In this study, a novel decoupling representation learning (DRL) model, has been proposed that separates the representation learning and classification processes to capture the discriminative feature of imbalanced RSVP EEG data while classifying it accurately. The representation learning process is responsible for learning universal patterns for the classification of all samples, while the classifier determines a better bounding for the target and non-target classes. Specifically, the representation learning process adopts a dual-branch architecture, which minimizes the contrastive loss to regularize the representation space. In addition, to learn more discriminative information from RSVP EEG data, a novel multi-granular information (MGI) based extractor is designed to extract spatial-temporal information. Considering the class re-balancing strategies can significantly promote classifier learning, the classifier was trained with rebalanced EEG data while freezing the parameters of the representation learning process. Main results. To evaluate the proposed method, experiments were conducted on two public datasets and one self-conducted dataset. The results demonstrate that the proposed DRL can achieve state-of-the-art performance for EEG classification in the RSVP task. Significance. This is the first study to focus on the class imbalance problem and propose a generic solution in the RSVP task. Furthermore, multi-granular data was explored to extract more complementary spatial-temporal information. The code is open-source and available at https://github.com/Tammie-Li/DRL.

A Cross-Scale Transformer and Triple-View Attention Based Domain-Rectified Transfer Learning for EEG Classification in RSVP Tasks

A Temporal-Spectral Fusion Transformer with Subject-Specific Adapter for Enhancing RSVP-BCI Decoding

Multi-Task Collaborative Network: Bridge the Supervised and Self-Supervised Learning for EEG Classification in RSVP Tasks

Multi-source domain adaptation based tempo-spatial convolution network for cross-subject EEG classification in RSVP task

A Multi-Scale EEGNet for Cross-Subject RSVP-based BCI System.

Enhancing the EEG Classification in RSVP Task by Combining Interval Model of ERPs with Spatial and Temporal Regions of Interest.

A Convolution Network of Multi-Windows Spatial-Temporal Feature Analysis for Single-trial EEG Classification in RSVP Task

Low-Dimensional Subject Representation-Based Transfer Learning in EEG Decoding

A deep learning method for single-trial EEG classification in RSVP task based on spatiotemporal features of ERPs

A Dual-Branch Spatio-Temporal-Spectral Transformer Feature Fusion Network for EEG-Based Visual Recognition

Single-Trial EEG Classification Using Spatio-Temporal Weighting and Correlation Analysis for RSVP-Based Collaborative Brain Computer Interface.

Transformer-based Spatial-Temporal Feature Learning for EEG Decoding

Assembling global and local spatial-temporal filters to extract discriminant information of EEG in RSVP task

Cross Domain Correlation Maximization for Enhancing the Target Recognition of SSVEP-Based Brain-Computer Interfaces.

Decoupling Representation Learning for Imbalanced Electroencephalography Classification in Rapid Serial Visual Presentation Task

A novel deep transfer learning framework integrating general and domain-specific features for EEG-based brain–computer interface

Boosting Template-based SSVEP Decoding by Cross-domain Transfer Learning

Cross-Modal Transfer Learning From EEG to Functional Near-Infrared Spectroscopy for Classification Task in Brain-Computer Interface System

A Transformer-Based Approach Combining Deep Learning Network and Spatial-Temporal Information for Raw EEG Classification

An EEG Transfer Learning Algorithm Based on Mutual Information and Transfer Component Analysis

Cross-subject dual-domain fusion network with task-related and task-discriminant component analysis enhancing one-shot SSVEP classification.