Abstract:Electroencephalogram (EEG), as a tool capable of objectively recording brain electrical signals during emotional expression, has been extensively utilized. Current technology heavily relies on datasets, with its performance being limited by the size of the dataset and the accuracy of its annotations. At the same time, unsupervised learning and contrastive learning methods largely depend on the feature distribution within datasets, thus requiring training tailored to specific datasets for optimal results. However, the collection of EEG signals is influenced by factors such as equipment, settings, individuals, and experimental procedures, resulting in significant variability. Consequently, the effectiveness of models is heavily dependent on dataset collection efforts conducted under stringent objective conditions. To address these challenges, we introduce a novel approach: employing a self‐supervised pre‐training model, to process data across different datasets. This model is capable of operating effectively across multiple datasets. The model conducts self‐supervised pre‐training without the need for direct access to specific emotion category labels, enabling it to pre‐train and extract universally useful features without predefined downstream tasks. To tackle the issue of semantic expression confusion, we employed a masked prediction model that guides the model to generate richer semantic information through learning bidirectional feature combinations in sequence. Addressing challenges such as significant differences in data distribution, we introduced adaptive clustering techniques that manage by generating pseudo‐labels across multiple categories. The model is capable of enhancing the expression of hidden features in intermediate layers during the self‐supervised training process, enabling it to learn common hidden features across different datasets. This study, by constructing a hybrid dataset and conducting extensive experiments, demonstrated two key findings: (1) our model performs best on multiple evaluation metrics; (2) the model can effectively integrate critical features from different datasets, significantly enhancing the accuracy of emotion recognition.

EEG-SCMM: Soft Contrastive Masked Modeling for Cross-Corpus EEG-Based Emotion Recognition

Multi-view Domain-Adaptive Representation Learning for EEG-based Emotion Recognition

Electroencephalogram Emotion Recognition Based on Empirical Mode Decomposition and Optimal Feature Selection.

Multi-Scale Masked Autoencoders for Cross-Session Emotion Recognition

A Cross-subject and Cross-modal Model for Multimodal Emotion Recognition

A Novel Multi-Source Contrastive Learning Approach for Robust Cross-Subject Emotion Recognition in Eeg Data

Joint Contrastive Learning with Feature Alignment for Cross-Corpus EEG-based Emotion Recognition

Multi-Source EEG Emotion Recognition via Dynamic Contrastive Domain Adaptation

Semi-Supervised Dual-Stream Self-Attentive Adversarial Graph Contrastive Learning for Cross-Subject EEG-based Emotion Recognition

MS-MDA: Multisource Marginal Distribution Adaptation for Cross-Subject and Cross-Session EEG Emotion Recognition

Masked self‐supervised pre‐training model for EEG‐based emotion recognition

Exploring EEG Features in Cross-Subject Emotion Recognition

Cross-Session EEG-Based Emotion Recognition Via Maximizing Domain Discrepancy

Self-Supervised EEG Representation Learning for Robust Emotion Recognition

Multi-Source and Multi-Representation Adaptation for Cross-Domain Electroencephalography Emotion Recognition

CLDTA: Contrastive Learning based on Diagonal Transformer Autoencoder for Cross-Dataset EEG Emotion Recognition

Emotion Recognition Using Cross-Modal Attention from Eeg and Facial Expression

Cross-Cultural Emotion Recognition with EEG and Eye Movement Signals Based on Multiple Stacked Broad Learning System

An Attention-Based Multi-Domain Bi-Hemisphere Discrepancy Feature Fusion Model for EEG Emotion Recognition

Multi-source Information-Shared Domain Adaptation for EEG Emotion Recognition.

GC-STCL: A Granger Causality-Based Spatial–Temporal Contrastive Learning Framework for EEG Emotion Recognition