Abstract:EEG signals capture information through multi-channel electrodes and hold promising prospects for human emotion recognition. However, the presence of high levels of noise and the diverse nature of EEG signals pose significant challenges, leading to potential overfitting issues that further complicate the extraction of meaningful information. To address this issue, we propose a Granger causal-based spatial–temporal contrastive learning framework, which significantly enhances the ability to capture EEG signal information by modeling rich spatial–temporal relationships. Specifically, in the spatial dimension, we employ a sampling strategy to select positive sample pairs from individuals watching the same video. Subsequently, a Granger causality test is utilized to enhance graph data and construct potential causality for each channel. Finally, a residual graph convolutional neural network is employed to extract features from EEG signals and compute spatial contrast loss. In the temporal dimension, we first apply a frequency domain noise reduction module for data enhancement on each time series. Then, we introduce the Granger–Former model to capture time domain representation and calculate the time contrast loss. We conduct extensive experiments on two publicly available sentiment recognition datasets (DEAP and SEED), achieving 1.65% improvement of the DEAP dataset and 1.55% improvement of the SEED dataset compared to state-of-the-art unsupervised models. Our method outperforms benchmark methods in terms of prediction accuracy as well as interpretability.

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is to improve the emotion recognition ability based on EEG signals. Specifically, the challenges mentioned in the paper include: 1. **Complex EEG channel spatial topological relationships**: Existing research usually determines the spatial topological relationships of channels only according to the physical distance between electrodes or channel correlations, which cannot accurately describe the complex causal relationships between EEG signals. Therefore, simple undirected graph modeling is difficult to capture the complex information transfer between these channels. 2. **High - noise interference**: During the EEG data collection process, the interference of internal emotions and external devices leads to a low signal - to - noise ratio of the signal, which is likely to cause model over - fitting. In addition, the high - time resolution of EEG signals requires a time - consuming and labor - intensive sample labeling process. Most supervised or semi - supervised methods are not effective when dealing with limited labeled training data. To address these challenges, the authors propose a Granger - causality - based spatio - temporal contrastive learning framework (GC - STCL). This framework enhances emotion recognition ability in the following ways: - **Spatial dimension**: Use the Granger - causality test to construct a directed graph, capture the causal relationships between EEG channels, and extract features through a residual graph convolutional neural network to calculate the spatial contrast loss. - ****Time dimension**: Adopt a frequency - domain noise reduction method to enhance the data, use the Granger - Former model to capture the time - domain representation, and calculate the time contrast loss. Through these methods, GC - STCL has achieved significant performance improvements on two publicly available emotion recognition datasets (DEAP and SEED), with improvements of 1.65% and 1.55% respectively, and is superior to the benchmark methods in terms of prediction accuracy and interpretability.

GC-STCL: A Granger Causality-Based Spatial–Temporal Contrastive Learning Framework for EEG Emotion Recognition

Attention-based Temporal Graph Representation Learning for EEG-based Emotion Recognition

Multi-view Domain-Adaptive Representation Learning for EEG-based Emotion Recognition

EEG-Based Emotion Recognition Using Spatial-Temporal Graph Convolutional LSTM with Attention Mechanism.

Spatial-temporal features-based EEG emotion recognition using graph convolution network and long short-term memory

Emotion recognition of EEG signals based on contrastive learning graph convolutional model

Electroencephalogram Emotion Recognition Based on Empirical Mode Decomposition and Optimal Feature Selection.

Subject-independent EEG emotion recognition with hybrid spatio-temporal GRU-Conv architecture

Hybrid Network Using Dynamic Graph Convolution and Temporal Self-Attention for EEG-Based Emotion Recognition.

Cascaded Convolutional Recurrent Neural Networks for EEG Emotion Recognition Based on Temporal–Frequency–Spatial Features

Multi-Domain Encoding of Spatiotemporal Dynamics in EEG for Emotion Recognition

Semi-Supervised Dual-Stream Self-Attentive Adversarial Graph Contrastive Learning for Cross-Subject EEG-based Emotion Recognition

Spatiotemporal Gated Graph Transformer for EEG-Based Emotion Recognition

Improved Graph Convolutional Neural Networks Based on Granger Causality Analysis for EEG Emotion Recognition

A model for electroencephalogram emotion recognition: Residual block-gated recurrent unit with attention mechanism

EEG-SCMM: Soft Contrastive Masked Modeling for Cross-Corpus EEG-Based Emotion Recognition

Attention-based Spatio-Temporal Graphic LSTM for EEG Emotion Recognition

Parallel Sequence-Channel Projection Convolutional Neural Network for EEG-Based Emotion Recognition

Temporal-spatial Representation Learning Transformer for EEG-based Emotion Recognition

Feature Hypergraph Representation Learning on Spatial-Temporal Correlations for EEG Emotion Recognition

Contrastive Learning of Subject-Invariant EEG Representations for Cross-Subject Emotion Recognition