Abstract:Objective. To take full advantage of both labeled data and unlabeled ones, the Graph Convolutional Network (GCN) was introduced in electroencephalography (EEG) based emotion recognition to achieve feature propagation. However, a single feature cannot represent the emotional state entirely and precisely due to the instability of the EEG signal and the complexity of the emotional state. In addition, the noise existing in the graph may affect the performance greatly. To solve these problems, it was necessary to introduce feature/similarity fusion and noise reduction strategies.Approach. A semi-supervised EEG emotion recognition model combining graph fusion, network enhancement, and feature fusion was proposed. Firstly, different features were extracted from EEG and then compacted by Principal Component Analysis (PCA), respectively. Secondly, a Sample-by-sample Similarity Matrix (SSM) was constructed based on each feature, and similarity network fusion (SNF) was adopted to fuse the graphs corresponding to different SSMs to take advantage of their complementarity. Then, Network Enhancement (NE) was performed on the fused graph to reduce the noise in it. Finally, GCN was performed on the concatenated features and the enhanced fused graph to achieve feature propagation.Main results. Experimental results demonstrated that: (a) When 5.30%of SEED and 7.20%of SEED-IV samples were chosen as the labeled samples, respectively, the minimum classification accuracy improvement achieved by the proposed scheme over state-of-the-art schemes were 1.52%on SEED and 13.14%on SEED-IV, respectively. (b) When 8.00%of SEED and 9.60%of SEED-IV samples were chosen as the labeled samples, respectively, the minimum training time reduction achieved by the proposed scheme over state-of-the-art schemes were 46.75 s and 22.55 s, respectively. (c) Graph fusion, network enhancement, and feature fusion all contributed to the performance enhancement. (d) The key hyperparameters that affect the performance were relatively few and easy to set to obtain outstanding performance.Significance. This paper demonstrated that the combination of graph fusion, network enhancement, and feature fusion help to enhance GCN-based EEG emotion recognition.

Emotion Recognition Based on Electroencephalogram Using Semi-supervised Generative Adversarial Network

EEG Emotion Recognition Based on Self-attention Dynamic Graph Neural Networks

Generative Listener EEG for Speech Emotion Recognition Using Generative Adversarial Networks with Compressed Sensing

EEG Emotion Recognition Model Based on Attention and GAN

Semi-Supervised Dual-Stream Self-Attentive Adversarial Graph Contrastive Learning for Cross-Subject EEG-based Emotion Recognition

GANSER: A Self-supervised Data Augmentation Framework for EEG-based Emotion Recognition

Data Augmentation for EEG-Based Emotion Recognition Using Generative Adversarial Networks

A Graph Neural Network for EEG-Based Emotion Recognition With Contrastive Learning and Generative Adversarial Neural Network Data Augmentation

Semi-supervised EEG emotion recognition model based on enhanced graph fusion and GCN

Transfer EEG Emotion Recognition by Combining Semi-Supervised Regression with Bipartite Graph Label Propagation

EEG Data Augmentation for Emotion Recognition with a Task-Driven GAN

DAGAM: A domain adversarial graph attention model for subject independent EEG-based emotion recognition

SFT-SGAT: A semi-supervised fine-tuning self-supervised graph attention network for emotion recognition and consciousness detection

EEG Emotion Recognition Based on GADF and AMB‐CNN Model

Emotion Classification from Multi-Band Electroencephalogram Data Using Dynamic Simplifying Graph Convolutional Network and Channel Style Recalibration Module

Semi-supervised bipartite graph construction with active EEG sample selection for emotion recognition

EEG-Based Subject-Independent Emotion Recognition Using Gated Recurrent Unit and Minimum Class Confusion

Cross-subject emotion recognition in brain-computer interface based on frequency band attention graph convolutional adversarial neural networks

Emotion Recognition Based on EEG Using Generative Adversarial Nets and Convolutional Neural Network

Dual-Encoder VAE-GAN With Spatiotemporal Features for Emotional EEG Data Augmentation

MAS-DGAT-Net: A dynamic graph attention network with multibranch feature extraction and staged fusion for EEG emotion recognition