Abstract:Objective. To take full advantage of both labeled data and unlabeled ones, the Graph Convolutional Network (GCN) was introduced in electroencephalography (EEG) based emotion recognition to achieve feature propagation. However, a single feature cannot represent the emotional state entirely and precisely due to the instability of the EEG signal and the complexity of the emotional state. In addition, the noise existing in the graph may affect the performance greatly. To solve these problems, it was necessary to introduce feature/similarity fusion and noise reduction strategies.Approach. A semi-supervised EEG emotion recognition model combining graph fusion, network enhancement, and feature fusion was proposed. Firstly, different features were extracted from EEG and then compacted by Principal Component Analysis (PCA), respectively. Secondly, a Sample-by-sample Similarity Matrix (SSM) was constructed based on each feature, and similarity network fusion (SNF) was adopted to fuse the graphs corresponding to different SSMs to take advantage of their complementarity. Then, Network Enhancement (NE) was performed on the fused graph to reduce the noise in it. Finally, GCN was performed on the concatenated features and the enhanced fused graph to achieve feature propagation.Main results. Experimental results demonstrated that: (a) When 5.30%of SEED and 7.20%of SEED-IV samples were chosen as the labeled samples, respectively, the minimum classification accuracy improvement achieved by the proposed scheme over state-of-the-art schemes were 1.52%on SEED and 13.14%on SEED-IV, respectively. (b) When 8.00%of SEED and 9.60%of SEED-IV samples were chosen as the labeled samples, respectively, the minimum training time reduction achieved by the proposed scheme over state-of-the-art schemes were 46.75 s and 22.55 s, respectively. (c) Graph fusion, network enhancement, and feature fusion all contributed to the performance enhancement. (d) The key hyperparameters that affect the performance were relatively few and easy to set to obtain outstanding performance.Significance. This paper demonstrated that the combination of graph fusion, network enhancement, and feature fusion help to enhance GCN-based EEG emotion recognition.

Computational Integrative Physiology: At the Convergence of the Life and Computational Sciences

EEG Emotion Recognition Based on Self-attention Dynamic Graph Neural Networks

Attention-based Temporal Graph Representation Learning for EEG-based Emotion Recognition

Temporal Convolutional Network-Enhanced Real-Time Implicit Emotion Recognition with an Innovative Wearable fNIRS-EEG Dual-Modal System

Emotion Recognition from EEG Signal Using CA-GCN

Multi-channel EEG-based emotion recognition via a multi-level features guided capsule network

EEG emotion recognition using fusion model of graph convolutional neural networks and LSTM

Semi-supervised EEG emotion recognition model based on enhanced graph fusion and GCN

Multi-domain fusion deep graph convolution neural network for EEG emotion recognition

Spatial-temporal features-based EEG emotion recognition using graph convolution network and long short-term memory

Fusion Graph Representation of EEG for Emotion Recognition

MAS-DGAT-Net: A dynamic graph attention network with multibranch feature extraction and staged fusion for EEG emotion recognition

TC-Net: A Transformer Capsule Network for EEG-based emotion recognition

PGCN: Pyramidal Graph Convolutional Network for EEG Emotion Recognition

Emotion recognition using spatial-temporal EEG features through convolutional graph attention network

EEG-based Emotion Recognition with Feature Fusion Networks.

An Efficient Graph Learning System for Emotion Recognition Inspired by the Cognitive Prior Graph of EEG Brain Network

DC-ASTGCN: EEG Emotion Recognition Based on Fusion Deep Convolutional and Adaptive Spatio-temporal Graph Convolutional Networks

A Multi-Dimensional Graph Convolution Network for EEG Emotion Recognition

Feature Fusion Based on Mutual-Cross-Attention Mechanism for EEG Emotion Recognition

EEG emotion recognition based on the attention mechanism and pre-trained convolution capsule network