Abstract:Electroencephalogram (EEG)-based emotion recognition has become a hot research field, with the most attention given to decoding three basic types of emotional states (i.e., positive, negative, and neutral) by EEG. Traditional EEG emotion recognition is a single feature input mode that cannot cover multiple feature information. For brain function networks, the feature extraction process is very cumbersome. There will also be individual differences in the characteristics of different subjects. Therefore, the theory of graph convolution and brain function connection is introduced into this research, and the multi-domain fusion features input deep graph convolution neural network (MdGCNN) is proposed in this paper. Pearson correlation is used to determine the adjacency matrix. The Sortpooling layer is employed as a bridge between the graph convolution neural layer and the normal neural network layer and sorts the node features in a consistent order. Based on analyzing the characteristics of a single electrode, the brain topology structure features are automatically extracted. Taking MdGCNN as the basic model and considering the method of minimizing the feature distance between the source and the target domain, we propose a transfer learning (TL) emotion recognition model for cross-subject called MdGCNN-TL. Meanwhile, MdGCNN-TL is extended to traverse the target domain of a single subject in a two-to-one domain form. According to the idea of principal component analysis, the transfer model with a high recognition effect is determined with the degree of subject correlation (SC), and MdGCNN-TL is upgraded to MdGCNN-TL-SC. Experimental analysis on the SEED dataset is performed to evaluate the proposed models. Further validation of the model is implemented on the DEAP dataset. The results show that the proposed model has achieved better performance in EEG emotion recognition.

Multi-channel EEG-based Emotion Recognition in the Presence of Noisy Labels

Multi-view Domain-Adaptive Representation Learning for EEG-based Emotion Recognition

Multi-channel EEG-based emotion recognition via a multi-level features guided capsule network

EEG Emotion Recognition Based on Self-attention Dynamic Graph Neural Networks

Emotion recognition from EEG based on multi-task learning with capsule network and attention mechanism

Electroencephalogram Emotion Recognition Based on Empirical Mode Decomposition and Optimal Feature Selection.

EEG emotion recognition based on the attention mechanism and pre-trained convolution capsule network

ICaps-ResLSTM: Improved Capsule Network and Residual LSTM for EEG Emotion Recognition.

Light-weight residual convolution-based capsule network for EEG emotion recognition

EEG-fNIRS-Based Emotion Recognition Using Graph Convolution and Capsule Attention Network

Enhanced deep capsule network for EEG-based emotion recognition

Self-Supervised EEG Representation Learning for Robust Emotion Recognition

Facial Emotion Recognition with Noisy Multi-task Annotations

EEG-based Emotion Recognition via Channel-wise Attention and Self Attention

DA-CapsNet: A multi-branch capsule network based on adversarial domain adaption for cross-subject EEG emotion recognition

TC-Net: A Transformer Capsule Network for EEG-based emotion recognition

EEG-Based Subject-Independent Emotion Recognition Using Gated Recurrent Unit and Minimum Class Confusion

Recognition of Emotions Using Multichannel EEG Data and DBN-GC-Based Ensemble Deep Learning Framework

Multi-domain fusion deep graph convolution neural network for EEG emotion recognition

Multi-channel EEG emotion recognition through residual graph attention neural network

Multidimensional Feature in Emotion Recognition Based on Multi-Channel EEG Signals.