Abstract:Electroencephalogram (EEG)-based emotion recognition has become a hot research field, with the most attention given to decoding three basic types of emotional states (i.e., positive, negative, and neutral) by EEG. Traditional EEG emotion recognition is a single feature input mode that cannot cover multiple feature information. For brain function networks, the feature extraction process is very cumbersome. There will also be individual differences in the characteristics of different subjects. Therefore, the theory of graph convolution and brain function connection is introduced into this research, and the multi-domain fusion features input deep graph convolution neural network (MdGCNN) is proposed in this paper. Pearson correlation is used to determine the adjacency matrix. The Sortpooling layer is employed as a bridge between the graph convolution neural layer and the normal neural network layer and sorts the node features in a consistent order. Based on analyzing the characteristics of a single electrode, the brain topology structure features are automatically extracted. Taking MdGCNN as the basic model and considering the method of minimizing the feature distance between the source and the target domain, we propose a transfer learning (TL) emotion recognition model for cross-subject called MdGCNN-TL. Meanwhile, MdGCNN-TL is extended to traverse the target domain of a single subject in a two-to-one domain form. According to the idea of principal component analysis, the transfer model with a high recognition effect is determined with the degree of subject correlation (SC), and MdGCNN-TL is upgraded to MdGCNN-TL-SC. Experimental analysis on the SEED dataset is performed to evaluate the proposed models. Further validation of the model is implemented on the DEAP dataset. The results show that the proposed model has achieved better performance in EEG emotion recognition.

Association Extraction and Recognition of Multiple Emotion Expressed in Social Texts

Emotion Detection in Online Social Networks: A Multilabel Learning Approach

A Novel and Powerful Dual-Stream Multi-Level Graph Convolution Network for Emotion Recognition

Emotion Recognition in Social Network Texts Based on A Multilingual Architecture

Emotion Detection In Online Social Network Based On Multi-Label Learning

Affect-GCN: a multimodal graph convolutional network for multi-emotion with intensity recognition and sentiment analysis in dialogues

Graph Convolutional Network with Connectivity Uncertainty for EEG-based Emotion Recognition

Exploiting Visual Context and Multi-grained Semantics for Social Text Emotion Recognition

Multiple graph convolutional networks for aspect-based sentiment analysis

A Multi-Dimensional Graph Convolution Network for EEG Emotion Recognition

A multi-modal and multi-scale emotion-enhanced inference model based on fuzzy recognition

A Two-Stage Multi-Modal Multi-Label Emotion Recognition Decision System Based on GCN

Multimodal Emotion Classification with Multi-Level Semantic Reasoning Network

Speech Emotion Recognition Based on Temporal-Spatial Learnable Graph Convolutional Neural Network

Multi-View Speech Emotion Recognition Via Collective Relation Construction

Multi-domain fusion deep graph convolution neural network for EEG emotion recognition

MLGAT: multi-layer graph attention networks for multimodal emotion recognition in conversations

MFGCN: Multimodal fusion graph convolutional network for speech emotion recognition

Multimodal Emotion Recognition From EEG Signals and Facial Expressions

Conversational emotion recognition studies based on graph convolutional neural networks and a dependent syntactic analysis

MAS-DGAT-Net: A dynamic graph attention network with multibranch feature extraction and staged fusion for EEG emotion recognition