Abstract:Emotion recognition is essential in the diagnosis and rehabilitation of various mental diseases. In the last decade, electroencephalogram (EEG)-based emotion recognition has been intensively investigated due to its prominative accuracy and reliability, and graph convolutional network (GCN) has become a mainstream model to decode emotions from EEG signals. However, the electrode relationship, especially long-range electrode dependencies across the scalp, may be underutilized by GCNs, although such relationships have been proven to be important in emotion recognition. The small receptive field makes shallow GCNs only aggregate local nodes. On the other hand, stacking too many layers leads to over-smoothing. To solve these problems, we propose the pyramidal graph convolutional network (PGCN), which aggregates features at three levels: local, mesoscopic, and global. First, we construct a vanilla GCN based on the 3D topological relationships of electrodes, which is used to integrate two-order local features; Second, we construct several mesoscopic brain regions based on priori knowledge and employ mesoscopic attention to sequentially calculate the virtual mesoscopic centers to focus on the functional connections of mesoscopic brain regions; Finally, we fuse the node features and their 3D positions to construct a numerical relationship adjacency matrix to integrate structural and functional connections from the global perspective. Experimental results on three public datasets indicate that PGCN enhances the relationship modelling across the scalp and achieves state-of-the-art performance in both subject-dependent and subject-independent scenarios. Meanwhile, PGCN makes an effective trade-off between enhancing network depth and receptive fields while suppressing the ensuing over-smoothing. Our codes are publicly accessible at <a class="link-external link-https" href="https://github.com/Jinminbox/PGCN" rel="external noopener nofollow">this https URL</a>.

Emotion Recognition from EEG Signal Using CA-GCN

Multi-view Domain-Adaptive Representation Learning for EEG-based Emotion Recognition

EEG-Based Emotion Recognition Using Partial Directed Coherence Dense Graph Propagation

CR-GCN: Channel-Relationships-Based Graph Convolutional Network for EEG Emotion Recognition

EEG-based Emotion Recognition via Channel-wise Attention and Self Attention

Recognition of Emotions Using Multichannel EEG Data and DBN-GC-Based Ensemble Deep Learning Framework

EEG-fNIRS-Based Emotion Recognition Using Graph Convolution and Capsule Attention Network

Spatial-temporal features-based EEG emotion recognition using graph convolution network and long short-term memory

Linking Multi-Layer Dynamical GCN With Style-Based Recalibration CNN for EEG-Based Emotion Recognition

EEG-based emotion recognition using an end-to-end regional-asymmetric convolutional neural network

Graph Convolutional Neural Network for EEG Emotion Recognition

EEG Signal Processing and Emotion Recognition Using Convolutional Neural Network

Cascaded Convolutional Recurrent Neural Networks for EEG Emotion Recognition Based on Temporal–Frequency–Spatial Features

Channel attention convolutional aggregation network based on video-level features for EEG emotion recognition

PGCN: Pyramidal Graph Convolutional Network for EEG Emotion Recognition

A Multi-Dimensional Graph Convolution Network for EEG Emotion Recognition

EEG-Based Emotion Recognition Using Trainable Adjacency Relation Driven Graph Convolutional Network

Graph Convolutional Network with Connectivity Uncertainty for EEG-based Emotion Recognition

EEG emotion recognition using fusion model of graph convolutional neural networks and LSTM

Multi-domain fusion deep graph convolution neural network for EEG emotion recognition

DC-ASTGCN: EEG Emotion Recognition Based on Fusion Deep Convolutional and Adaptive Spatio-temporal Graph Convolutional Networks