Abstract:Human emotions are complex psychological and physiological responses to external stimuli. Correctly identifying and providing feedback on emotions is an important goal in human–computer interaction research. Compared to facial expressions, speech, or other physiological signals, using electroencephalogram (EEG) signals for the task of emotion recognition has advantages in terms of authenticity, objectivity, and high reliability; thus, it is attracting increasing attention from researchers. However, the current methods have significant room for improvement in terms of the combination of information exchange between different brain regions and time–frequency feature extraction. Therefore, this paper proposes an EEG emotion recognition network, namely, self-organized graph pesudo-3D convolution (SOGPCN), based on attention and spatiotemporal convolution. Unlike previous methods that directly construct graph structures for brain channels, the proposed SOGPCN method considers that the spatial relationships between electrodes in each frequency band differ. First, a self-organizing map is constructed for each channel in each frequency band to obtain the 10 most relevant channels to the current channel, and graph convolution is employed to capture the spatial relationships between all channels in the self-organizing map constructed for each channel in each frequency band. Then, pseudo-three-dimensional convolution combined with partial dot product attention is implemented to extract the temporal features of the EEG sequence. Finally, LSTM is employed to learn the contextual information between adjacent time-series data. Subject-dependent and subject-independent experiments are conducted on the SEED dataset to evaluate the performance of the proposed SOGPCN method, which achieves recognition accuracies of 95.26% and 94.22%, respectively, indicating that the proposed method outperforms several baseline methods.

STSNet: a Novel Spatio-Temporal-spectral Network for Subject-Independent EEG-based Emotion Recognition

EEG Emotion Recognition Based on Self-attention Dynamic Graph Neural Networks

SSTD: A Novel Spatio-Temporal Demographic Network for EEG-Based Emotion Recognition

SST-EmotionNet: Spatial-Spectral-Temporal based Attention 3D Dense Network for EEG Emotion Recognition

STAFNet: an adaptive multi-feature learning network via spatiotemporal fusion for EEG-based emotion recognition

S3T-Net: A novel electroencephalogram signals-oriented emotion recognition model

STM-Net Based Spatial-Temporal Multi-Modal Fusion Network for Emotion Recognition

A Novel Spatio-Temporal Field for Emotion Recognition Based on EEG Signals

MetaEmotionNet: Spatial–Spectral–Temporal-Based Attention 3-D Dense Network with Meta-Learning for EEG Emotion Recognition

Two-Stream Spectral-Temporal Denoising Network for End-to-End Robust EEG-Based Emotion Recognition

A spatiotemporal symmetrical transformer structure for EEG emotion recognition

From Regional to Global Brain: A Novel Hierarchical Spatial-Temporal Neural Network Model for EEG Emotion Recognition

Spatial-temporal Network for Fine-grained-level Emotion EEG Recognition

FBSTCNet: A Spatio-Temporal Convolutional Network Integrating Power and Connectivity Features for EEG-Based Emotion Decoding

Emotion recognition using spatial-temporal EEG features through convolutional graph attention network

EEG Emotion Recognition Network Based on Attention and Spatiotemporal Convolution

HASTF: a hybrid attention spatio-temporal feature fusion network for EEG emotion recognition

STILN: A novel spatial-temporal information learning network for EEG-based emotion recognition

Attention-based Spatio-Temporal Graphic LSTM for EEG Emotion Recognition

Emotion Classification from Multi-Channel EEG Signals Using HiSTN: A Hierarchical Graph-based Spatial-Temporal Approach

A Parallel Neural Networks for Emotion Recognition Based on EEG Signals