Abstract:Objective. Emotion recognition on the basis of electroencephalography (EEG) signals has received a significant amount of attention in the areas of cognitive science and human-computer interaction (HCI). However, most existing studies either focus on one-dimensional EEG data, ignoring the relationship between channels, or only extract time-frequency features while not involving spatial features.Approach. We develop spatial-temporal features-based EEG emotion recognition using a graph convolution network (GCN) and long short-term memory (LSTM), named ERGL. First, the one-dimensional EEG vector is converted into a two-dimensional mesh matrix, so that the matrix configuration corresponds to the distribution of brain regions at EEG electrode locations, thus to represent the spatial correlation between multiple adjacent channels in a better way. Second, the GCN and LSTM are employed together to extract spatial-temporal features; the GCN is used to extract spatial features, while LSTM units are applied to extract temporal features. Finally, a softmax layer is applied to emotion classification.Main results. Extensive experiments are conducted on the A Dataset for Emotion Analysis using Physiological Signals (DEAP) and the SJTU Emotion EEG Dataset (SEED). The classification results of accuracy, precision, and F-score for valence and arousal dimensions on DEAP achieved 90.67% and 90.33%, 92.38% and 91.72%, and 91.34% and 90.86%, respectively. The accuracy, precision, and F-score of positive, neutral, and negative classifications reached 94.92%, 95.34%, and 94.17%, respectively, on the SEED dataset.Significance. The above results demonstrate that the proposed ERGL method is encouraging in comparison to state-of-the-art recognition research.

EEG-based emotion recognition with cascaded convolutional recurrent neural networks

Cascaded Convolutional Recurrent Neural Networks for EEG Emotion Recognition Based on Temporal–Frequency–Spatial Features

EEG-Based Emotion Recognition by Convolutional Neural Network with Multi-Scale Kernels

Emotion recognition with convolutional neural network and EEG-based EFDMs

EEG-Based Emotion Recognition Using Partial Directed Coherence Dense Graph Propagation

EEG-based emotion recognition using 4D convolutional recurrent neural network

EEG emotion recognition approach using multi-scale convolution and feature fusion

Using electroencephalogram for emotion recognition based on filter-bank long short-term memory networks

Accurate EEG-Based Emotion Recognition on Combined Features Using Deep Convolutional Neural Networks.

Deep Sparse Autoencoder and Recursive Neural Network for EEG Emotion Recognition

EEG emotion recognition using fusion model of graph convolutional neural networks and LSTM

A model for electroencephalogram emotion recognition: Residual block-gated recurrent unit with attention mechanism

EEG-based emotion recognition using an end-to-end regional-asymmetric convolutional neural network

Spatial-temporal features-based EEG emotion recognition using graph convolution network and long short-term memory

A 3D Convolutional Neural Network for Emotion Recognition Based on EEG Signals.

A Novel DE-CNN-BiLSTM Multi-Fusion Model for EEG Emotion Recognition

EEG Emotion Recognition Based on GADF and AMB‐CNN Model

Convolutional Neural Networks on EEG-Based Emotion Recognition.

An attention-based hybrid deep learning model for EEG emotion recognition

Human Emotion Recognition with Electroencephalographic Multidimensional Features by Hybrid Deep Neural Networks

EEG Signal Processing and Emotion Recognition Using Convolutional Neural Network