Abstract:Emotion recognition is a research area that spans multiple disciplines, including computational science, neuroscience, and cognitive psychology. The use of electroencephalogram (EEG) signals in emotion recognition is particularly promising due to their objective and nonartefactual nature. To effectively leverage the spatial information between electrodes, the temporal correlation of EEG sequences, and the various sub-bands of information corresponding to different emotions, we construct a 4D matrix comprising temporal–frequency–spatial features as the input to our proposed hybrid model. This model incorporates a residual network based on depthwise convolution (DC) and pointwise convolution (PC), which not only extracts the spatial–frequency information in the input signal, but also reduces the training parameters. To further improve performance, we apply frequency channel attention networks (FcaNet) to distribute weights to different channel features. Finally, we use a bidirectional long short-term memory network (Bi-LSTM) to learn the temporal information in the sequence in both directions. To highlight the temporal importance of the frame window in the sample, we choose the weighted sum of the hidden layer states at all frame moments as the input to softmax. Our experimental results demonstrate that the proposed method achieves excellent recognition performance. We experimentally validated all proposed methods on the DEAP dataset, which has authoritative status in the EEG emotion recognition domain. The average accuracy achieved was 97.84% for the four binary classifications of valence, arousal, dominance, and liking and 88.46% for the four classifications of high and low valence–arousal recognition.

Emotion recognition with convolutional neural network and EEG-based EFDMs

Using electroencephalogram for emotion recognition based on filter-bank long short-term memory networks

Electroencephalogram Emotion Recognition Based on Empirical Mode Decomposition and Optimal Feature Selection.

EEG emotion recognition approach using multi-scale convolution and feature fusion

Accurate EEG-Based Emotion Recognition on Combined Features Using Deep Convolutional Neural Networks.

Convolutional Neural Networks on EEG-Based Emotion Recognition.

Cross-Subject Eeg-Based Emotion Recognition With Deep Domain Confusion

Cascaded Convolutional Recurrent Neural Networks for EEG Emotion Recognition Based on Temporal–Frequency–Spatial Features

EEG Signal Processing and Emotion Recognition Using Convolutional Neural Network

Emotion Recognition From Multi-Channel EEG via Deep Forest

EEG-based emotion recognition using an end-to-end regional-asymmetric convolutional neural network

Human Emotion Recognition with Electroencephalographic Multidimensional Features by Hybrid Deep Neural Networks

EEG-Based Emotion Recognition Using a 2D CNN with Different Kernels

EEG-Based Emotion Recognition Fusing Spacial-Frequency Domain Features and Data-Driven Spectrogram-Like Features.

Emotion Recognition from Multi-Channel Eeg Data Through Convolutional Recurrent Neural Network

A model for electroencephalogram emotion recognition: Residual block-gated recurrent unit with attention mechanism

Deep Sparse Autoencoder and Recursive Neural Network for EEG Emotion Recognition

Deep Convolutional Neural Network For Emotion Recognition Using Eeg And Peripheral Physiological Signal

EEG emotion recognition using fusion model of graph convolutional neural networks and LSTM

EEG-based emotion recognition using 4D convolutional recurrent neural network

EEG-Based Emotion Recognition by Convolutional Neural Network with Multi-Scale Kernels