Abstract:Emotion is the human brain reacting to objective things. In real life, human emotions are complex and changeable, so research into emotion recognition is of great significance in real life applications. Recently, many deep learning and machine learning methods have been widely applied in emotion recognition based on EEG signals. However, the traditional machine learning method has a major disadvantage in that the feature extraction process is usually cumbersome, which relies heavily on human experts. Then, end-to-end deep learning methods emerged as an effective method to address this disadvantage with the help of raw signal features and time-frequency spectrums. Here, we investigated the application of several deep learning models to the research field of EEG-based emotion recognition, including deep neural networks (DNN), convolutional neural networks (CNN), long short-term memory (LSTM), and a hybrid model of CNN and LSTM (CNN-LSTM). The experiments were carried on the well-known DEAP dataset. Experimental results show that the CNN and CNN-LSTM models had high classification performance in EEG-based emotion recognition, and their accurate extraction rate of RAW data reached 90.12 and 94.17%, respectively. The performance of the DNN model was not as accurate as other models, but the training speed was fast. The LSTM model was not as stable as the CNN and CNN-LSTM models. Moreover, with the same number of parameters, the training speed of the LSTM was much slower and it was difficult to achieve convergence. Additional parameter comparison experiments with other models, including epoch, learning rate, and dropout probability, were also conducted in the paper. Comparison results prove that the DNN model converged to optimal with fewer epochs and a higher learning rate. In contrast, the CNN model needed more epochs to learn. As for dropout probability, reducing the parameters by ~50% each time was appropriate.

EEG-Based Emotion Estimate Using Shallow Fully Convolutional Neural Network with Boost Training Strategy

Multi-view Domain-Adaptive Representation Learning for EEG-based Emotion Recognition

Using electroencephalogram for emotion recognition based on filter-bank long short-term memory networks

EEG emotion recognition approach using multi-scale convolution and feature fusion

Emotion recognition with convolutional neural network and EEG-based EFDMs

Accurate EEG-Based Emotion Recognition on Combined Features Using Deep Convolutional Neural Networks.

Electroencephalogram Access for Emotion Recognition Based on a Deep Hybrid Network

Deep Sparse Autoencoder and Recursive Neural Network for EEG Emotion Recognition

Channel attention convolutional aggregation network based on video-level features for EEG emotion recognition

Human Emotion Recognition with Electroencephalographic Multidimensional Features by Hybrid Deep Neural Networks

Convolutional Neural Networks on EEG-Based Emotion Recognition.

Cascaded Convolutional Recurrent Neural Networks for EEG Emotion Recognition Based on Temporal–Frequency–Spatial Features

A Channel-Fused Dense Convolutional Network for EEG-Based Emotion Recognition.

An Investigation of Deep Learning Models for EEG-Based Emotion Recognition.

An attention-based hybrid deep learning model for EEG emotion recognition

Parallel Sequence-Channel Projection Convolutional Neural Network for EEG-Based Emotion Recognition

EEG-Based Emotion Recognition by Convolutional Neural Network with Multi-Scale Kernels

A 3D Convolutional Neural Network for Emotion Recognition Based on EEG Signals.

A model for electroencephalogram emotion recognition: Residual block-gated recurrent unit with attention mechanism

A Feature-Fused Convolutional Neural Network for Emotion Recognition from Multichannel EEG Signals

Effects of Data Augmentation Method Borderline-SMOTE on Emotion Recognition of EEG Signals Based on Convolutional Neural Network