Abstract:Emotion analysis is the key technology in human–computer emotional interaction and has gradually become a research hotspot in the field of artificial intelligence. The key problems of emotion analysis based on EEG are feature extraction and classifier design. The existing methods of emotion analysis mainly use machine learning and rely on manually extracted features. As an end-to-end method, deep learning can automatically extract EEG features and classify them. However, most of the deep learning models of emotion recognition based on EEG still need manual screening and data pre-processing, and the accuracy and convenience are not high enough. Therefore, this paper proposes a CNN-Bi-LSTM-Attention model to automatically extract the features and classify emotions based on EEG signals. The original EEG data are used as input, a CNN and a Bi-LSTM network are used for feature extraction and fusion, and then the electrode channel weights are balanced through the attention mechanism layer. Finally, the EEG signals are classified to different kinds of emotions. An emotion classification experiment based on EEG is conducted on the SEED dataset to evaluate the performance of the proposed model. The experimental results show that the method proposed in this paper can effectively classify EEG emotions. The method was assessed on two distinctive classification tasks, one with three and one with four target classes. The average ten-fold cross-validation classification accuracy of this method is 99.55% and 99.79%, respectively, corresponding to three and four classification tasks, which is significantly better than the other methods. It can be concluded that our method is superior to the existing methods in emotion recognition, which can be widely used in many fields, including modern neuroscience, psychology, neural engineering, and computer science as well.

Exploring Discriminative Representations for Image Emotion Recognition with CNNs.

Learning Multi-level Representations for Image Emotion Recognition in the Deep Convolutional Network

Exploring Spatio-Temporal Representations by Integrating Attention-based Bidirectional-LSTM-RNNs and FCNs for Speech Emotion Recognition

Feature Discrimination and Diversification for Image Emotion Recognition

Dependency Exploitation: A Unified CNN-RNN Approach for Visual Emotion Recognition

A Saliency Detection and Gram Matrix Transform-Based Convolutional Neural Network for Image Emotion Classification.

The application of deep learning in computer vision: Facial emotion recognition based on convolutional neural network

Learning multi-level representations for affective image recognition

Interpretable Deep Neural Networks for Dimensional and Categorical Emotion Recognition in-the-wild

Image Emotion Recognition Based on Deep Neural Network

A supervised contrastive learning-based model for image emotion classification

Fine-Grained Facial Expression Analysis Using Dimensional Emotion Model

Emergence of Emotion Selectivity in Deep Neural Networks Trained to Recognize Visual Objects

A Model for EEG-Based Emotion Recognition: CNN-Bi-LSTM with Attention Mechanism

Affective Image Recognition with Multi-Attribute Knowledge in Deep Neural Networks

Correction To: Deep Transfer Learning for Image Emotion Analysis: Reducing Marginal and Joint Distribution Discrepancies Together

Emotion Recognition by Assisted Learning with Convolutional Neural Networks

EmoCAM: Toward Understanding What Drives CNN-based Emotion Recognition

A Novel Attention Based CNN Model for Emotion Intensity Prediction.

Discovering Affective Regions in Deep Convolutional Neural Networks for Visual Sentiment Prediction.