Abstract:Emotion analysis is the key technology in human–computer emotional interaction and has gradually become a research hotspot in the field of artificial intelligence. The key problems of emotion analysis based on EEG are feature extraction and classifier design. The existing methods of emotion analysis mainly use machine learning and rely on manually extracted features. As an end-to-end method, deep learning can automatically extract EEG features and classify them. However, most of the deep learning models of emotion recognition based on EEG still need manual screening and data pre-processing, and the accuracy and convenience are not high enough. Therefore, this paper proposes a CNN-Bi-LSTM-Attention model to automatically extract the features and classify emotions based on EEG signals. The original EEG data are used as input, a CNN and a Bi-LSTM network are used for feature extraction and fusion, and then the electrode channel weights are balanced through the attention mechanism layer. Finally, the EEG signals are classified to different kinds of emotions. An emotion classification experiment based on EEG is conducted on the SEED dataset to evaluate the performance of the proposed model. The experimental results show that the method proposed in this paper can effectively classify EEG emotions. The method was assessed on two distinctive classification tasks, one with three and one with four target classes. The average ten-fold cross-validation classification accuracy of this method is 99.55% and 99.79%, respectively, corresponding to three and four classification tasks, which is significantly better than the other methods. It can be concluded that our method is superior to the existing methods in emotion recognition, which can be widely used in many fields, including modern neuroscience, psychology, neural engineering, and computer science as well.

Comparison of Complex Emotion Detection Based on the Basic Emotion Model and the Complex Emotion Model.

Recognizing, Fast and Slow: Complex Emotion Recognition with Facial Expression Detection and Remote Physiological Measurement

The Study of a Five-Dimensional Emotional Model for Facial Emotion Recognition

Comparison of Facial Emotion Recognition Based on Image Visual Features and EEG Features

Multimodal Emotion Recognition by Combining Physiological Signals and Facial Expressions: a Preliminary Study.

Expression Analysis Based on Face Regions in Real-world Conditions.

Expression Analysis Based on Face Regions in Read-world Conditions

Valence-Arousal Model based Emotion Recognition using EEG, peripheral physiological signals and Facial Expression

Compound facial expressions recognition approach using DCGAN and CNN

Facial Emotion Recognition Combining Auxiliary Classifiers and Multiscale CBAM Attention Mechanisms

A Comparison of Methods of Facial Expression Recognition

Human Emotion Recognition Based on Face and Facial Expression Detection Using Deep Belief Network Under Complicated Backgrounds

A study on computer vision for facial emotion recognition

Multimodal Emotion Recognition From EEG Signals and Facial Expressions

A Robust Lightweight Compound Emotion Recognition Approach Using Depthwise Separable CNN

EEG-based emotion recognition using simple recurrent units network and ensemble learning

EEG-Based Emotion Recognition by Exploiting Fused Network Entropy Measures of Complex Networks Across Subjects.

Perceptual learning and recognition confusion reveal the underlying relationships among the six basic emotions.

Comparing Recognition Performance and Robustness of Multimodal Deep Learning Models for Multimodal Emotion Recognition

Spatio-temporal deep forest for emotion recognition based on facial electromyography signals

A Model for EEG-Based Emotion Recognition: CNN-Bi-LSTM with Attention Mechanism