Abstract:Electroencephalograms (EEG)-based technology for recognizing emotions has attracted a lot of interest lately. However, there is still work to be done on the efficient fusion of different temporal and spatial features of EEG signals to improve performance in emotion recognition. Therefore, this study suggests a new deep learning architecture that combines a time–frequency convolutional neural network (TFCNN), a bidirectional gated recurrent unit (BiGRU), and a self-attention mechanism (SAM) to categorize emotions based on EEG signals and automatically extract features. The first step is to use the continuous wavelet transform (CWT), which responds more readily to temporal frequency variations within EEG recordings, as a layer inside the convolutional layers, to create 2D scalogram images from EEG signals for time series and spatial representation learning. Second, to encode more discriminative features representing emotions, two-dimensional (2D)-CNN, BiGRU, and SAM are trained on these scalograms simultaneously to capture the appropriate information from spatial, local, temporal, and global aspects. Finally, EEG signals are categorized into several emotional states. This network can learn the temporal dependencies of EEG emotion signals with BiGRU, extract local spatial features with TFCNN, and improve recognition accuracy with SAM, which is applied to explore global signal correlations by reassigning weights to emotion features. Using the SEED and GAMEEMO datasets, the suggested strategy was evaluated on three different classification tasks: one with two target classes (positive and negative), one with three target classes (positive, neutral, and negative), and one with four target classes (boring, calm, horror, and funny). Based on the comprehensive results of the experiments, the suggested approach achieved a 93.1%, 96.2%, and 92.9% emotion detection accuracy in two, three, and four classes, respectively, which are 0.281%, 1.98%, and 2.57% higher than the existing approaches working on the same datasets for different subjects, respectively. The open source codes are available at https://www.mathworks.com/matlabcentral/fileexchange/165126-tfcnn-bigru

ECG-Based Automated Emotion Recognition Using Temporal Convolution Neural Networks

Temporal Convolutional Network-Enhanced Real-Time Implicit Emotion Recognition with an Innovative Wearable fNIRS-EEG Dual-Modal System

A new data augmentation convolutional neural network for human emotion recognition based on ECG signals

Emotion Recognition Using Electrodermal Activity Signals and Multiscale Deep Convolution Neural Network

TFCNN-BiGRU with self-attention mechanism for automatic human emotion recognition using multi-channel EEG data

A new deep convolutional neural network incorporating attentional mechanisms for ECG emotion recognition

Emotion recognition with convolutional neural network and EEG-based EFDMs

Convolutional Neural Networks on EEG-Based Emotion Recognition.

A 3D Convolutional Neural Network for Emotion Recognition Based on EEG Signals.

Electroencephalogram-based emotion recognition using factorization temporal separable convolution network

Spatial-temporal features-based EEG emotion recognition using graph convolution network and long short-term memory

Emotion Recognition Using Electrodermal Activity Signals and Multiscale Deep Convolutional Neural Network

Multi-Channel EEG Based Emotion Recognition Using Temporal Convolutional Network and Broad Learning System

Accurate EEG-Based Emotion Recognition on Combined Features Using Deep Convolutional Neural Networks.

Emotion recognition using effective connectivity and pre-trained convolutional neural networks in EEG signals

Arousal-Valence Classification from Peripheral Physiological Signals Using Long Short-Term Memory Networks

Exploring Deep Learning Features for Automatic Classification of Human Emotion Using EEG Rhythms

ECG-based emotion recognition using random convolutional kernel method

Deep Convolutional Neural Network For Emotion Recognition Using Eeg And Peripheral Physiological Signal

EEG-based Emotion Recognition via Channel-wise Attention and Self Attention

EEG-Based Emotion Recognition by Convolutional Neural Network with Multi-Scale Kernels