Abstract:The recognition of emotions is one of the most challenging issues in human-computer interaction (HCI). EEG signals are widely adopted as a method for recognizing emotions because of their ease of acquisition, mobility, and convenience. Deep neural networks (DNN) have provided excellent results in emotion recognition studies. Most studies, however, use other methods to extract handcrafted features, such as Pearson correlation coefficient (PCC), Principal Component Analysis, Higuchi Fractal Dimension (HFD), etc., even though DNN is capable of generating meaningful features. Furthermore, most earlier studies largely ignored spatial information between the different channels, focusing mainly on time domain and frequency domain representations. This study utilizes a pre-trained 3D-CNN MobileNet model with transfer learning on the spatio-temporal representation of EEG signals to extract features for emotion recognition. In addition to fully connected layers, hybrid models were explored using other decision layers such as multilayer perceptron (MLP), k-nearest neighbor (KNN), extreme learning machine (ELM), XGBoost (XGB), random forest (RF), and support vector machine (SVM). Additionally, this study investigates the effects of post-processing or filtering output labels. Extensive experiments were conducted on the SJTU Emotion EEG Dataset (SEED) (three classes) and SEED-IV (four classes) datasets, and the results obtained were comparable to the state-of-the-art. Based on the conventional 3D-CNN with ELM classifier, SEED and SEED-IV datasets showed a maximum accuracy of 89.18% and 81.60%, respectively. Post-filtering improved the emotional classification performance in the hybrid 3D-CNN with ELM model for SEED and SEED-IV datasets to 90.85% and 83.71%, respectively. Accordingly, spatial-temporal features extracted from the EEG, along with ensemble classifiers, were found to be the most effective in recognizing emotions compared to state-of-the-art methods.

Improved performance with novel utility functions in a game-theoretic model of medium access control in wireless networks

EEG Emotion Recognition Based on Self-attention Dynamic Graph Neural Networks

Multi-view Domain-Adaptive Representation Learning for EEG-based Emotion Recognition

Attention-based Temporal Graph Representation Learning for EEG-based Emotion Recognition

Emotion recognition using hierarchical spatial-temporal learning transformer from regional to global brain

Emotion Recognition via Environmental Context and Human Body

Transformers for EEG-Based Emotion Recognition: A Hierarchical Spatial Information Learning Model

EEG-based emotion recognition using an end-to-end regional-asymmetric convolutional neural network

Enhancing local representation learning through global-local integration with functional connectivity for EEG-based emotion recognition

Control of torpor and body weight patterns by a seasonal timer in Siberian hamsters.

Emotion recognition based on brain-like multimodal hierarchical perception

A model for electroencephalogram emotion recognition: Residual block-gated recurrent unit with attention mechanism

Multi-domain fusion deep graph convolution neural network for EEG emotion recognition

Multidimensional Feature in Emotion Recognition Based on Multi-Channel EEG Signals.

Spatial-temporal features-based EEG emotion recognition using graph convolution network and long short-term memory

Emotion Recognition from Spatio-Temporal Representation of EEG Signals via 3D-CNN with Ensemble Learning Techniques

[Estimation of model parameters for the pyruvate kinase reaction from kinetic data].

The immunopathogenesis and regulation of T-cell-mediated demyelinating diseases.

Cascaded Convolutional Recurrent Neural Networks for EEG Emotion Recognition Based on Temporal–Frequency–Spatial Features

Linking Multi-Layer Dynamical GCN With Style-Based Recalibration CNN for EEG-Based Emotion Recognition

Subject-independent EEG emotion recognition with hybrid spatio-temporal GRU-Conv architecture