Abstract:Objective Electroencephalogram (EEG) analysis has always been an important tool in neural engineering, and the recognition and classification of human emotions are one of the important tasks in neural engineering. EEG data, obtained from electrodes placed on the scalp, represent a valuable resource of information for brain activity analysis and emotion recognition. Feature extraction methods have shown promising results, but recent trends have shifted toward end-to-end methods based on deep learning. However, these approaches often overlook channel representations, and their complex structures pose certain challenges to model fitting. Approach To address these challenges, this paper proposes a hybrid approach named FetchEEG that combines feature extraction and temporal-channel joint attention. Leveraging the advantages of both traditional feature extraction and deep learning, the FetchEEG adopts a multi-head self-attention mechanism to extract representations between different time moments and channels simultaneously. The joint representations are then concatenated and classified using fully-connected layers for emotion recognition. The performance of the FetchEEG is verified by comparison experiments on a self-developed dataset and two public datasets. Results In both subject-dependent and subject-independent experiments, the FetchEEG demonstrates better performance and stronger generalization ability than the state-of-the-art methods on all datasets. Moreover, the performance of the FetchEEG is analyzed for different sliding window sizes and overlap rates in the feature extraction module. The sensitivity of emotion recognition is investigated for three- and five-frequency-band scenarios. Finally, we perform visualization of the channel-attention to project the model's reliance on different channels onto scalp topographic maps. Significance FetchEEG is a novel hybrid method based on EEG for emotion classification, which significantly improves the performance of recognition and is effective and feasible.

An Affective EEG Analysis Method Without Feature Engineering

EEG Emotion Recognition Based on Self-attention Dynamic Graph Neural Networks

Using electroencephalogram for emotion recognition based on filter-bank long short-term memory networks

DRS-Net: A Spatial–temporal Affective Computing Model Based on Multichannel EEG Data

Design and Implementation of an Emotion Analysis System Based on EEG Signals

A Novel Spatio-Temporal Field for Emotion Recognition Based on EEG Signals

Emotion Feature Analysis and Recognition Based on Reconstructed EEG Sources

Toward EEG-Based Objective Assessment of Emotion Intensity

Emotional Analysis and Recognition Based on EEG Brain Network.

Spatial-temporal Network for Fine-grained-level Emotion EEG Recognition

HASTF: a hybrid attention spatio-temporal feature fusion network for EEG emotion recognition

E2ENNet: An end-to-end neural network for emotional brain-computer interface

An attention-based hybrid deep learning model for EEG emotion recognition

EEG-based Emotion Recognition via Channel-wise Attention and Self Attention

FetchEEG: a hybrid approach combining feature extraction and temporal-channel joint attention for EEG-based emotion classification

An Emotional Face Evoked EEG Signal Recognition Method Based on Optimal EEG Feature and Electrodes Selection

EEG-Based Emotion Estimate Using Shallow Fully Convolutional Neural Network with Boost Training Strategy

Hybrid Network Using Dynamic Graph Convolution and Temporal Self-Attention for EEG-Based Emotion Recognition.

Deep Sparse Autoencoder and Recursive Neural Network for EEG Emotion Recognition

Improving Emotion Analysis For Speech-Induced Eegs Through Eemd-Hht-Based Feature Extraction And Electrode Selection

A model for electroencephalogram emotion recognition: Residual block-gated recurrent unit with attention mechanism