Abstract:In the recent past, deep learning-based approaches have significantly improved the classification accuracy when compared to classical signal processing and machine learning based frameworks. But most of them were subject-dependent studies which were not able to generalize on the subject-independent tasks due to the inter-subject variability present in EEG data. In this work, a novel deep learning framework capable of doing subject-independent emotion recognition is presented, consisting of two parts. First, an unsupervised Long Short-Term Memory (LSTM) with channel-attention autoencoder is proposed for getting a subject-invariant latent vector subspace i.e., intrinsic variables present in the EEG data of each individual. Secondly, a convolutional neural network (CNN) with attention framework is presented for performing the task of subject-independent emotion recognition on the encoded lower dimensional latent space representations obtained from the proposed LSTM with channel-attention autoencoder. With the attention mechanism, the proposed approach could highlight the significant time-segments of the EEG signal, which contributes to the emotion under consideration as validated by the results. The proposed approach has been validated using publicly available datasets for EEG signals such as DEAP dataset, SEED dataset and CHB-MIT dataset. The proposed end-to-end deep learning framework removes the requirement of different hand engineered features and provides a single comprehensive task agnostic EEG analysis tool capable of performing various kinds of EEG analysis on subject independent data.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the individual difference problem existing in emotion recognition among different individuals. Specifically, when dealing with electroencephalogram (EEG) data, most traditional emotion recognition methods rely on data from specific individuals, which results in poor generalization ability of these methods when facing different individuals. This is because there is significant inter - subject variability in EEG data, making it difficult for a model trained on a specific individual to be effectively applied to other individuals. To overcome this challenge, this research proposes a new deep - learning framework aiming at achieving subject - independent emotion recognition. This framework consists of two parts: 1. **Unsupervised Long - Short - Term Memory Network (LSTM) and Channel - Attention Auto - encoder**: This part is used to extract a subject - invariant low - dimensional latent - space representation from EEG data, that is, the internal variables in each individual's EEG data. By using the channel - attention mechanism, the model can focus on the time segments that contribute the most to the emotion recognition task, thereby improving the robustness and accuracy of the model. 2. **Convolutional Neural Network (CNN) and Attention Framework**: This part is used to perform the subject - independent emotion recognition task on the basis of the low - dimensional latent - space representation obtained in the previous step. By combining the features extracted by the auto - encoder and the attention mechanism, the model can identify the key time segments of the EEG signal without supervision and learn to classify the signal under supervision. In general, the goal of this paper is to develop an end - to - end deep - learning framework. This framework can not only reduce the dependence on manually - designed features, but also provides a general EEG analysis tool that can perform various types of EEG analysis tasks without considering individual differences. The verification results of this method on multiple public data sets show its effectiveness and superiority.

Subject Independent Emotion Recognition using EEG Signals Employing Attention Driven Neural Networks

Multi-view Domain-Adaptive Representation Learning for EEG-based Emotion Recognition

Inter Subject Emotion Recognition Using Spatio-Temporal Features From EEG Signal

A Novel Deep-Learning Based Framework for Multi-Subject Emotion Recognition

Subject Adversarial Neural Network on EEG-Based Emotion Recognition

Subject-Independent Emotion Recognition of EEG Signals Based on Dynamic Empirical Convolutional Neural Network.

EEG-based Emotion Recognition via Channel-wise Attention and Self Attention

S-LSTM-ATT: a hybrid deep learning approach with optimized features for emotion recognition in electroencephalogram

Human Emotion Recognition with Electroencephalographic Multidimensional Features by Hybrid Deep Neural Networks

An Attention-Enhanced Retentive Broad Learning System for Subject-Generic Emotion Recognition from EEG Signals.

Deep learning framework for subject-independent emotion detection using wireless signals

Deep Sparse Autoencoder and Recursive Neural Network for EEG Emotion Recognition

A Systematic Exploration Of Deep Neural Networks For Eda-Based Emotion Recognition

Investigating the Use of Pretrained Convolutional Neural Network on Cross-Subject and Cross-Dataset EEG Emotion Recognition

CNN and LSTM based ensemble learning for human emotion recognition using EEG recordings

Emotion Recognition Using Electrodermal Activity Signals and Multiscale Deep Convolution Neural Network

Cascaded Self-supervised Learning for Subject-independent EEG-based Emotion Recognition

EEG-Based Subject-Independent Emotion Recognition Using Gated Recurrent Unit and Minimum Class Confusion

An Efficient LSTM Network for Emotion Recognition from Multichannel EEG Signals

DAGAM: A domain adversarial graph attention model for subject independent EEG-based emotion recognition

An adaptive search optimizer-based deep Bi-LSTM for emotion recognition using electroencephalogram signal