Abstract:Abstract Objective. The data scarcity problem in emotion recognition from electroencephalography (EEG) leads to difficulty in building an affective model with high accuracy using machine learning algorithms or deep neural networks. Inspired by emerging deep generative models, we propose three methods for augmenting EEG training data to enhance the performance of emotion recognition models. Approach. Our proposed methods are based on two deep generative models, variational autoencoder (VAE) and generative adversarial network (GAN), and two data augmentation ways, full and partial usage strategies. For the full usage strategy, all of the generated data are augmented to the training dataset without judging the quality of the generated data, while for the partial usage, only high-quality data are selected and appended to the training dataset. These three methods are called conditional Wasserstein GAN (cWGAN), selective VAE (sVAE), and selective WGAN (sWGAN). Main results. To evaluate the effectiveness of these proposed methods, we perform a systematic experimental study on two public EEG datasets for emotion recognition, namely, SEED and DEAP. We first generate realistic-like EEG training data in two forms: power spectral density and differential entropy. Then, we augment the original training datasets with a different number of generated realistic-like EEG data. Finally, we train support vector machines and deep neural networks with shortcut layers to build affective models using the original and augmented training datasets. The experimental results demonstrate that our proposed data augmentation methods based on generative models outperform the existing data augmentation approaches such as conditional VAE, Gaussian noise, and rotational data augmentation. We also observe that the number of generated data should be less than 10 times of the original training dataset to achieve the best performance. Significance. The augmented training datasets produced by our proposed sWGAN method significantly enhance the performance of EEG-based emotion recognition models.

Enhancing EEG Signal-Based Emotion Recognition with Synthetic Data: Diffusion Model Approach

Multi-view Domain-Adaptive Representation Learning for EEG-based Emotion Recognition

EEG Synthetic Data Generation Using Probabilistic Diffusion Models

Electroencephalogram Emotion Recognition Based on Dispersion Entropy Feature Extraction Using Random Oversampling Imbalanced Data Processing

EEG Data Augmentation for Emotion Recognition Using a Conditional Wasserstein GAN.

Data Augmentation for EEG-Based Emotion Recognition Using Generative Adversarial Networks

Data augmentation for enhancing EEG-based emotion recognition with deep generative models

EEG-Based Emotion Recognition Using Partial Directed Coherence Dense Graph Propagation

EEG Data Augmentation for Emotion Recognition with a Task-Driven GAN

Enhancing EEG Signal Generation through a Hybrid Approach Integrating Reinforcement Learning and Diffusion Models

A Graph Neural Network for EEG-Based Emotion Recognition With Contrastive Learning and Generative Adversarial Neural Network Data Augmentation

Enhanced Cross-Dataset Electroencephalogram-based Emotion Recognition using Unsupervised Domain Adaptation

Enhancing Emotion Detection with Non-invasive Multi-Channel EEG and Hybrid Deep Learning Architecture

PatchEMG: Few-shot EMG Signal Generation with Diffusion Models for Data Augmentation to Improve Classification Performance

A Preliminary Study on Augmenting Speech Emotion Recognition using a Diffusion Model

Dual-Encoder VAE-GAN With Spatiotemporal Features for Emotional EEG Data Augmentation

Effects of Data Augmentation Method Borderline-SMOTE on Emotion Recognition of EEG Signals Based on Convolutional Neural Network

Exploring Emotions in EEG: Deep Learning Approach with Feature Fusion

Emotion Recognition Using a Novel Granger Causality Quantifier and Combined Electrodes of EEG

EEG data augmentation for emotion recognition with a multiple generator conditional Wasserstein GAN

EEG emotion recognition approach using multi-scale convolution and feature fusion