Abstract:This paper proposes the use of Semi-supervised Generative Adversarial Network (SGAN) to take advantage of the large amount of unlabeled electroencephalogram (EEG) spectrogram data in improving the classifier's accuracy in emotion recognition. The use of SGAN led the discriminator network to not just learn in a supervised fashion from the small amount of labeled data to distinguish among the different target classes, but also make use of the true unlabeled data to distinguish them from the synthetic ones generated by the generator network. This additional ability to distinguish true and fake samples forces the network to focus only on features that are present on a true sample to distinguish the classes, thereby improving generalization and overall accuracy. An ablation study is devised, where the SGAN classifier is compared to a mere discriminator network without the GAN architecture. The 80% : 20% validation method was employed to classify the EEG spectrogram of 50 participants gathered by Kaohsiung Medical University into two emotion labels in the valence dimension: positive and negative. The proposed method achieved an accuracy of 84.83% given only 50% labeled data, which is not just better than the baseline discriminator network which achieved 83.5% accuracy, but is also better than many previous studies at accuracies around 78%. This demonstrates the ability of SGAN in improving discriminator network's accuracy by training it to also distinguish between the unlabeled true sample and synthetic data.Clinical Relevance- The use of EEG in emotion recognition has seen growing interest due to its ease of access. However, the large amount of labeled data required to train an accurate model has been the limiting factor as databases in the area of emotion recognition with EEG is still relatively small. This paper proposes the use of SGAN to allow using large amount of unlabeled EEG data to improve the recognition rate.

Conditional generative adversarial network for EEG-based emotion fine-grained estimation and visualization.

Expression Conditional Gan for Facial Expression-to-Expression Translation.

Attention-based Temporal Graph Representation Learning for EEG-based Emotion Recognition

Cgan Based Facial Expression Recognition for Human-Robot Interaction

EEG Emotion Recognition Based on Self-attention Dynamic Graph Neural Networks

EEG Data Augmentation for Emotion Recognition Using a Conditional Wasserstein GAN.

EEG data augmentation for emotion recognition with a multiple generator conditional Wasserstein GAN

Generative Listener EEG for Speech Emotion Recognition Using Generative Adversarial Networks with Compressed Sensing

EEG Data Augmentation for Emotion Recognition with a Task-Driven GAN

Emotion Recognition Based on Electroencephalogram Using Semi-supervised Generative Adversarial Network

EEG Emotion Recognition Model Based on Attention and GAN

Data Augmentation Using Conditional GANs for Facial Emotion Recognition

Temporal conditional Wasserstein GANs for audio-visual affect-related ties

Machine to brain: facial expression recognition using brain machine generative adversarial networks

A Graph Neural Network for EEG-Based Emotion Recognition With Contrastive Learning and Generative Adversarial Neural Network Data Augmentation

Generation of Artificial FO-contours of Emotional Speech with Generative Adversarial Networks

Dual-Encoder VAE-GAN With Spatiotemporal Features for Emotional EEG Data Augmentation

GAN-ACNN: a design decision-making algorithm based on EEG signals from different brain regions

GI-AEE - GAN Inversion Based Attentive Expression Embedding Network for Facial Expression Editing.

Expression-Guided Attention GAN for Fine-Grained Facial Expression Editing

Emotion Recognition Based on EEG Using Generative Adversarial Nets and Convolutional Neural Network