Abstract:Fully supervised learning has recently achieved promising performance in various electroencephalography (EEG) learning tasks by training on large datasets with ground truth labels. However, labeling EEG data for affective experiments is challenging, as it can be difficult for participants to accurately distinguish between similar emotions, resulting in ambiguous labeling (reporting multiple emotions for one EEG instance). This notion could cause model performance degradation, as the ground truth is hidden within multiple candidate labels. To address this issue, Partial Label Learning (PLL) has been proposed to identify the ground truth from candidate labels during the training phase, and has shown good performance in the computer vision domain. However, PLL methods have not yet been adopted for EEG representation learning or implemented for emotion recognition tasks. In this paper, we adapt and re-implement six state-of-the-art PLL approaches for emotion recognition from EEG on a large emotion dataset (SEED-V, containing five emotion classes). We evaluate the performance of all methods in classical and real-world experiments. The results show that PLL methods can achieve strong results in affective computing from EEG and achieve comparable performance to fully supervised learning. We also investigate the effect of label disambiguation, a key step in many PLL methods. The results show that in most cases, label disambiguation would benefit the model when the candidate labels are generated based on their similarities to the ground truth rather than obeying a uniform distribution. This finding suggests the potential of using label disambiguation-based PLL methods for real-world affective tasks. We make the source code of this paper publicly available at: <a class="link-external link-https" href="https://github.com/guangyizhangbci/PLL-Emotion-EEG" rel="external noopener nofollow">this https URL</a>.

Label-less Learning for Emotion Cognition

Emotion Detection in Online Social Networks: A Multilabel Learning Approach

Attention-Enhanced Connectionist Temporal Classification for Discrete Speech Emotion Recognition

Toward Label-Efficient Emotion and Sentiment Analysis

Latent Emotion Memory for Multi-Label Emotion Classification

Leveraging Label Information for Multimodal Emotion Recognition

Label-Efficient Emotion and Sentiment Analysis

Multi-label Class Incremental Emotion Decoding with Augmented Emotional Semantics Learning

Learning to Label with Active Learning and Reinforcement Learning.

Self supervised learning based emotion recognition using physiological signals

Label Distribution Changing Learning with Sample Space Expanding

Label Distribution Learning on Auxiliary Label Space Graphs for Facial Expression Recognition

Self-supervised Exclusive-Inclusive Interactive Learning for Multi-label Facial Expression Recognition in the Wild

Facial Emotion Distribution Learning by Exploiting Low-Rank Label Correlations Locally

Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning

Adaptively Learning Facial Expression Representation via C-F Labels and Distillation

Self-Supervised EEG Representation Learning for Robust Emotion Recognition

Large Vision-Language Models as Emotion Recognizers in Context Awareness

Noisy label facial expression recognition via face-specific label distribution learning

Towards Label-Agnostic Emotion Embeddings

Partial Label Learning for Emotion Recognition from EEG