Abstract:Accurately measuring emotion is a major challenge in advancing the understanding of human emotion and developing emotional artificial intelligence. In many existing studies, participants' emotional ratings in interval scales are considered the true reflection of their emotional experiences. However, recent research suggests that ordinal annotations of emotions can more accurately capture the emotional expression process, providing a potential method for more precise emotion measurement. However, our understanding of the characteristics and validity of this new form of emotion representation is still relatively lacking. In particular, there is a lack of research using neural signals to explore the validity and neural basis of ordinal emotion representation. In this study, we used a video-elicited EEG dataset (n = 123) to identify the neural basis of ordinal emotion representation and demonstrate its validity from a neural perspective. Furthermore, we explored various characteristics of ordinal emotion representation, showing how it is superior to the interval form. First, we conducted inter-situation representational similarity analysis (RSA) and inter-subject RSA to test the degree to which ordinal representation captures both group commonalities and individual differences of emotion. Next, we investigated the characteristics of ordinal representation under different combinations of emotion items, including uni-variate and multivariate emotions, positive and negative emotions. Our results show that both group commonalities and inter-subject variations in EEG features are better explained by ordinal emotion representations than by interval ones. Multivariate ordinal representations showed better inter-subject reliability and higher representational similarity with EEG features compared to univariate counterparts, highlighting the co-occurrence nature of human emotions. Compared to negative emotions, ordinal representation showed greater improvements for positive emotions, suggesting that the complexity of positive emotions is well captured by ordinal representations. Taken together, these findings demonstrate that multivariate ordinal emotion ratings provide a more accurate measure of real emotional experience, which is crucial for enabling machines to precisely understand and express human emotions.

Electrophysiological Representations of Multivariate Human Emotion Experience

Exploring the Neural Basis and Validity of Ordinal Emotion Representation through EEG

The EEG Microstate Representation of Discrete Emotions.

Multimodal Affective State Assessment Using fNIRS + EEG and Spontaneous Facial Expression

Multi-modal emotion analysis from facial expressions and electroencephalogram.

Exploiting EEG signals and audiovisual feature fusion for video emotion recognition

EEG-based Approach for Recognizing Human Social Emotion Perception

Similar brains blend emotion in similar ways: Neural representations of individual difference in emotion profiles

EEG Microstates and Fnirs Metrics Reveal the Spatiotemporal Joint Neural Processing Features of Human Emotions

Neural Mechanisms of Social Emotion Perception: an EEG Hyper-Scanning Study

A novel methodology for emotion recognition through 62-lead EEG signals: multilevel heterogeneous recurrence analysis

Multi-Target Positive Emotion Recognition from EEG Signals

Inter-Brain EEG Feature Extraction and Analysis for Continuous Implicit Emotion Tagging During Video Watching

Multi-Domain Encoding of Spatiotemporal Dynamics in EEG for Emotion Recognition

Exploring EEG Features in Cross-Subject Emotion Recognition

Human Emotion Variation Analysis Based On Eeg Signal And Poms Scale

Multidimensional Feature in Emotion Recognition Based on Multi-Channel EEG Signals.

An Attention-Based Multi-Domain Bi-Hemisphere Discrepancy Feature Fusion Model for EEG Emotion Recognition

Human Emotion Recognition with Electroencephalographic Multidimensional Features by Hybrid Deep Neural Networks

Exploratory Cross-Frequency Coupling and Scaling Analysis of Neuronal Oscillations Stimulated by Emotional Images: an Evidence from EEG

Examining the Relationship between EEG Dynamics and Emotion Ratings during Video Watching using Adaptive Mixture Independent Component Analysis.