Abstract:Emotions are important factors in decision-making. With the advent of brain-computer interface (BCI) techniques, researchers developed a strong interest in predicting decisions based on emotions, which is a challenging task. To predict decision-making performance using emotion, we have proposed the Maximizing Mutual Information between Emotion and Decision relevant features (MMI-ED) method, with three modules: (1) Temporal-spatial encoding module captures spatial correlation and temporal dependence from electroencephalogram (EEG) signals; (2) Relevant feature decomposition module extracts emotion-relevant features and decision-relevant features; (3) Relevant feature fusion module maximizes the mutual information to incorporate useful emotion-related feature information during the decision-making prediction process. To construct a dataset that uses emotions to predict decision-making performance, we designed an experiment involving emotion elicitation and decision-making tasks and collected EEG, behavioral, and subjective data. We performed a comparison of our model with several emotion recognition and motion imagery models using our dataset. The results demonstrate that our model achieved state-of-the-art performance, achieving a classification accuracy of 92.96<inline-formula><tex-math notation="LaTeX">$\%$</tex-math><alternatives><mml:math><mml:mo>%</mml:mo></mml:math><inline-graphic xlink:href="wang-ieq1-3329526.gif"/></alternatives></inline-formula>. This accuracy is 6.83<inline-formula><tex-math notation="LaTeX">$\%$</tex-math><alternatives><mml:math><mml:mo>%</mml:mo></mml:math><inline-graphic xlink:href="wang-ieq2-3329526.gif"/></alternatives></inline-formula> higher than the best-performing model. Furthermore, we conducted an ablation study to demonstrate the validity of each module and provided explanations for the brain regions associated with the relevant features.

Relationship Between Decision-making and Resting-state EEG in Adolescents with Different Emotional Stabilities

Predicting individual decision-making responses based on the functional connectivity of resting-state EEG.

Single-Trial Eeg-Informed Fmri Analysis of Emotional Decision Problems in Hot Executive Function

The electrophysiology and structural difference between humans with distinct risky preference: a study based on EEG and MRI

The Role of Resting-State EEG Localized Activation and Central Nervous System Arousal in Executive Function Performance in Children with Attention-Deficit/Hyperactivity Disorder.

Author Response for "prediction of Dispositional Dialectical Thinking from Resting‐state Electroencephalography"

Time-frequency Analysis of Electroencephalogram Signals in a Cognitive Decision-making Task

The Growing from Adolescence to Adulthood Influences the Decision Strategy to Unfair Situations

Different Decision-Making Responses Occupy Different Brain Networks for Information Processing: A Study Based on EEG and TMS.

Pre-stimulus alpha activities predict the confidence in subjective judgment by modulating post-stimulus theta oscillation

Predicting individual decision-making responses based on single-trial EEG

The neural mechanisms underlying the modulation of attentional deployment on emotional stability

Frontal alpha asymmetry predicts subsequent social decision-making: A dynamic multilevel, neural, and developmental perspective

Prediction of dispositional dialectical thinking from resting‐state electroencephalography

Resting posterior alpha power and adolescent major depressive disorder

Resting-state network predicts the decision-making behaviors of the proposer during the ultimatum game

Differential effects of specific emotions on spatial decision-making: evidence from cross-frequency functionally independent brain networks

Predicting rock-paper-scissors choices based on single-trial EEG signals

Resting-State Alpha Activity in the Frontal and Occipital Lobes and Assessment of Cognitive Impairment in Depression Patients

Behavioral State-Dependent Associations Between EEG Temporal Correlations and Depressive Symptoms

Enhancing EEG-Based Decision-Making Performance Prediction by Maximizing Mutual Information Between Emotion and Decision-Relevant Features