Abstract:Emotions are important factors in decision-making. With the advent of brain-computer interface (BCI) techniques, researchers developed a strong interest in predicting decisions based on emotions, which is a challenging task. To predict decision-making performance using emotion, we have proposed the Maximizing Mutual Information between Emotion and Decision relevant features (MMI-ED) method, with three modules: (1) Temporal-spatial encoding module captures spatial correlation and temporal dependence from electroencephalogram (EEG) signals; (2) Relevant feature decomposition module extracts emotion-relevant features and decision-relevant features; (3) Relevant feature fusion module maximizes the mutual information to incorporate useful emotion-related feature information during the decision-making prediction process. To construct a dataset that uses emotions to predict decision-making performance, we designed an experiment involving emotion elicitation and decision-making tasks and collected EEG, behavioral, and subjective data. We performed a comparison of our model with several emotion recognition and motion imagery models using our dataset. The results demonstrate that our model achieved state-of-the-art performance, achieving a classification accuracy of 92.96<inline-formula><tex-math notation="LaTeX">$\%$</tex-math><alternatives><mml:math><mml:mo>%</mml:mo></mml:math><inline-graphic xlink:href="wang-ieq1-3329526.gif"/></alternatives></inline-formula>. This accuracy is 6.83<inline-formula><tex-math notation="LaTeX">$\%$</tex-math><alternatives><mml:math><mml:mo>%</mml:mo></mml:math><inline-graphic xlink:href="wang-ieq2-3329526.gif"/></alternatives></inline-formula> higher than the best-performing model. Furthermore, we conducted an ablation study to demonstrate the validity of each module and provided explanations for the brain regions associated with the relevant features.

Behavioral Analysis of EEG Signals in Loss-Gain Decision-Making Experiments

Event-related Potentials and the Decision Making under Risk and Ambiguity

Use of Electroencephalography for the Study of Gain–Loss Asymmetry in Intertemporal Decision-Making

Activation of the DLPFC Reveals an Asymmetric Effect in Risky Decision Making: Evidence from a Tdcs Study

Time-frequency Analysis of Electroencephalogram Signals in a Cognitive Decision-making Task

Study on Game Theory and Model of ERP Based on EEG

Electrophysiological indexes of option characteristic processing.

Altered Neural Correlates of Optimal Decision-Making in Individuals with Depressive Status.

An Electrophysiological Index of Changes in Risk Decision-Making Strategies.

Predicting the Behavioural Tendency of Loss Aversion

Single-Trial Eeg-Informed Fmri Analysis of Emotional Decision Problems in Hot Executive Function

Discrimination of Decision Confidence Levels from EEG Signals

Feedback-related Brain Activity in Individual Decision: Evidence from a Gambling EEG Study.

The electrophysiology and structural difference between humans with distinct risky preference: a study based on EEG and MRI

Decision-Feedback Stages Revealed by Hidden Markov Modeling of EEG.

Enhancing EEG-Based Decision-Making Performance Prediction by Maximizing Mutual Information Between Emotion and Decision-Relevant Features

Decomposing loss aversion from a single neural signal

Asymmetric Valuation and Belief Updating over Gain and Loss in Risky Decision Making: A Behavioral and Electrophysiological Investigation.

The Different Patterns of Reward Magnitude: A Scalp EEG Research.

The Neural Dynamics of Loss Aversion

The intuitive decision preference and EEG features based on commonality heuristic