Abstract:Emotions are important factors in decision-making. With the advent of brain-computer interface (BCI) techniques, researchers developed a strong interest in predicting decisions based on emotions, which is a challenging task. To predict decision-making performance using emotion, we have proposed the Maximizing Mutual Information between Emotion and Decision relevant features (MMI-ED) method, with three modules: (1) Temporal-spatial encoding module captures spatial correlation and temporal dependence from electroencephalogram (EEG) signals; (2) Relevant feature decomposition module extracts emotion-relevant features and decision-relevant features; (3) Relevant feature fusion module maximizes the mutual information to incorporate useful emotion-related feature information during the decision-making prediction process. To construct a dataset that uses emotions to predict decision-making performance, we designed an experiment involving emotion elicitation and decision-making tasks and collected EEG, behavioral, and subjective data. We performed a comparison of our model with several emotion recognition and motion imagery models using our dataset. The results demonstrate that our model achieved state-of-the-art performance, achieving a classification accuracy of 92.96<inline-formula><tex-math notation="LaTeX">$\%$</tex-math><alternatives><mml:math><mml:mo>%</mml:mo></mml:math><inline-graphic xlink:href="wang-ieq1-3329526.gif"/></alternatives></inline-formula>. This accuracy is 6.83<inline-formula><tex-math notation="LaTeX">$\%$</tex-math><alternatives><mml:math><mml:mo>%</mml:mo></mml:math><inline-graphic xlink:href="wang-ieq2-3329526.gif"/></alternatives></inline-formula> higher than the best-performing model. Furthermore, we conducted an ablation study to demonstrate the validity of each module and provided explanations for the brain regions associated with the relevant features.

Predicting rock-paper-scissors choices based on single-trial EEG signals

Predicting individual decision-making responses based on single-trial EEG

Time-frequency Analysis of EEG During Gaming Process and Decision Prediction Based on Optimized Features

Time-frequency Analysis of Electroencephalogram Signals in a Cognitive Decision-making Task

Single-trial prediction of a Go / NoGo decision using human EEG

Prediction of Decision-Making Response in Ultimatum Game by Constructing Regularized Common Spatial Network Pattern Based on Phase Locking Value

Discriminability of Single-Trial EEG During Decision-Making of Cooperation or Aggression: a Study Based on Machine Learning.

Predicting individual decision-making responses based on the functional connectivity of resting-state EEG.

Discrimination of Decision Confidence Levels from EEG Signals

Space-CNN: a decision classification method based on EEG signals from different brain regions

Rapid Face Recognition Based On Single-Trial Event-Related Potential Detection Over Multiple Brains

Behavioral Analysis of EEG Signals in Loss-Gain Decision-Making Experiments

Single-Trial Eeg-Informed Fmri Analysis of Emotional Decision Problems in Hot Executive Function

Unveiling the secrets of online consumer choice: A deep learning algorithmic approach to evaluate and predict purchase decisions through EEG responses

A Novel Eeg Signal Recognition Method Using Modified Optimal Electrodes Recombination Strategy

Predicting human decision making in psychological tasks with recurrent neural networks.

Predicting human decision making in psychological tasks with recurrent neural networks

Enhancing EEG-Based Decision-Making Performance Prediction by Maximizing Mutual Information Between Emotion and Decision-Relevant Features

An Electrophysiological Index of Changes in Risk Decision-Making Strategies.

Multi-AI competing and winning against humans in iterated Rock-Paper-Scissors game

Neuro-Behavioral Dynamic Prediction of Interpersonal Cooperation and Aggression