Abstract:Emotions are important factors in decision-making. With the advent of brain-computer interface (BCI) techniques, researchers developed a strong interest in predicting decisions based on emotions, which is a challenging task. To predict decision-making performance using emotion, we have proposed the Maximizing Mutual Information between Emotion and Decision relevant features (MMI-ED) method, with three modules: (1) Temporal-spatial encoding module captures spatial correlation and temporal dependence from electroencephalogram (EEG) signals; (2) Relevant feature decomposition module extracts emotion-relevant features and decision-relevant features; (3) Relevant feature fusion module maximizes the mutual information to incorporate useful emotion-related feature information during the decision-making prediction process. To construct a dataset that uses emotions to predict decision-making performance, we designed an experiment involving emotion elicitation and decision-making tasks and collected EEG, behavioral, and subjective data. We performed a comparison of our model with several emotion recognition and motion imagery models using our dataset. The results demonstrate that our model achieved state-of-the-art performance, achieving a classification accuracy of 92.96<inline-formula><tex-math notation="LaTeX">$\%$</tex-math><alternatives><mml:math><mml:mo>%</mml:mo></mml:math><inline-graphic xlink:href="wang-ieq1-3329526.gif"/></alternatives></inline-formula>. This accuracy is 6.83<inline-formula><tex-math notation="LaTeX">$\%$</tex-math><alternatives><mml:math><mml:mo>%</mml:mo></mml:math><inline-graphic xlink:href="wang-ieq2-3329526.gif"/></alternatives></inline-formula> higher than the best-performing model. Furthermore, we conducted an ablation study to demonstrate the validity of each module and provided explanations for the brain regions associated with the relevant features.

Who Wins the Game of Thrones? How Sentiments Improve the Prediction of Candidate Choice

Competing With Artificial Intelligence Or Other Fans: Effects of Making Predictions About Game Outcome on Fans' Perceived Curiosity and Evaluations of Game Consumption

Measuring the Effect of Influential Messages on Varying Personas

Spectators Who Spectate and Voters Who Vote

Balance of thrones: a network study on Game of Thrones

Predicting Winners of the Reality TV Dating Show $\textit{The Bachelor}$ Using Machine Learning Algorithms

Predicting competitions by combining conditional logistic regression and subjective Bayes: An Academy Awards case study

Predicting wins and spread in the Premier League using a sentiment analysis of twitter

Scoring a forced-choice image-based assessment of personality: A comparison of machine learning, regression, and summative approaches

(DRAFT) personalized choice prediction with less user information

Understanding the Prediction Mechanism of Sentiments by XAI Visualization

Modeling undecided voters to forecast elections: From bandwagon behavior and the spiral of silence perspective

Enhancing EEG-Based Decision-Making Performance Prediction by Maximizing Mutual Information Between Emotion and Decision-Relevant Features

A Hybrid Method of Sentiment Analysis and Machine Learning Algorithm for the U.S. Presidential Election Forecasting

Party Prediction for Twitter

Psychological State in Text: A Limitation of Sentiment Analysis

Analyzing Social Exchange Motives With Theory-Driven Data and Machine Learning

Interpretable Real-Time Win Prediction for Honor of Kings, a Popular Mobile MOBA Esport

Looking for the Key to Winning: Psychophysiological Predicting Factors in Healthy University Students

Finding the Best Match - a Case Study on the (Text-)Feature and Model Choice in Digital Mental Health Interventions

Prediction of Listener Perception of Argumentative Speech in a Crowdsourced Dataset Using (Psycho-)Linguistic and Fluency Features