Abstract:Emotions are important factors in decision-making. With the advent of brain-computer interface (BCI) techniques, researchers developed a strong interest in predicting decisions based on emotions, which is a challenging task. To predict decision-making performance using emotion, we have proposed the Maximizing Mutual Information between Emotion and Decision relevant features (MMI-ED) method, with three modules: (1) Temporal-spatial encoding module captures spatial correlation and temporal dependence from electroencephalogram (EEG) signals; (2) Relevant feature decomposition module extracts emotion-relevant features and decision-relevant features; (3) Relevant feature fusion module maximizes the mutual information to incorporate useful emotion-related feature information during the decision-making prediction process. To construct a dataset that uses emotions to predict decision-making performance, we designed an experiment involving emotion elicitation and decision-making tasks and collected EEG, behavioral, and subjective data. We performed a comparison of our model with several emotion recognition and motion imagery models using our dataset. The results demonstrate that our model achieved state-of-the-art performance, achieving a classification accuracy of 92.96<inline-formula><tex-math notation="LaTeX">$\%$</tex-math><alternatives><mml:math><mml:mo>%</mml:mo></mml:math><inline-graphic xlink:href="wang-ieq1-3329526.gif"/></alternatives></inline-formula>. This accuracy is 6.83<inline-formula><tex-math notation="LaTeX">$\%$</tex-math><alternatives><mml:math><mml:mo>%</mml:mo></mml:math><inline-graphic xlink:href="wang-ieq2-3329526.gif"/></alternatives></inline-formula> higher than the best-performing model. Furthermore, we conducted an ablation study to demonstrate the validity of each module and provided explanations for the brain regions associated with the relevant features.

Research on Emotion Theory and the Decision Models Based on Emotion

A Emotion Development Agent Model Based On Occ Model And Operant Conditioning

Study on Artificial Emotion and Its Application in the Behavior Selection Strategy of Agents

An Emotion-Based Approach to Decision Making and Self Learning in Autonomous Robot Control

Implementation of an Artificial Emotion Model and Behavior Strategies Based on Finite Automata

EMIA: Emotion Model for Intelligent Agent

An Artificial Emotion model Baesd-on State-space Method

A Computational Study on Emotions and Temperament in Multi-Agent Systems

A Model of Mental State Transition Network

Artificial Emotion and Its Recognition, Modeling and Applications: an Overview

Deep Emotion: A Computational Model of Emotion Using Deep Neural Networks

Research on emotion modelling

Digital Empirical Research of Influencing Factors of Musical Emotion Classification Based on Pleasure-Arousal Musical Emotion Fuzzy Model

An emotion information processing model based on a mental state transition network

A domain-independent framework for modeling emotion

Neural Mechanism of Emotional Response in Social Decision Making

Computational Modeling of Emotion-Motivated Decisions for Continuous Control of Mobile Robots

Enhancing EEG-Based Decision-Making Performance Prediction by Maximizing Mutual Information Between Emotion and Decision-Relevant Features

Emotional Theory of Rationality

Respect Your Emotion: Human-Multi-Robot Teaming based on Regret Decision Model