Abstract:Emotions significantly shape decision-making, and targeted emotional elicitations represent an important factor in neuromarketing, where they impact advertising effectiveness by capturing potential customers' attention intricately associated with emotional triggers. Analyzing biometric parameters after stimulus exposure may help in understanding emotional states. This study investigates autonomic and central nervous system responses to emotional stimuli, including images, auditory cues, and their combination while recording physiological signals, namely the electrocardiogram, blood volume pulse, galvanic skin response, pupillometry, respiration, and the electroencephalogram. The primary goal of the proposed analysis is to compare emotional stimulation methods and to identify the most effective approach for distinct physiological patterns. A novel feature selection technique is applied to further optimize the separation of four emotional states. Basic machine learning approaches are used in order to discern emotions as elicited by different kinds of stimulation. Electroencephalographic signals, Galvanic skin response and cardio-respiratory coupling-derived features provided the most significant features in distinguishing the four emotional states. Further findings highlight how auditory stimuli play a crucial role in creating distinct physiological patterns that enhance classification within a four-class problem. When combining all three types of stimulation, a validation accuracy of 49% was achieved. The sound-only and the image-only phases resulted in 52% and 44% accuracy respectively, whereas the combined stimulation of images and sounds led to 51% accuracy. Isolated visual stimuli yield less distinct patterns, necessitating more signals for relatively inferior performance compared to other types of stimuli. This surprising significance arises from limited auditory exploration in emotional recognition literature, particularly contrasted with the pleathora of studies performed using visual stimulation. In marketing, auditory components might hold a more relevant potential to significantly influence consumer choices.

Enhancing EEG-Based Decision-Making Performance Prediction by Maximizing Mutual Information Between Emotion and Decision-Relevant Features

Electroencephalogram Emotion Recognition Based on Empirical Mode Decomposition and Optimal Feature Selection.

A study on the combination of functional connection features and Riemannian manifold in EEG emotion recognition

A Stepwise Discriminant Analysis and FBCSP Feature Selection Strategy for EEG MI Recognition

An Attention-Based Multi-Domain Bi-Hemisphere Discrepancy Feature Fusion Model for EEG Emotion Recognition

Investigating EEG-based functional connectivity patterns for multimodal emotion recognition

Prediction of Product Design Decision Making: an Investigation of Eye Movements and EEG Features

Stable Feature Selection for EEG-based Emotion Recognition

Understanding the role of emotion in decision making process: using machine learning to analyze physiological responses to visual, auditory, and combined stimulation

Discrimination of Decision Confidence Levels from EEG Signals

An innovative EEG-based emotion recognition using a single channel-specific feature from the brain rhythm code method

Interpretable Emotion Classification Using Multidomain Feature of EEG Signals

A personality-guided affective brain—computer interface for implementation of emotional intelligence in machines

Integration of Simultaneous Fmri and EEG Source Localization in Emotional Decision Problems

Multidimensional Feature in Emotion Recognition Based on Multi-Channel EEG Signals.

Enhancing Emotion Recognition Using Region-Specific Electroencephalogram Data and Dynamic Functional Connectivity

Multi-Source EEG Emotion Recognition via Dynamic Contrastive Domain Adaptation

Predicting individual decision-making responses based on single-trial EEG

Mixed Emotion Recognition Based on EEG Signals

A comparative analysis of machine learning methods for emotion recognition using EEG and peripheral physiological signals

Dynamic-Attention-based EEG State Transition Modeling for Emotion Recognition