Abstract:Affective computing through physiological signals monitoring is currently a hot topic in the scientific literature, but also in the industry. Many wearable devices are being developed for health or wellness tracking during daily life or sports activity. Likewise, other applications are being proposed for the early detection of risk situations involving sexual or violent aggressions, with the identification of panic or fear emotions. The use of other sources of information, such as video or audio signals will make multimodal affective computing a more powerful tool for emotion classification, improving the detection capability. There are other biological elements that have not been explored yet and that could provide additional information to better disentangle negative emotions, such as fear or panic. Catecholamines are hormones produced by the adrenal glands, two small glands located above the kidneys. These hormones are released in the body in response to physical or emotional stress. The main catecholamines, namely adrenaline, noradrenaline and dopamine have been analysed, as well as four physiological variables: skin temperature, electrodermal activity, blood volume pulse (to calculate heart rate activity. i.e., beats per minute) and respiration rate. This work presents a comparison of the results provided by the analysis of physiological signals in reference to catecholamine, from an experimental task with 21 female volunteers receiving audiovisual stimuli through an immersive environment in virtual reality. Artificial intelligence algorithms for fear classification with physiological variables and plasma catecholamine concentration levels have been proposed and tested. The best results have been obtained with the features extracted from the physiological variables. Adding catecholamine's maximum variation during the five minutes after the video clip visualization, as well as adding the five measurements (1-min interval) of these levels, are not providing better performance in the classifiers.

Emotion Recognition from Heart Rate Variability Data of Smartwatch While Watching a Video

Emotion-Recognition Using Smart Watch Sensor Data: Mixed-Design Study

Physiological Signals Based Emotional State Recognition Model of Audience

Emotion-Recognition Using Smart Watch Accelerometer Data: Preliminary Findings

Exploiting EEG signals and audiovisual feature fusion for video emotion recognition

WEARS: Wearable Emotion AI with Real-time Sensor data

Optimizing Emotion Recognition with Wearable Sensor Data: Unveiling Patterns in Body Movements and Heart Rate through Random Forest Hyperparameter Tuning

Wearable Emotion Recognition Using Heart Rate Data from a Smart Bracelet

Emotion Classification Based on Pulsatile Images Extracted from Short Facial Videos via Deep Learning

Human Emotions Analysis and Recognition Using EEG Signals in Response to 360$^\circ$ Videos

Emotion and Stress Recognition Utilizing Galvanic Skin Response and Wearable Technology: A Real-time Approach for Mental Health Care

Emotion recognition from users' EEG signals with the help of stimulus VIDEOS

CorrNet: Fine-Grained Emotion Recognition for Video Watching Using Wearable Physiological Sensors

SensEmo: Enabling Affective Learning through Real-time Emotion Recognition with Smartwatches

Video Quality Prediction: An Exploratory Study With Valence and Arousal Signals

Physiological Sensors Based Emotion Recognition While Experiencing Tactile Enhanced Multimedia

Constructing an Emotion Estimation Model Based on EEG/HRV Indexes Using Feature Extraction and Feature Selection Algorithms

Emotion Recognition for Everyday Life Using Physiological Signals from Wearables: A Systematic Literature Review

Arousal-Valence Classification from Peripheral Physiological Signals Using Long Short-Term Memory Networks

Fear Detection in Multimodal Affective Computing: Physiological Signals versus Catecholamine Concentration