Abstract:Human computer interaction is increasingly utilized in smart home, industry 4.0 and personal health. Communication between human and computer can benefit by a flawless exchange of emotions. As emotions have substantial influence on cognitive processes of the human brain such as learning, memory, perception and problem solving, emotional interactions benefit different applications. It can further be relevant in modern health care especially in interaction with patients suffering from stress or depression. Additionally rehabilitation applications, guiding patients through their rehabilitation training while adapting to the patients emotional state, would be highly motivating and might lead to a faster recovery. Depending on the application area, different systems for emotion recognition suit different purposes. The aim of this work is to give an overview of methods to recognize emotions and to compare their applicability based on existing studies. This review paper should enable practitioners, researchers and engineers to find a system most suitable for certain applications. An entirely contact-less method is to analyze facial features with the help of a video camera. This is useful when computers, smart-phones or tablets with integrated cameras are included in the task. Smart wearables provide contact with the skin and physiological parameters such as electro-dermal activity and heart related signals can be recorded unobtrusively also during dynamical tasks. Next to unimodal solutions, multimodal affective computing systems are analyzed since they promise higher classification accuracy. Accuracy varies based on the amount of detected emotions, extracted features, classification method and the quality of the database. Electroencephalography achieves 88.86 % accuracy for four emotions, multimodal measurements (Electrocardiography, Electromyography and bio-signals) 79.3 % for four emotive states, facial recognition 89 % for seven states and speech recognition 80.46 % for happiness and sadness. Looking forward, heart-related parameters might be an option to measure emotions accurately and unobtrusive with the help of smart wearables. This can be used in dynamic or outdoor tasks. Facial recognition on the other hand is a useful contact-less tool when it comes to emotion recognition during computer interaction.

Dimensional emotion recognition from camera-based PRV features

Facial-Video-Based Physiological Signal Measurement: Recent Advances and Affective Applications

Emotion Recognition by Point Process Characterization of Heartbeat Dynamics

Emotion detection and recognition using HRV features derived from photoplethysmogram signals

Multimodal Emotion Recognition by Combining Physiological Signals and Facial Expressions: a Preliminary Study.

Multi-modal emotion analysis from facial expressions and electroencephalogram.

Heart rate variability monitoring for emotion and disorders of emotion

Emotion Recognition Based on Multi-Variant Correlation of Physiological Signals

Your blush gives you away: detecting hidden mental states with remote photoplethysmography and thermal imaging

Emotion Recognition Based on a Limited Number of Multimodal Physiological Signals Channels

Emotion Recognition from Physiological Signal Analysis: A Review

Non-Contact Dual-Modality Emotion Recognition System by CW Radar and RGB Camera

Human Emotion Characterization by Heart Rate Variability Analysis Guided by Respiration

A Noncontact Emotion Recognition Method Based on Complexion and Heart Rate

Emotion Classification Based on Pulsatile Images Extracted from Short Facial Videos via Deep Learning

Remote Photoplethysmograph Signal Measurement from Facial Videos Using Spatio-Temporal Networks

Non-Contact Psychological Stress Detection Combining Heart Rate Variability and Facial Expressions

Improvement of HRV Methodology for Positive/negative Emotion Assessment.

Analysis of EDA and Heart Rate Signals for Emotional Stimuli Responses

Human emotion recognition by analyzing facial expressions, heart rate and blogs using deep learning method