Abstract:Human computer interaction is increasingly utilized in smart home, industry 4.0 and personal health. Communication between human and computer can benefit by a flawless exchange of emotions. As emotions have substantial influence on cognitive processes of the human brain such as learning, memory, perception and problem solving, emotional interactions benefit different applications. It can further be relevant in modern health care especially in interaction with patients suffering from stress or depression. Additionally rehabilitation applications, guiding patients through their rehabilitation training while adapting to the patients emotional state, would be highly motivating and might lead to a faster recovery. Depending on the application area, different systems for emotion recognition suit different purposes. The aim of this work is to give an overview of methods to recognize emotions and to compare their applicability based on existing studies. This review paper should enable practitioners, researchers and engineers to find a system most suitable for certain applications. An entirely contact-less method is to analyze facial features with the help of a video camera. This is useful when computers, smart-phones or tablets with integrated cameras are included in the task. Smart wearables provide contact with the skin and physiological parameters such as electro-dermal activity and heart related signals can be recorded unobtrusively also during dynamical tasks. Next to unimodal solutions, multimodal affective computing systems are analyzed since they promise higher classification accuracy. Accuracy varies based on the amount of detected emotions, extracted features, classification method and the quality of the database. Electroencephalography achieves 88.86 % accuracy for four emotions, multimodal measurements (Electrocardiography, Electromyography and bio-signals) 79.3 % for four emotive states, facial recognition 89 % for seven states and speech recognition 80.46 % for happiness and sadness. Looking forward, heart-related parameters might be an option to measure emotions accurately and unobtrusive with the help of smart wearables. This can be used in dynamic or outdoor tasks. Facial recognition on the other hand is a useful contact-less tool when it comes to emotion recognition during computer interaction.

Human-computer Affective Interaction System Research and Application Based on Physiological Signals: A Survey

Facial-Video-Based Physiological Signal Measurement: Recent Advances and Affective Applications

A survey of affective brain computer interfaces: principles, state-of-the-art, and challenges

Happy Companion : A System of Multimodal Human-Computer Affective Interaction

A systematic review on affective computing: emotion models, databases, and recent advances

A survey of speech emotion recognition in human computer interaction

Ubiquitous Affective Computing: A Review

Affective Computing for Healthcare: Recent Trends, Applications, Challenges, and Beyond

Physiological mouse: toward an emotion-aware mouse

Affect is Computable——A Survey on Affective Computing

A Comprehensive Survey on Affective Computing; Challenges, Trends, Applications, and Future Directions

Multimodal human attention detection for reading from facial expression, eye gaze, and mouse dynamics

A Survey of Affective Brain-Computer Interface

Ten Challenges for EEG-based Affective Computing

A Review, Current Challenges, and Future Possibilities on Emotion Recognition Using Machine Learning and Physiological Signals

Toward an affect-sensitive multimodal human-computer interaction

A Survey on Personalized Affective Computing in Human-Machine Interaction

A Survey of Multimodal Human-Machine Interface.

Emotion Recognition from Physiological Signal Analysis: A Review

Affective multimodal human-computer interaction

User stress detection in human-computer interactions