Abstract:The human being in his blessed curiosity has always wondered how to make machines feel, and, at the same time how a machine can detect emotions. Perhaps some of the tasks that cannot be replaced by machines are the ability of human beings to feel emotions. In the last year, this hypothesis is increasingly questioned by scientists who have done work that seeks to understand the phenomena of brain functioning using the state of the art in instrumentation, sensors, and signal processing. Today, the world scientists have powerful machine learning methods developed to challenge this issue.The field of emotion detection is gaining significance as the technology advances, and particularly due to the current developments in machine learning, the Internet of Things, industry 4.0 and Autonomous Vehicles. Machines will need to be equipped with the capacity to monitor the state of the human user and to change their behaviour in response. Machine learning offers a route to this and should be able to make use of data collected from questionnaires, facial expression scans, and physiological signals such as electroencephalograms (EEG), electrocardiograms, and galvanic skin response. In this study, an approach was proposed to identify the emotional state of a subject from the collected data in the elicited emotion experiments. An algorithm using EEG data was developed, using the power spectral density of the frequency cerebral bands (alpha, beta, theta, and gamma) as features for classifier training. A K Nearest Neighbors algorithm using Euclidian distance was used to predict the emotional state of the subject. This article proposes a novel approach for emotion recognition that not only depends on images of the face, as in the previous literature, but also on the physiological data. The algorithm was able to recognize nine different emotions (Neutral, Anger, Disgust, Fear, Joy, Sadness, Surprise, Amusement, and Anxiety), nine valence positions, and nine positions on arousal axes. Using the data from only 14 EEG electrodes, an accuracy of approximately 97% was achieved. An approach has been developed for evaluating the state of mind of an driver in the context of a semi-autonomous vehicle context, for example. However, the system has a much wider range of potential applications, from the design of products to the evaluation of the user experience.

Automated recognition of emotional states of horses from facial expressions

Emotion Recognition in Horses with Convolutional Neural Networks

Horses can learn to identify joy and sadness against other basic emotions from human facial expressions

Deep Learning Models for Automated Classification of Dog Emotional States from Facial Expressions

Pain assessment in horses using automatic facial expression recognition through deep learning-based modeling

Horses discriminate between human facial and vocal expressions of sadness and joy

The Use of Artificial Intelligence in Assessing Affective States in Livestock

Automatic Facial Expression Recognition in Standardized and Non-standardized Emotional Expressions

AI in Pursuit of Happiness, Finding Only Sadness: Multi-Modal Facial Emotion Recognition Challenge

Affective State Recognition in Livestock—Artificial Intelligence Approaches

Anatomical and functional basis of facial expressions and their relationship with emotions in horses

Recognizing affective states from the expressive behavior of tennis players using Convolutional Neural Networks

Emotion recognition for semi-autonomous vehicles framework

Implicit Media Tagging and Affect Prediction from video of spontaneous facial expressions, recorded with depth camera

Human Emotion Recognition Based on Spatio-Temporal Facial Features Using HOG-HOF and VGG-LSTM

Human Emotion Identification Based on Facial Expression using Image Processing

Towards Context-Aware Facial Emotion Reaction Database for Dyadic Interaction Settings

Automated video-based pain recognition in cats using facial landmarks

Computer Vision Estimation of Emotion Reaction Intensity in the Wild

Automatic Recognition of Facial Displays of Unfelt Emotions

Human emotion recognition from EEG-based brain–computer interface using machine learning: a comprehensive review