Abstract:Emotion recognition has increased the potential of affective computing by getting an instant feedback from users and thereby, have a better understanding of their behavior. Physiological sensors have been used to recognize human emotions in response to audio and video content that engages single (auditory) and multiple (two: auditory and vision) human senses, respectively. In this study, human emotions were recognized using physiological signals observed in response to tactile enhanced multimedia content that engages three (tactile, vision, and auditory) human senses. The aim was to give users an enhanced real-world sensation while engaging with multimedia content. To this end, four videos were selected and synchronized with an electric fan and a heater, based on timestamps within the scenes, to generate tactile enhanced content with cold and hot air effect respectively. Physiological signals, i.e., electroencephalography (EEG), photoplethysmography (PPG), and galvanic skin response (GSR) were recorded using commercially available sensors, while experiencing these tactile enhanced videos. The precision of the acquired physiological signals (including EEG, PPG, and GSR) is enhanced using pre-processing with a Savitzky-Golay smoothing filter. Frequency domain features (rational asymmetry, differential asymmetry, and correlation) from EEG, time domain features (variance, entropy, kurtosis, and skewness) from GSR, heart rate and heart rate variability from PPG data are extracted. The K nearest neighbor classifier is applied to the extracted features to classify four (happy, relaxed, angry, and sad) emotions. Our experimental results show that among individual modalities, PPG-based features gives the highest accuracy of 78.57 % as compared to EEG- and GSR-based features. The fusion of EEG, GSR, and PPG features further improved the classification accuracy to 79.76 % (for four emotions) when interacting with tactile enhanced multimedia.

Intelligent Remote Control for TV Program based on Emotion in Arabic Speech

Deep Learning, Ensemble and Supervised Machine Learning for Arabic Speech Emotion Recognition

Evaluating and Validating Emotion Elicitation Using English and Arabic Movie Clips on a Saudi Sample

Human-Computer Interaction for Recognizing Speech Emotions Using Multilayer Perceptron Classifier

Speaker-Independent Speech Emotion Recognition Based On Cnn-Blstm And Multiple Svms

A Context-Aware Smart TV System with Body-Gesture Control and Personalized Recommendation

Smart and Context-Aware System employing Emotions Recognition

Recommender System for Arabic Content Using Sentiment Analysis of User Reviews

Group Movie Selection using Multi-channel Emotion Recognition

Utilizing Speech Emotion Recognition and Recommender Systems for Negative Emotion Handling in Therapy Chatbots

Speech emotion recognition approaches in human computer interaction

Physiological Sensors Based Emotion Recognition While Experiencing Tactile Enhanced Multimedia

A Control System Using Speech Recognition AMR in Robotic System

An Innovative Method for Speech Signal Emotion Recognition Based on Spectral Features Using GMM and HMM Techniques

A Survey on Emotion Recognition for Human Robot Interaction

Deploying Machine Learning Techniques for Human Emotion Detection

Modeling of Recommendation System Based on Emotional Information and Collaborative Filtering

An intelligent film recommender system based on emotional analysis

Application of Speech Emotion Recognition in Intelligent Household Robot

Personalized Smart Learning Recommendation System for Arabic Users in Smart Campus

A Comparative Analysis of Different Approach for Basic Emotions Recognition from Speech