Abstract:Abstract Emotion recognition using brain signals has the potential to change the way we identify and treat some health conditions. Difficulties and limitations may arise in general emotion recognition software due to the restricted number of facial expression triggers, dissembling of emotions, or among people with alexithymia. Such triggers are identified by studying the continuous brainwaves generated by human brain. Electroencephalogram (EEG) signals from the brain give us a more diverse insight on emotional states that one may not be able to express. Brainwave EEG signals can reflect the changes in electrical potential resulting from communications networks between neurons. This research involves analyzing the epoch data from EEG sensor channels and performing comparative analysis of multiple machine learning techniques [namely Support Vector Machine (SVM), K-nearest neighbor, Linear Discriminant Analysis, Logistic Regression and Decision Trees each of these models] were tested with and without principal component analysis (PCA) for dimensionality reduction. Grid search was also utilized for hyper-parameter tuning for each of the tested machine learning models over Spark cluster for lowered execution time. The DEAP Dataset was used in this study, which is a multimodal dataset for the analysis of human affective states. The predictions were based on the labels given by the participants for each of the 40 1-min long excerpts of music. music. Participants rated each video in terms of the level of arousal, valence, like/dislike, dominance and familiarity. The binary class classifiers were trained on the time segmented, 15 s intervals of epoch data, individually for each of the 4 classes. PCA with SVM performed the best and produced an F1-score of 84.73% with 98.01% recall in the 30th to 45th interval of segmentation. For each of the time segments and “a binary training class” a different classification model converges to a better accuracy and recall than others. The results prove that different classification models must be used to identify different emotional states.

RECOGNITION OF EMOTIONS FROM TIME AND TIME- FREQUENCY FEATURES USING FACIAL ELECTROMYOGRAPHY SIGNALS

Recognition of Emotion Through Facial Expressions Using EMG Signal

Multi-modal emotion analysis from facial expressions and electroencephalogram.

Using electroencephalogram for emotion recognition based on filter-bank long short-term memory networks

An Approach for Evaluation and Recognition of Facial Emotions Using EMG Signal

Multimodal emotion recognition based on the fusion of vision, EEG, ECG, and EMG signals

Performance evaluation of multi-channel electroencephalogram signal (EEG) based time frequency analysis for human emotion recognition

Emotion Recognition Using Electrodermal Activity Signals and Multiscale Deep Convolution Neural Network

Valence-Arousal Model based Emotion Recognition using EEG, peripheral physiological signals and Facial Expression

A comparative analysis of machine learning methods for emotion recognition using EEG and peripheral physiological signals

Emotion Recognition for Challenged People Facial Appearance in Social using Neural Network

Acquisition and Analysis of Facial Electromyographic Signals for Emotion Recognition

Automated Emotion Identification Using Fourier–Bessel Domain-Based Entropies

Classification of Individual’s discrete emotions reflected in facial microexpressions using electroencephalogram and facial electromyogram

Decoding Emotions: Integrating EEG Signals and Facial Expressions for Advanced Multimodal Emotion Recognition

EEG-based emotion recognition using frequency domain features and support vector machines

Facial Emotion Characterization and Detection using Fourier Transform and Machine Learning

Emotion Recognition Based on the Multiple Physiological Signals

Emotion recognition framework using multiple modalities for an effective human–computer interaction

Comprehensive Analysis of Feature Extraction Methods for Emotion Recognition from Multichannel EEG Recordings

Using Facial Micro-Expressions in Combination With EEG and Physiological Signals for Emotion Recognition