Abstract:Abstract Emotion recognition using brain signals has the potential to change the way we identify and treat some health conditions. Difficulties and limitations may arise in general emotion recognition software due to the restricted number of facial expression triggers, dissembling of emotions, or among people with alexithymia. Such triggers are identified by studying the continuous brainwaves generated by human brain. Electroencephalogram (EEG) signals from the brain give us a more diverse insight on emotional states that one may not be able to express. Brainwave EEG signals can reflect the changes in electrical potential resulting from communications networks between neurons. This research involves analyzing the epoch data from EEG sensor channels and performing comparative analysis of multiple machine learning techniques [namely Support Vector Machine (SVM), K-nearest neighbor, Linear Discriminant Analysis, Logistic Regression and Decision Trees each of these models] were tested with and without principal component analysis (PCA) for dimensionality reduction. Grid search was also utilized for hyper-parameter tuning for each of the tested machine learning models over Spark cluster for lowered execution time. The DEAP Dataset was used in this study, which is a multimodal dataset for the analysis of human affective states. The predictions were based on the labels given by the participants for each of the 40 1-min long excerpts of music. music. Participants rated each video in terms of the level of arousal, valence, like/dislike, dominance and familiarity. The binary class classifiers were trained on the time segmented, 15 s intervals of epoch data, individually for each of the 4 classes. PCA with SVM performed the best and produced an F1-score of 84.73% with 98.01% recall in the 30th to 45th interval of segmentation. For each of the time segments and “a binary training class” a different classification model converges to a better accuracy and recall than others. The results prove that different classification models must be used to identify different emotional states.

Emotion Recognition With Audio, Video, EEG, and EMG: A Dataset and Baseline Approaches

A Efficient Multimodal Framework for Large Scale Emotion Recognition by Fusing Music and Electrodermal Activity Signals

Multi-modal emotion analysis from facial expressions and electroencephalogram.

Electroencephalogram Emotion Recognition Based on Empirical Mode Decomposition and Optimal Feature Selection.

Multimodal Emotion Recognition by Combining Physiological Signals and Facial Expressions: a Preliminary Study.

Exploiting EEG signals and audiovisual feature fusion for video emotion recognition

A Multimodal Dataset for Mixed Emotion Recognition

A comparative analysis of machine learning methods for emotion recognition using EEG and peripheral physiological signals

MPED: A Multi-Modal Physiological Emotion Database for Discrete Emotion Recognition

Emotion recognition using multi-modal data and machine learning techniques: A tutorial and review

A Publicly Available Multimodal Emotional Dataset Triggered by Both Videos and Odors

Emotion recognition framework using multiple modalities for an effective human–computer interaction

SEED-VII: A Multimodal Dataset of Six Basic Emotions with Continuous Labels for Emotion Recognition

Multi-modal Emotion Recognition Based on Deep Learning in Speech, Video and Text

Valence-Arousal Model based Emotion Recognition using EEG, peripheral physiological signals and Facial Expression

A Model for EEG-Based Emotion Recognition: CNN-Bi-LSTM with Attention Mechanism

Multimodal emotion recognition based on the fusion of vision, EEG, ECG, and EMG signals

Multimodal Emotion Recognition From EEG Signals and Facial Expressions

Multimodal Emotion Recognition based on Facial Expressions, Speech, and EEG

EAV: EEG-Audio-Video Dataset for Emotion Recognition in Conversational Contexts

Multi-Modal Emotion Recognition Based On deep Learning Of EEG And Audio Signals