Abstract:Abstract Objective. Cultures have essential influences on emotions. However, most studies on cultural influences on emotions are in the areas of psychology and neuroscience, while the existing affective models are mostly built with data from the same culture. In this paper, we identify the similarities and differences among Chinese, German, and French individuals in emotion recognition with electroencephalogram (EEG) and eye movements from an affective computing perspective. Approach. Three experimental settings were designed: intraculture subject dependent, intraculture subject independent, and cross-culture subject independent. EEG and eye movements are acquired simultaneously from Chinese, German, and French subjects while watching positive, neutral, and negative movie clips. The affective models for Chinese, German, and French subjects are constructed by using machine learning algorithms. A systematic analysis is performed from four aspects: affective model performance, neural patterns, complementary information from different modalities, and cross-cultural emotion recognition. Main results. From emotion recognition accuracies, we find that EEG and eye movements can adapt to Chinese, German, and French cultural diversities and that a cultural in-group advantage phenomenon does exist in emotion recognition with EEG. From the topomaps of EEG, we find that the γ and β bands exhibit decreasing activities for Chinese, while for German and French, θ and α bands exhibit increasing activities. From confusion matrices and attentional weights, we find that EEG and eye movements have complementary characteristics. From a cross-cultural emotion recognition perspective, we observe that German and French people share more similarities in topographical patterns and attentional weight distributions than Chinese people while the data from Chinese are a good fit for test data but not suitable for training data for the other two cultures. Significance. Our experimental results provide concrete evidence of the in-group advantage phenomenon, cultural influences on emotion recognition, and different neural patterns among Chinese, German, and French individuals.

Cultural Differences and Similarities in Emotion Recognition

Emotion Perception and Recognition: an Exploration of Cultural Differences and Similarities

Identifying similarities and differences in emotion recognition with EEG and eye movements among Chinese, German, and French People

A comparative analysis of machine learning methods for emotion recognition using EEG and peripheral physiological signals

Using electroencephalogram for emotion recognition based on filter-bank long short-term memory networks

Electroencephalogram Emotion Recognition Based on Empirical Mode Decomposition and Optimal Feature Selection.

Multi-modal emotion analysis from facial expressions and electroencephalogram.

Analysis of brain areas in emotion recognition from EEG signals with deep learning methods

Image-Evoked Emotion Recognition for Hearing-Impaired Subjects with EEG Signals

EEG-based emotion recognition systems; comprehensive study

Identifying valence and arousal levels via connectivity between EEG channels

Multi-modal emotion recognition using EEG and speech signals

A Cross-Culture Study on Multimodal Emotion Recognition Using Deep Learning

Research Progress of EEG-Based Emotion Recognition: A Survey

EEG based Emotion Recognition: A Tutorial and Review

EEG and fNIRS Signal-Based Emotion Identification by Means of Machine Learning Algorithms During Visual Stimuli Exposure

DREAMER: A Database for Emotion Recognition Through EEG and ECG Signals From Wireless Low-cost Off-the-Shelf Devices

Design and Implementation of an Emotion Analysis System Based on EEG Signals

EEG-Based BCI Emotion Recognition: A Survey

Emotion Recognition in Conversations Using Brain and Physiological Signals

Mini review: Challenges in EEG emotion recognition