Abstract:Abstract Objective. Cultures have essential influences on emotions. However, most studies on cultural influences on emotions are in the areas of psychology and neuroscience, while the existing affective models are mostly built with data from the same culture. In this paper, we identify the similarities and differences among Chinese, German, and French individuals in emotion recognition with electroencephalogram (EEG) and eye movements from an affective computing perspective. Approach. Three experimental settings were designed: intraculture subject dependent, intraculture subject independent, and cross-culture subject independent. EEG and eye movements are acquired simultaneously from Chinese, German, and French subjects while watching positive, neutral, and negative movie clips. The affective models for Chinese, German, and French subjects are constructed by using machine learning algorithms. A systematic analysis is performed from four aspects: affective model performance, neural patterns, complementary information from different modalities, and cross-cultural emotion recognition. Main results. From emotion recognition accuracies, we find that EEG and eye movements can adapt to Chinese, German, and French cultural diversities and that a cultural in-group advantage phenomenon does exist in emotion recognition with EEG. From the topomaps of EEG, we find that the γ and β bands exhibit decreasing activities for Chinese, while for German and French, θ and α bands exhibit increasing activities. From confusion matrices and attentional weights, we find that EEG and eye movements have complementary characteristics. From a cross-cultural emotion recognition perspective, we observe that German and French people share more similarities in topographical patterns and attentional weight distributions than Chinese people while the data from Chinese are a good fit for test data but not suitable for training data for the other two cultures. Significance. Our experimental results provide concrete evidence of the in-group advantage phenomenon, cultural influences on emotion recognition, and different neural patterns among Chinese, German, and French individuals.

Neural correlates of emotion perception depending on culture and gaze direction

How Facial Cues of Models Affect Attention to Websites in Asian and American Cultures

Influence Of Ethnic Group-Membership And Gaze Direction On The Perception Of Emotions. A Cross-Cultural Study Between Germany And China

Language access differentially alters functional connectivity during emotion perception across cultures

Cultural influences on neural basis of intergroup empathy

The impact of emotional facial expressions on reflexive attention depends on the aim of dynamic gaze changes: An ERP study

Neural Responses to Affective Stimuli Across Culturally Similar and Dissimilar Situations

Emotion depends on context, culture and their interaction: evidence from effective connectivity

Emotional Gaze: The Effects of Gaze Direction on the Perception of Facial Emotions

Context matters: task relevance shapes neural responses to emotional facial expressions

Cross-cultural and hemispheric laterality effects on the ensemble coding of emotion in facial crowds

Cross-cultural effects on ensemble coding of emotion in facial crowds

Overt and covert attention shifts to emotional faces: Combining EEG, eye tracking, and a go/no-go paradigm.

The effect of eye gaze direction on emotional mimicry: A multimodal study with electromyography and electroencephalography

Identifying similarities and differences in emotion recognition with EEG and eye movements among Chinese, German, and French People

Culture modulates brain activity during empathy with anger.

Does culture moderate the encoding and recognition of negative cues? Evidence from an eye-tracking study

The influence of selective attention to specific emotions on the processing of faces as revealed by event-related brain potentials.

Frequency-specific gaze modulation of emotional face processing in the human amygdala

Integration of gaze direction and facial expression in patients with unilateral amygdala damage

Neural Substrates Underlying Intentional Empathy