Abstract:The use of expressive Virtual Characters is an effective complementary means of communication for social networks offering multi-user 3D-chatting environment. In such contexts, the facial expression channel offers a rich medium to translate the ongoing emotions conveyed by the text-based exchanges. However, until recently, only purely symmetric facial expressions have been considered for that purpose. In this article we examine human sensitivity to facial asymmetry in the expression of both basic and complex emotions. The rationale for introducing asymmetry in the display of facial expressions stems from two well-established observations in cognitive neuroscience: first that the expression of basic emotions generally displays a small asymmetry, second that more complex emotions such as ambivalent feeling may reflect in the partial display of different, potentially opposite, emotions on each side of the face. A frequent occurrence of this second case results from the conflict between the truly felt emotion and the one that should be displayed due to social conventions. Our main hypothesis is that a much larger expressive and emotional space can only be automatically synthesized by means of facial asymmetry when modeling emotions with a general Valence-Arousal-Dominance dimensional approach. Besides, we want also to explore the general human sensitivity to the introduction of a small degree of asymmetry into the expression of basic emotions. We conducted an experiment by presenting 64 pairs of static facial expressions, one symmetric and one asymmetric, illustrating eight emotions (three basic and five complex ones) alternatively for a male and a female character. Each emotion was presented four times by swapping the symmetric and asymmetric positions and by mirroring the asymmetrical expression. Participants were asked to grade, on a continuous scale, the correctness of each facial expression with respect to a short definition. Results confirm the potential of introducing facial asymmetry for a subset of the complex emotions. Guidelines are proposed for designers of embodied conversational agent and emotionally reflective avatars.

Virtual Character Facial Expressions Influence Human Brain and Facial EMG Activity in a Decision-Making Game

Left Amygdala and Putamen Activation Modulate Emotion Driven Decisions in the Iterated Prisoner’s Dilemma Game

The value of a real face: Differences between affective faces and emojis in neural processing and their social influence on decision-making

Neural dynamics of two players when using nonverbal cues to gauge intentions to cooperate during the Prisoner's Dilemma Game

Neurocircuits underlying cognition–emotion interaction in a social decision making context

Trust or doubt? Neural resonance based on facial expressions in a deception game reflected by frontal EEG activities.

Game induced emotion analysis using electroencephalography

Observers predict actions from facial emotional expressions during real-time social interactions

BARGAIN: behavioral affective rule-based games adaptation interface–towards emotionally intelligent games: application on a virtual reality environment for socio-moral development

Dynamic Facial Expression of Emotion Made Easy

Assessment of Empathy in an Affective VR Environment using EEG Signals

Brain responses to the acquired moral status of faces

Brain activity correlates with emotional perception induced by dynamic avatars

The effect of anime character's facial expressions and eye blinking on donation behavior

The effect of psychopathy on cooperative strategies in an iterated Prisoner’s Dilemma experiment with emotional feedback

The Impact of Partner Expressions on Felt Emotion in the Iterated Prisoner's Dilemma: An Event-level Analysis

Facial EMG sensing for monitoring affect using a wearable device

Evaluating the Sensitivity to Virtual Characters Facial Asymmetry in Emotion Synthesis

Emotional face recognition, EMG response, and medial prefrontal activity in empathic behaviour

Rapid approach-avoidance responses to emotional displays reflect value-based decisions: Neural evidence from an EEG study

Motivation in the metaverse: A dual-process approach to consumer choices in a virtual reality supermarket