Abstract:Human facial expressions are complex, multi-component signals that can communicate rich information about emotions,1-5 including specific categories, such as "anger," and broader dimensions, such as "negative valence, high arousal."6-8 An enduring question is how this complex signaling is achieved. Communication theory predicts that multi-component signals could transmit each type of emotion information-i.e., specific categories and broader dimensions-via the same or different facial signal components, with implications for elucidating the system and ontology of facial expression communication.9 We addressed this question using a communication-systems-based method that agnostically generates facial expressions and uses the receiver's perceptions to model the specific facial signal components that represent emotion category and dimensional information to them.10-12 First, we derived the facial expressions that elicit the perception of emotion categories (i.e., the six classic emotions13 plus 19 complex emotions3) and dimensions (i.e., valence and arousal) separately, in 60 individual participants. Comparison of these facial signals showed that they share subsets of components, suggesting that specific latent signals jointly represent-i.e., multiplex-categorical and dimensional information. Further examination revealed these specific latent signals and the joint information they represent. Our results-based on white Western participants, same-ethnicity face stimuli, and commonly used English emotion terms-show that facial expressions can jointly represent specific emotion categories and broad dimensions to perceivers via multiplexed facial signal components. Our results provide insights into the ontology and system of facial expression communication and a new information-theoretic framework that can characterize its complexities.

The Information in Emotion Communication

Information Theory Opens New Dimensions in Experimental Studies of Animal Behaviour and Communication

A Thermodynamic Study on Information Power in Communication Systems

Essential conditions for evolution of communication within a species

Non-verbal effecting - animal research sheds light on human emotion communication

Beyond Facial Expression: Spatial Distance as a Factor in the Communication of Discrete Emotions

Emotion Transfer Protocol Experiments in Emotion Transmission

A Protocol for Emotions

Smile through your fear and sadness: transmitting and identifying facial expression signals over a range of viewing distances

Emotional Expression: Advances in Basic Emotion Theory

Emojis as social information in digital communication.

Facial expressions elicit multiplexed perceptions of emotion categories and dimensions

Summary of Information Theoretic Quantities

Emotional expressions as appeals to recipients.

Emotion in a Century: A Review of Emotion Recognition

Dissecting emotion and user influence in social media communities: An interaction modeling approach

Stripping syntax from complexity: An information-theoretical perspective on complex systems

A study of emotion-technology

Social Role-Aware Emotion Contagion In Image Social Networks

Unlocking the Emotional World of Visual Media: An Overview of the Science, Research, and Impact of Understanding Emotion

Quantifying the Effect of Sentiment on Information Diffusion in Social Media