Abstract:Emotions can be perceived from both facial and bodily expressions. Our previous study has found the successful decoding of facial expressions based on the functional connectivity (FC) patterns. However, the role of the FC patterns in the recognition of bodily expressions remained unclear, and no neuroimaging studies have adequately addressed the question of whether emotions perceiving from facial and bodily expressions are processed rely upon common or different neural networks. To address this, the present study collected functional magnetic resonance imaging (fMRI) data from a block design experiment with facial and bodily expression videos as stimuli (three emotions: anger, fear, and joy), and conducted multivariate pattern classification analysis based on the estimated FC patterns. We found that in addition to the facial expressions, bodily expressions could also be successfully decoded based on the large-scale FC patterns. The emotion classification accuracies for the facial expressions were higher than that for the bodily expressions. Further contributive FC analysis showed that emotion-discriminative networks were widely distributed in both hemispheres, containing regions that ranged from primary visual areas to higher-level cognitive areas. Moreover, for a particular emotion, discriminative FCs for facial and bodily expressions were distinct. Together, our findings highlight the key role of the FC patterns in the emotion processing, indicating how large-scale FC patterns reconfigure in processing of facial and bodily expressions, and suggest the distributed neural representation for the emotion recognition. Furthermore, our results also suggest that the human brain employs separate network representations for facial and bodily expressions of the same emotions. This study provides new evidence for the network representations for emotion perception and may further our understanding of the potential mechanisms underlying body language emotion recognition.

Decoding facial expressions based on face-selective and motion-sensitive areas

Facial Expression Decoding Based on Fmri Brain Signal

Decoding the temporal representation of facial expression in face-selective regions

Neural Substrates for Explicit Recognition of Dynamic Facial Expression by Fmri

Decoding six basic emotions from brain functional connectivity patterns

Dissociable Roles of Internal Feelings and Face Recognition Ability in Facial Expression Decoding.

Functional MRI Study on Recognition of Facial Expression in Healthy Subjects

Network Representations of Facial and Bodily Expressions: Evidence from Multivariate Connectivity Pattern Classification.

The Preliminary Study of Facial Expression Recognition in Normal Adults by Fmri

Facial expression recognition: A meta-analytic review of theoretical models and neuroimaging evidence

Reexamining the neural network involved in perception of facial expression: A meta-analysis

EEG decoding of multidimensional information from emotional faces

The Classification of Facial Expressions with Multi-Cultural Backgrounds: an Event-Related Fmri Study

Multimodal Affective State Assessment Using fNIRS + EEG and Spontaneous Facial Expression

Brain networks processing temporal information in dynamic facial expressions

Layer-specific, retinotopically-diffuse modulation in human visual cortex by emotional faces

Spontaneous Facial Expressions and Micro-expressions Coding: From Brain to Face

Recognizing facial expressions of emotion amid noise: A dynamic advantage

Neural Responses to Rapid Facial Expressions of Fear and Surprise

The Brain Computes Dynamic Facial Movements for Emotion Categorization Using a Third Pathway

Facial Expressions Recognition Based on Cognition and Mapped Binary Patterns.