Abstract:A fundamental characteristic of social exchanges is the synchronization of individuals' behaviors, physiological responses, and neural activity. However, the influence of how individuals communicate in terms of emotional content and expressed associative knowledge on interpersonal synchrony has been scarcely investigated so far. This study addresses this research gap by bridging recent advances in cognitive neuroscience data, affective computing, and cognitive data science frameworks. Using functional near-infrared spectroscopy (fNIRS) hyperscanning, prefrontal neural data were collected during social interactions involving 84 participants (i.e., 42 dyads) aged 18-35 years. Wavelet transform coherence was used to assess interpersonal neural synchrony between participants. We used manual transcription of dialogues and automated methods to codify transcriptions as emotional levels and syntactic/semantic networks. Our quantitative findings reveal higher than random expectations levels of interpersonal neural synchrony in the superior frontal gyrus (p = 0.020) and the bilateral middle frontal gyri (p < 0.001; p = 0.002). Stepwise models based on dialogues' emotional content only significantly predicted interpersonal neural synchrony across the prefrontal cortex (R2adj = 3.89%). Conversely, models relying on semantic features were more effective at the local level, for predicting brain synchrony in the right middle frontal gyrus (R2 adj = 6.78%). Generally, models based on the emotional content of dialogues lose predictive power when limited to data from one region of interest at a time, whereas models based on syntactic/semantic features show the opposite trend, losing predictive power when incorporating data from all regions of interest. Moreover, we found an interplay between emotions and associative knowledge in predicting brain synchrony, especially in social interactions based on role-play techniques, providing quantitative support to the major role played by the prefrontal cortex in conditions of identity faking. Our study identifies a mind-brain duality in emotions and associative knowledge reflecting neural synchrony levels, opening new ways for investigating human interactions.

Neural bases of social communicative intentions in speech

Neural dynamics of the intention to speak

Temporal neural dynamics of understanding communicative intentions from speech prosody

Neural processing of facial expressions as modulators of communicative intention

Beyond speaking: neurocognitive perspectives on language production in social interaction

The Neural Network Underlying the Processing of Affective Vocalizations

Influence of social and semantic contexts on phonetic encoding in naturalistic conversations

What has social neuroscience learned from hyperscanning studies of spoken communication? A systematic review

Neurocognitive Dynamics of Prosodic Salience over Semantics during Explicit and Implicit Processing of Basic Emotions in Spoken Words

Comment: The Next Frontier: Prosody Research Gets Interpersonal

Bidirectional Connectivity Between Broca's Area and Wernicke's Area During Interactive Verbal Communication

Brain Networks of Emotional Prosody Processing

Recruitment of Language-, Emotion- and Speech-Timing Associated Brain Regions for Expressing Emotional Prosody: Investigation of Functional Neuroanatomy with fMRI

Neural processing of social interaction: Coordinate‐based meta‐analytic evidence from human neuroimaging studies

Reading Between the Lines: Listener's Vmpfc Simulates Speaker Cooperative Choices in Communication Games.

Amygdala and insula contributions to dorsal-ventral pathway integration in the prosodic neural network

Linguistic signs in action: The neuropragmatics of speech acts

Emotional Content and Semantic Structure of Dialogues Predict Interpersonal Neural Synchrony in the Prefrontal Cortex: a Hyperscanning Study with Functional Near-Infrared Spectroscopy

Do you know what I mean? Brain oscillations and the understanding of communicative intentions

Spatio-temporal Brain Dynamics of Understanding Social Versus Private Intentions: an Electrical Neuroimaging Study

Beyond Human Intentions and Emotions.