Abstract:A fundamental characteristic of social exchanges is the synchronization of individuals' behaviors, physiological responses, and neural activity. However, the influence of how individuals communicate in terms of emotional content and expressed associative knowledge on interpersonal synchrony has been scarcely investigated so far. This study addresses this research gap by bridging recent advances in cognitive neuroscience data, affective computing, and cognitive data science frameworks. Using functional near-infrared spectroscopy (fNIRS) hyperscanning, prefrontal neural data were collected during social interactions involving 84 participants (i.e., 42 dyads) aged 18-35 years. Wavelet transform coherence was used to assess interpersonal neural synchrony between participants. We used manual transcription of dialogues and automated methods to codify transcriptions as emotional levels and syntactic/semantic networks. Our quantitative findings reveal higher than random expectations levels of interpersonal neural synchrony in the superior frontal gyrus (p = 0.020) and the bilateral middle frontal gyri (p < 0.001; p = 0.002). Stepwise models based on dialogues' emotional content only significantly predicted interpersonal neural synchrony across the prefrontal cortex (R2adj = 3.89%). Conversely, models relying on semantic features were more effective at the local level, for predicting brain synchrony in the right middle frontal gyrus (R2 adj = 6.78%). Generally, models based on the emotional content of dialogues lose predictive power when limited to data from one region of interest at a time, whereas models based on syntactic/semantic features show the opposite trend, losing predictive power when incorporating data from all regions of interest. Moreover, we found an interplay between emotions and associative knowledge in predicting brain synchrony, especially in social interactions based on role-play techniques, providing quantitative support to the major role played by the prefrontal cortex in conditions of identity faking. Our study identifies a mind-brain duality in emotions and associative knowledge reflecting neural synchrony levels, opening new ways for investigating human interactions.

The effect of interbrain synchronization in gesture observation: A fNIRS study

Dynamic brain networks in spontaneous gestural communication

The Increasing Effect of Interoception on Brain Frontal Responsiveness During a Socially Framed Motor Synchronization Task

Donate or receive? Social hyperscanning application with fNIRS

What hyperscanning and brain connectivity for hemodynamic (fNIRS), electrophysiological (EEG) and behavioral measures can tell us about prosocial behavior.

Inter-brain entrainment (IBE) during interoception. A multimodal EEG-fNIRS coherence-based hyperscanning approach

Two is better than one: The effects of strategic cooperation on intra- and inter-brain connectivity by fNIRS

Neural Correlates of Cooperation During Interactive Visuomotor Task: an Fnirs Hyperscanning Study

Inter-Brain Network Underlying Turn-Based Cooperation and Competition: A Hyperscanning Study Using Near-Infrared Spectroscopy

The “gift effect” on functional brain connectivity. Inter-brain synchronization when prosocial behavior is in action

Dyadic inter-brain EEG coherence induced by interoceptive hyperscanning

Cooperative Behavior Evokes Interbrain Synchrony in the Prefrontal and Temporoparietal Cortex: A Systematic Review and Meta-Analysis of fNIRS Hyperscanning Studies

Multimodal Affective State Assessment Using fNIRS + EEG and Spontaneous Facial Expression

NIRS-Based Hyperscanning Reveals Inter-brain Neural Synchronization during Cooperative Jenga Game with Face-to-Face Communication

Interbrain Synchrony in the Expectation of Cooperation Behavior: A Hyperscanning Study Using Functional Near-Infrared Spectroscopy

Emotional Content and Semantic Structure of Dialogues Predict Interpersonal Neural Synchrony in the Prefrontal Cortex: a Hyperscanning Study with Functional Near-Infrared Spectroscopy

Inter-Brain Synchrony in Open-Ended Collaborative Learning: An fNIRS-Hyperscanning Study

An Exploratory Analysis of the Neural Correlates of Human-Robot Interactions With Functional Near Infrared Spectroscopy

Dynamic inter-brain synchrony in real-life inter-personal cooperation: A functional near-infrared spectroscopy hyperscanning study

EEG brain oscillations are modulated by interoception in response to a synchronized motor vs. cognitive task

Interbrain Synchrony of Team Collaborative Decision-Making: An fNIRS Hyperscanning Study