Role of arachidonic acid metabolites in the pathogenesis of acute lung injury.

A. Lonigro,A. Stephenson,R. Sprague

Abstract:

What problem does this paper attempt to address?

Narrative simulation of social experiences in naturalistic context - A neurocinematic approach

Pia Tikka,Mauri Kaipainen,Juha Salmi

DOI: https://doi.org/10.1016/j.neuropsychologia.2023.108654

IF: 3.054

2023-09-09

Neuropsychologia

Abstract:Narratives may be regarded as simulations of everyday social situations. They are key to studying the human mind in socio-culturally determined contexts as they allow anchoring to the common ground of embodied and environmentally-engaged cognition. Here we review recent findings from naturalistic neuroscience on neural functions in conditions that mimic lifelike situations. We will focus particularly on neurocinematics, a research field that applies mediated narratives as stimuli for neuroimaging experiments. During the last two decades, this paradigm has contributed to an accumulation of insights about the neural underpinnings of behavior and sense-making in various narratively contextualized situations particularly pertaining to socio-emotional encounters. One of the key questions in neurocinematics is, how do intersubjectively synchronized brain activations relate to subjective experiences? Another question we address is how to bring natural contexts into experimental studies. Seeking to respond to both questions, we suggest neurocinematic studies to examine three manifestations of the same phenomenon side-by-side: subjective experiences of narrative situations, unfolding of narrative stimulus structure, and neural processes that co-constitute the experience. This approach facilitates identifying experientially meaningful activity patterns in the brain and points out what they may mean in relation to shared and communicable contents. Via rich-featured and temporally contextualized narrative stimuli, neurocinematics attempts to contribute to emerging holistic theories of neural dynamics and connectomics explaining typical and atypical interindividual variability.
Perspective taking in the human brain: complementary evidence from neuroimaging studies with media-based naturalistic stimuli and artificial controlled paradigms

Iiro P Jääskeläinen,Vladimir Kosonogov

DOI: https://doi.org/10.3389/fnhum.2023.1051934

2023-02-15

Abstract:Perception and interpretation of various types of events and information in life crucially depend on one's perspective. A specific perspective can be explicitly adopted, for example, via instructing an experimental subject, implicitly via a priori information given to subjects, and by subjects' personality traits or cultural background. The neural basis of perspective taking has been addressed in a number of recent neuroimaging studies, some of which have used movies and narratives as media-based stimuli to pursue a holistic understanding of the phenomenon under ecologically valid conditions. Results across these studies suggest that the human brain flexibly adapts to support the information-processing needs of different perspectives, however, also that inferior temporal-occipital areas and posterior-medial parietal areas are engaged across different perspectives. These findings are complemented by studies that have investigated specific aspects of perspective taking with highly controlled experimental designs. They have disclosed involvement of the temporoparietal junction in visual perspective taking and the importance of the affective component of the pain matrix when empathizing with others' pain. Identification with the protagonists also seems to matter, as dorsomedial vs. ventromedial prefrontal areas are recruited when the protagonist is dissimilar vs. similar to self. Finally, as a translational aspect, perspective taking can, under certain conditions, serve as an effective emotion regulation technique, wherein lateral and medial regions of the prefrontal cortex seem to support reappraisal processes. Together, findings from studies with media-based stimuli and more traditional paradigms complement each other to gain a comprehensive understanding of the neural basis of perspective taking.
Exploring the Neural Processes behind Narrative Engagement: An EEG Study

Hossein Dini,Aline Simonetti,Luis Emilio Bruni

DOI: https://doi.org/10.1523/ENEURO.0484-22.2023

2023-07-17

eNeuro

Abstract:Past cognitive neuroscience studies using naturalistic stimuli have considered narratives holistically and focused on cognitive processes. In this study, we incorporated the narrative structure, the dramatic arc, as an object of investigation, to examine how engagement levels fluctuate across a narrative-aligned dramatic arc. We explored the possibility of predicting self-reported engagement ratings from neural activity and investigated the idiosyncratic effects of each phase of the dramatic arc on brain responses as well as the relationship between engagement and brain responses. We presented a movie excerpt following the six-phase narrative arc structure to female and male participants while collecting EEG signals. We then asked this group of participants to recall the excerpt, another group to segment the video based on the dramatic arc model, and a third to rate their engagement levels while watching the movie. The results showed that the self-reported engagement ratings followed the pattern of the narrative dramatic arc. Moreover, while EEG amplitude could not predict group-averaged engagement ratings, other features comprising dynamic intersubject correlation (dISC), including certain frequency bands, dynamic functional connectivity patterns and graph features were able to achieve this. Furthermore, neural activity in the last two phases of the dramatic arc significantly predicted engagement patterns. This study is the first to explore the cognitive processes behind the dramatic arc and its phases. By demonstrating how neural activity predicts self-reported engagement, which itself aligns with the narrative structure, this study provides insights on the interrelationships between narrative structure, neural responses, and viewer engagement.
Processing of the same narrative stimuli elicits common functional connectivity dynamics between individuals

Başak Türker,Laouen Belloli,Adrian M Owen,Lorina Naci,Jacobo D Sitt

DOI: https://doi.org/10.1038/s41598-023-48656-7

2023-12-02

Abstract:It has been suggested that conscious experience is linked to the richness of brain state repertories, which change in response to environmental and internal stimuli. High-level sensory stimulation has been shown to alter local brain activity and induce neural synchrony across participants. However, the dynamic interplay of cognitive processes underlying moment-to-moment information processing remains poorly understood. Using naturalistic movies as an ecological laboratory model of the real world, here we investigate how the processing of complex naturalistic stimuli alters the dynamics of brain network interactions and how these in turn support information processing. Participants underwent fMRI recordings during movie watching, scrambled movie watching, and resting. By measuring the phase-synchrony between different brain networks, we analyzed whole-brain connectivity patterns. Our finding revealed distinct connectivity patterns associated with each experimental condition. We found higher synchronization of brain patterns across participants during movie watching compared to rest and scrambled movie conditions. Furthermore, synchronization levels increased during the most engaging parts of the movie. The synchronization dynamics among participants were associated with suspense; scenes with higher levels of suspense induced greater synchronization. These results suggest that processing the same high-level information elicits common neural dynamics across individuals, and that whole-brain functional connectivity tracks variations in processed information and subjective experience.
A naturalistic neuroimaging database for understanding the brain using ecological stimuli

Sarah Aliko,Jiawen Huang,Florin Gheorghiu,Stefanie Meliss,Jeremy I. Skipper

DOI: https://doi.org/10.1038/s41597-020-00680-2

2020-10-13

Scientific Data

Abstract:Abstract Neuroimaging has advanced our understanding of human psychology using reductionist stimuli that often do not resemble information the brain naturally encounters. It has improved our understanding of the network organization of the brain mostly through analyses of ‘resting-state’ data for which the functions of networks cannot be verifiably labelled. We make a ‘ Naturalistic Neuroimaging Database ’ (NNDb v1.0) publically available to allow for a more complete understanding of the brain under more ecological conditions during which networks can be labelled. Eighty-six participants underwent behavioural testing and watched one of 10 full-length movies while functional magnetic resonance imaging was acquired. Resulting timeseries data are shown to be of high quality, with good signal-to-noise ratio, few outliers and low movement. Data-driven functional analyses provide further evidence of data quality. They also demonstrate accurate timeseries/movie alignment and how movie annotations might be used to label networks. The NNDb can be used to answer questions previously unaddressed with standard neuroimaging approaches, progressing our knowledge of how the brain works in the real world.

multidisciplinary sciences
Toward naturalistic neuroscience: Mechanisms underlying the flattening of brain hierarchy in movie-watching compared to rest and task

Yonatan Sanz Perl,Enzo Tagliazucchi,Gustavo Deco,Morten L. Kringelbach

DOI: https://doi.org/10.1126/sciadv.ade6049

IF: 13.6

2023-01-14

Science Advances

Abstract:Identifying the functional specialization of the brain has moved from using cognitive tasks and resting state to using ecological relevant, naturalistic movies. We leveraged a large-scale neuroimaging dataset to directly investigate the hierarchical reorganization of functional brain activity when watching naturalistic films compared to performing seven cognitive tasks and resting. A thermodynamics-inspired whole-brain model paradigm revealed the generative underlying mechanisms for changing the balance in causal interactions between brain regions in different conditions. Paradoxically, the hierarchy is flatter for movie-watching, and the level of nonreversibility is significantly smaller in comparison to both rest and tasks, where the latter in turn have the highest levels of hierarchy and nonreversibility. The underlying mechanisms were revealed by the model-based generative effective connectivity (GEC). Naturalistic films could therefore provide a fast and convenient way to measure important changes in GEC (integrating functional and anatomical connectivity) found in, for example, neuropsychiatric disorders. Overall, this study demonstrates the benefits of moving toward a more naturalistic neuroscience.

multidisciplinary sciences
Inter- and intra-subject similarity in network functional connectivity across a full narrative movie

Lisa N Mochalski,Patrick Friedrich,Xuan Li,Jean-Philippe Kroell,Simon B Eickhoff,Susanne Weis

DOI: https://doi.org/10.1101/2024.05.14.594107

2024-05-14

Abstract:Naturalistic paradigms, such as watching movies during functional magnetic resonance imaging (fMRI), are thought to prompt the emotional and cognitive processes typically elicited in real life situations. Therefore, naturalistic viewing (NV) holds great potential for studying individual differences. However, in how far NV elicits similarity within and between subjects on a network level, particularly depending on emotions portrayed in movies, is currently unknown. We used the studyforrest dataset to investigate the inter- and intra-subject similarity in network functional connectivity (NFC) of 14 meta-analytically defined networks across a full narrative, audio-visual movie split into 8 consecutive movie segments. We characterized the movie segments by valence and arousal portrayed within the sequences, before utilizing a linear mixed model to analyze which factors explain inter- and intra-subject similarity. Our results showed that the model best explaining inter-subject similarity comprised network, movie segment, valence and a movie segment by valence interaction. Intra-subject similarity was influenced significantly by the same factors and an additional three-way interaction between movie segment, valence and arousal. Overall, inter- and intra-subject similarity in NFC were sensitive to the ongoing narrative and emotions in the movie. Lowest similarity both within and between subjects was seen in the emotional regulation network and networks associated with long-term memory processing, which might be explained by specific features and content of the movie. We conclude that detailed characterization of movie features is crucial for NV research.

Neuroscience
Neural substrates of narrative comprehension and memory

Tal Yarkoni,Nicole K Speer,Jeffrey M Zacks

DOI: https://doi.org/10.1016/j.neuroimage.2008.03.062

IF: 5.7

2008-07-15

NeuroImage

Abstract:When reading a narrative, comprehension and retention of information benefit considerably from the use of situation models--coherent representations of the characters, locations, and activities described in the text. Here we used functional magnetic resonance imaging (fMRI) to explore the neural mechanisms supporting situation model processing. Participants read blocks of sentences that were either unrelated to one another or formed coherent narratives. A timecourse-based approach was used to identify regions that differentiated narrative-level comprehension from sentence-level comprehension. Most brain regions that showed modulation of activation during narrative-level comprehension were also modulated to a lesser extent during sentence-level comprehension, suggesting a shared reliance on general coherence-building mechanisms. However, tentative evidence was found for narrative-specific activation in dorsomedial prefrontal cortex. Additional analyses identified spatiotemporally distinct neural contributions to situation model processing, with posterior parietal regions supporting situation model construction and frontotemporal regions supporting situation model maintenance. Finally, a set of subsequent memory analyses demonstrated that the boost in comprehension and memory performance observed for coherent materials was attributable to the use of integrative situation models rather than lower-level differences in sentence-level or word-level encoding. These results clarify the functional contributions of distinct brain systems to situation model processing and their mapping onto existing psychological models of narrative comprehension.
Investigation of functional brain network reconfiguration during exposure to naturalistic stimuli using graph-theoretical analysis

Gaoyan Zhang,Xin Liu

DOI: https://doi.org/10.1088/1741-2552/ac20e7

IF: 5.043

2021-09-13

Journal of Neural Engineering

Abstract:Abstract Objective. One of the most significant features of the human brain is that it can dynamically reconfigure itself to adapt to a changing environment. However, dynamic interaction characteristics of the brain networks in naturalistic scenes remain unclear. Approach. We used open-source functional magnetic resonance imaging (fMRI) data from 15 participants who underwent fMRI scans while watching an audio–visual movie ‘Forrest Gump’. The community detection algorithm based on inter-subject functional correlation was used to study the time-varying functional networks only induced by the movie stimuli. The whole brain reconfiguration patterns were quantified by the temporal co-occurrence matrix that describes the probability of two brain regions engage in the same community (or putative functional module) across time and the time-varying brain modularity. Four graph metrics of integration, recruitment, spatio-temporal diversity and within-community normalised centrality were further calculated to summarise the brain network dynamic roles and hub features in their spatio-temporal topology. Main results. Our results suggest that the networks that were involved in attention and audio–visual information processing, such as the visual network, auditory network, and dorsal attention network, were considered to play a role of ‘stable loners’. By contrast, ‘unstable loner’ networks such as the default mode network (DMN) and fronto-parietal network tended to interact more flexibly with the other networks. In addition, global brain network showed significant fluctuations in modularity. The ‘stable loner’ networks always maintained high functional connectivity (FC) strength while ‘unstable loner’ networks, especially the DMN, exhibited high intra- and inter-network FC only during a low modularity period. Finally, changes in brain modularity were significantly associated with variations in emotions induced by the movie. Significance. Our findings provide new insight for understanding the dynamic interaction characteristics of functional brain networks during naturalistic stimuli.

engineering, biomedical,neurosciences
Identifying Naturalistic Movies from Human Brain Activity with High-Density Diffuse Optical Tomography

Zachary E. Markow,Kalyan Tripathy,Alexandra M. Svoboda,Mariel L. Schroeder,Sean M. Rafferty,Edward J. Richter,Adam T. Eggebrecht,Mark A. Anastasio,Mark A. Chevillet,Emily M. Mugler,Stephanie N. Naufel,Allen Yin,Jason W. Trobaugh,Joseph P. Culver

DOI: https://doi.org/10.1101/2023.11.27.566650

2024-05-22

Abstract:Modern neuroimaging modalities, particularly functional MRI (fMRI), can decode detailed human experiences. Thousands of viewed images can be identified or classified, and sentences can be reconstructed. Decoding paradigms often leverage encoding models that reduce the stimulus space into a smaller yet generalizable feature set. However, the neuroimaging devices used for detailed decoding are non-portable, like fMRI, or invasive, like electrocorticography, excluding application in naturalistic use. Wearable, non-invasive, but lower-resolution devices such as electroencephalography and functional near-infrared spectroscopy (fNIRS) have been limited to decoding between stimuli used during training. Herein we develop and evaluate model-based decoding with high-density diffuse optical tomography (HD-DOT), a higher-resolution expansion of fNIRS with demonstrated promise as a surrogate for fMRI. Using a motion energy model of visual content, we decoded the identities of novel movie clips outside the training set with accuracy far above chance for single-trial decoding. Decoding was robust to modulations of testing time window, different training and test imaging sessions, hemodynamic contrast, and optode array density. Our results suggest that HD-DOT can translate detailed decoding into naturalistic use.

Bioengineering
Neural association between musical features and shared emotional perception while movie-watching: fMRI study

Leonardo Muller-Rodriguez,Owen O'Daly

2024-10-30

Abstract:The growing use of naturalistic stimuli, such as feature films, brings research on emotions closer to ecologically valid settings within brain scanners, such as functional magnetic resonance imaging (fMRI). Music is another cultural artifact known to evoke emotions, and film soundtracks are often designed to enhance the emotional impact of the narrative. However, the neural basis of shared emotional perception during movie-watching, and its relationship to the soundtrack, remains unclear. In this study, participants watched Forrest Gump in a 3T fMRI scanner. The reported shared arousal and valence (positive and negative) was correlated with the spectrogram and tempo information extracted from the soundtrack. For neuroimaging, four regions of interest (ROIs) related to audiovisual input and narrative content were examined: the superior temporal sulcus (STS), amygdala, inferior frontal gyrus, and precuneus. Results: Strong correlations between spectral and tempo, and emotional features (Bonferroni corr). BOLD responses associated with shared positive and negative valence and high-arousal moments were compared to film events with low emotional agreement. Significant activations were found in the STS and precuneus (pFWE < 0.05 peak level). No significant responses were observed in the amygdala or inferior frontal gyrus, but whole-brain analysis (pFWE < 0.05 cluster extent) revealed frontal activity linked to negative valence, alongside expected occipito-temporal lobe responses to the audiovisual stimuli. The STS and precuneus were particularly active during shared emotional perception of valenced and high-arousal events, with the precuneus encoding valence from auditory information. Naturalistic stimuli show promise as diagnostic and therapeutic tools for emotion regulation deficits although challenges may arise when crafting an experimental control.

Neurons and Cognition
Pegylated filgrastim (PF) after high dose chemotherapy (HDC) and autologous stem cell transplant (ASCT).

M. Jagasia,J. Greer,A. Kassim,S. Mineishi,D. Morgan,K. Ruffner,F. Schuening

DOI: https://doi.org/10.1016/J.BBMT.2003.12.035

IF: 45.3

2004-02-01

Journal of Clinical Oncology

Abstract:
Movie viewing elicits rich and reliable brain state dynamics

Johan N. van der Meer,Michael Breakspear,Luke J. Chang,Saurabh Sonkusare,Luca Cocchi

DOI: https://doi.org/10.1038/s41467-020-18717-w

IF: 16.6

2020-10-05

Nature Communications

Abstract:Abstract Adaptive brain function requires that sensory impressions of the social and natural milieu are dynamically incorporated into intrinsic brain activity. While dynamic switches between brain states have been well characterised in resting state acquisitions, the remodelling of these state transitions by engagement in naturalistic stimuli remains poorly understood. Here, we show that the temporal dynamics of brain states, as measured in fMRI, are reshaped from predominantly bistable transitions between two relatively indistinct states at rest, toward a sequence of well-defined functional states during movie viewing whose transitions are temporally aligned to specific features of the movie. The expression of these brain states covaries with different physiological states and reflects subjectively rated engagement in the movie. In sum, a data-driven decoding of brain states reveals the distinct reshaping of functional network expression and reliable state transitions that accompany the switch from resting state to perceptual immersion in an ecologically valid sensory experience.

multidisciplinary sciences
Functional near-infrared spectroscopy imaging of the prefrontal cortex during a naturalistic comedy movie

Noam Somech,Tamar Mizrahi,Yael Caspi,Vadim Axelrod

DOI: https://doi.org/10.3389/fnins.2022.913540

2022-09-08

Abstract:Naturalistic stimulation (i.e., movies and auditory narratives of some minutes' length) has been a powerful approach to bringing more real-life experiences into laboratory experiments. Data-driven, intersubject correlation (ISC) analysis permits examining to what extent activity in a specific brain region correlates across participants during exposure to a naturalistic stimulus, as well as testing whether neural activity correlates with behavioral measures. Notably, most of the previous research with naturalistic stimuli was conducted using functional fMRI (fMRI). Here, we tested whether a naturalistic approach and the ISC are feasible using functional near-infrared spectroscopy (fNIRS) - the imaging method particularly suited for populations of patients and children. Fifty-three healthy adult participants watched twice a 3-min segment of a Charlie Chaplin movie while we recorded the brain activity on the surface of their prefrontal cortex using fNIRS. In addition, an independent group of 18 participants used a continuous scoring procedure to rate the extent to which they felt that different parts of the movie fragment were funny. Our two findings were as follows. First, we found higher-than-zero ISC in fNIRS signals in the prefrontal cortex lobes, a result that was particularly high in the oxygenated channels during the first repetition of the movie. Second, we found a significant negative correlation between oxygenated brain signals and ratings of the movie's humorousness. In a series of control analyses we demonstrated that this latter correlation could not be explained by various non-humor-related movie sensory properties (e.g., auditory volume and image brightness). The key overall outcome of the present study is that fNIRS in combination with the naturalistic paradigms and the ISC might be a sensitive and powerful research method to explore cognitive processing. Our results also suggest a potential role of the prefrontal cortex in humor appreciation.
Individual differences in functional connectivity during naturalistic viewing conditions

Tamara Vanderwal,Jeffrey Eilbott,Emily S. Finn,R. Cameron Craddock,Adam Turnbull,F. Xavier Castellanos

DOI: https://doi.org/10.1016/j.neuroimage.2017.06.027

IF: 5.7

2017-08-01

NeuroImage

Abstract:Naturalistic viewing paradigms such as movies have been shown to reduce participant head motion and improve arousal during fMRI scanning relative to task-free rest, and have been used to study both functional connectivity and stimulus-evoked BOLD-signal changes. These task-based hemodynamic changes are synchronized across subjects and involve large areas of the cortex, and it is unclear whether individual differences in functional connectivity are enhanced or diminished under such naturalistic conditions. This work first aims to characterize variability in BOLD-signal based functional connectivity (FC) across 2 distinct movie conditions and eyes-open rest (n=31 healthy adults, 2 scan sessions each). We found that movies have higher within- and between-subject correlations in cluster-wise FC relative to rest. The anatomical distribution of inter-individual variability was similar across conditions, with higher variability occurring at the lateral prefrontal lobes and temporoparietal junctions. Second, we used an unsupervised test-retest matching algorithm that identifies individual subjects from within a group based on FC patterns, quantifying the accuracy of the algorithm across the three conditions. The movies and resting state all enabled identification of individual subjects based on FC matrices, with accuracies between 61% and 100%. Overall, pairings involving movies outperformed rest, and the social, faster-paced movie attained 100% accuracy. When the parcellation resolution, scan duration, and number of edges used were increased, accuracies improved across conditions, and the pattern of movies>rest was preserved. These results suggest that using dynamic stimuli such as movies enhances the detection of FC patterns that are unique at the individual level.

radiology, nuclear medicine & medical imaging,neurosciences,neuroimaging
The neural basis of naturalistic semantic and social cognition

Melissa Thye,Paul Hoffman,Daniel Mirman

DOI: https://doi.org/10.1038/s41598-024-56897-3

IF: 4.6

2024-03-23

Scientific Reports

Abstract:Decoding social environments and engaging meaningfully with other people are critical aspects of human cognition. Multiple cognitive systems, including social and semantic cognition, work alongside each other to support these processes. This study investigated shared processing between social and semantic systems using neuroimaging data collected during movie-viewing, which captures the multimodal environment in which social knowledge is exchanged. Semantic and social content from movie events (event-level) and movie transcripts (word-level) were used in parametric modulation analyses to test (1) the degree to which semantic and social information is processed within each respective network and (2) engagement of the same cross-network regions or the same domain-general hub located within the semantic network during semantic and social processing. Semantic word and event-level content engaged the same fronto-temporo-parietal network and a portion of the semantic hub in the anterior temporal lobe (ATL). Social word and event-level content engaged the supplementary motor area and right angular gyrus within the social network, but only social words engaged the domain-general semantic hub in left ATL. There was evidence of shared processing between the social and semantic systems in the dorsolateral portion of right ATL which was engaged by word and event-level semantic and social content. Overlap between the semantic and social word and event results was highly variable within and across participants, with the most consistent loci of overlap occurring in left inferior frontal, bilateral precentral and supramarginal gyri for social and semantic words and in bilateral superior temporal gyrus extending from ATL posteriorly into supramarginal gyri for social and semantic events. These results indicate a complex pattern of shared and distinct regions for social and semantic cognition during naturalistic processing.

multidisciplinary sciences
Probing Individual Differences in the Topological Landscape of Naturalistic Brain Dynamics

Junxing Xian,Yini He,Yan Yan,Xiaohan Tian,Yingjie Peng,Jing Lou,Xiya Liu,Qi Wang,Tian Gao,Qi Wang,Yuqing Sun,Puze Li,Yue Wang,Shangzheng Huang,Kaixin Li,Ke Hu,Chaoyue Ding,Dazheng Li,Meng Wang,Bing Liu,Ang Li

DOI: https://doi.org/10.1101/2024.06.20.599966

2024-11-17

Abstract:Psychiatry seeks to unravel brain dysfunction and individual differences in real-world contexts. Naturalistic stimuli, like movie watching, are increasingly recognized for eliciting complex, context-dependent neural activity with high ecological validity. Yet, current methods often rely on standard paradigms that average data across time, limiting the full potential of such stimuli. Here, we present STIM, a Topological Data Analysis-based framework designed to dynamically track how individuals integrate complex contexts in real time. Applied to large-sample fMRI data from movie watching, STIM constructs a robust low-dimensional dynamical landscape that reflects group consensus while probing individual variations at both global (spanning narratives) and local (within specific narratives) levels. At the global level, individual differences emerge along a center-periphery gradient in the dynamical landscape, which significantly predicts fluid intelligence, underscoring the importance of neural adaptability and diversity. At finer scales, local geometric features correlate with context-specific psychological traits beyond cognition. STIM also captures developmental changes in the dynamical landscape and reveals abnormalities in conditions such as autism. These findings demonstrate that STIM leverages the rich information from movie stimuli and fMRI recordings as neural ‘probes’ to assess individual differences in cognition and mental health.

Neuroscience
Neural Processing of Naturalistic Audiovisual Events in Space and Time

Yu Hu,Yalda Mohsenzadeh

DOI: https://doi.org/10.1101/2024.05.14.594145

2024-05-14

Abstract:Our brain seamlessly integrates distinct sensory information to form a coherent percept. However, when real-world audiovisual events are perceived, the specific brain regions and timings for processing different levels of information remain less investigated. To address that, we curated naturalistic videos and recorded fMRI and EEG data when participants viewed videos with accompanying sounds. Our findings reveal early asymmetrical cross-modal interaction, with acoustic information represented in both early visual and auditory regions, while visual information only identified in visual cortices. The visual and auditory features were processed with similar onset but different temporal dynamics. High-level categorical and semantic information emerged in multi-modal association areas later in time, indicating late cross-modal integration and its distinct role in converging conceptual information. Comparing neural representations to a two-branch deep neural network model highlighted the necessity of early fusion to build a biologically plausible model of audiovisual perception. With EEG-fMRI fusion, we provided a spatiotemporally resolved account of neural activity during the processing of naturalistic audiovisual stimuli.

Neuroscience
Moving toward reality: Electrocortical reactivity to naturalistic multimodal emotional videos

Dean Sabatinelli,Andrew H. Farkas,Matthew C. Gehr

DOI: https://doi.org/10.1111/psyp.14526

2024-01-26

Psychophysiology

Abstract:While previous research has investigated the effects of emotional videos on peripheral physiological measures and conscious experience, this study extends the research to include electrocortical measures, specifically the steady‐state visual‐evoked potential (ssVEP). A carefully curated set of 45 videos, designed to represent a wide range of emotional and neutral content, were presented with a flickering border. The videos featured a continuous single‐shot perspective, natural soundtrack, and excluded elements associated with professional films, to enhance realism. The results demonstrate a consistent reduction in ssVEP amplitude during emotional videos which strongly correlates with the rated emotional intensity of the clips. This suggests that narrative audiovisual stimuli have the potential to track dynamic emotional processing in the cortex, providing new avenues for research in affective neuroscience. The findings highlight the potential of using realistic video stimuli to investigate how the human brain processes emotional events in a paradigm that increases ecological validity. Future studies can further develop this paradigm by expanding the video set, targeting specific cortical networks, and manipulating narrative predictability. Overall, this study establishes a foundation for investigating emotional perception using realistic video stimuli and has the potential to expand our understanding of real‐world emotional processing in the human brain.

psychology, experimental,physiology,neurosciences, biological
A hybrid learning framework for fine-grained interpretation of brain spatiotemporal patterns during naturalistic functional magnetic resonance imaging

Sigang Yu,Enze Shi,Ruoyang Wang,Shijie Zhao,Tianming Liu,Xi Jiang,Shu Zhang

DOI: https://doi.org/10.3389/fnhum.2022.944543

2022-09-30

Abstract:Naturalistic stimuli, including movie, music, and speech, have been increasingly applied in the research of neuroimaging. Relative to a resting-state or single-task state, naturalistic stimuli can evoke more intense brain activities and have been proved to possess higher test-retest reliability, suggesting greater potential to study adaptive human brain function. In the current research, naturalistic functional magnetic resonance imaging (N-fMRI) has been a powerful tool to record brain states under naturalistic stimuli, and many efforts have been devoted to study the high-level semantic features from spatial or temporal representations via N-fMRI. However, integrating both spatial and temporal characteristics of brain activities for better interpreting the patterns under naturalistic stimuli is still underexplored. In this work, a novel hybrid learning framework that comprehensively investigates both the spatial (via Predictive Model) and the temporal [via convolutional neural network (CNN) model] characteristics of the brain is proposed. Specifically, to focus on certain relevant regions from the whole brain, regions of significance (ROS), which contain common spatial activation characteristics across individuals, are selected via the Predictive Model. Further, voxels of significance (VOS), whose signals contain significant temporal characteristics under naturalistic stimuli, are interpreted via one-dimensional CNN (1D-CNN) model. In this article, our proposed framework is applied onto the N-fMRI data during naturalistic classical/pop/speech audios stimuli. The promising performance is achieved via the Predictive Model to differentiate the different audio categories. Especially for distinguishing the classic and speech audios, the accuracy of classification is up to 92%. Moreover, spatial ROS and VOS are effectively obtained. Besides, temporal characteristics of the high-level semantic features are investigated on the frequency domain via convolution kernels of 1D-CNN model, and we effectively bridge the "semantic gap" between high-level semantic features of N-fMRI and low-level acoustic features of naturalistic audios in the frequency domain. Our results provide novel insights on characterizing spatiotemporal patterns of brain activities via N-fMRI and effectively explore the high-level semantic features under naturalistic stimuli, which will further benefit the understanding of the brain working mechanism and the advance of naturalistic stimuli clinical application.

Role of arachidonic acid metabolites in the pathogenesis of acute lung injury.

Narrative simulation of social experiences in naturalistic context - A neurocinematic approach

Perspective taking in the human brain: complementary evidence from neuroimaging studies with media-based naturalistic stimuli and artificial controlled paradigms

Exploring the Neural Processes behind Narrative Engagement: An EEG Study

Processing of the same narrative stimuli elicits common functional connectivity dynamics between individuals

A naturalistic neuroimaging database for understanding the brain using ecological stimuli

Toward naturalistic neuroscience: Mechanisms underlying the flattening of brain hierarchy in movie-watching compared to rest and task

Inter- and intra-subject similarity in network functional connectivity across a full narrative movie

Neural substrates of narrative comprehension and memory

Investigation of functional brain network reconfiguration during exposure to naturalistic stimuli using graph-theoretical analysis

Identifying Naturalistic Movies from Human Brain Activity with High-Density Diffuse Optical Tomography

Neural association between musical features and shared emotional perception while movie-watching: fMRI study

Pegylated filgrastim (PF) after high dose chemotherapy (HDC) and autologous stem cell transplant (ASCT).

Movie viewing elicits rich and reliable brain state dynamics

Functional near-infrared spectroscopy imaging of the prefrontal cortex during a naturalistic comedy movie

Individual differences in functional connectivity during naturalistic viewing conditions

The neural basis of naturalistic semantic and social cognition

Probing Individual Differences in the Topological Landscape of Naturalistic Brain Dynamics

Neural Processing of Naturalistic Audiovisual Events in Space and Time

Moving toward reality: Electrocortical reactivity to naturalistic multimodal emotional videos

A hybrid learning framework for fine-grained interpretation of brain spatiotemporal patterns during naturalistic functional magnetic resonance imaging