Mapping multi-modal dynamic network activity during naturalistic music listening

Sarah EM Faber,Anthony Randal McIntosh,Tanya Brown,Sarah Carpentier

DOI: https://doi.org/10.1101/2023.07.05.547865

2024-03-11

Abstract:The human brain is a complex, adaptive system capable of parsing complex stimuli and generating complex behaviour. Understanding how to model and interpret the dynamic relationship between brain, behaviour, and the environment will provide vital information on how the brain responds to real-world stimuli, develops and ages, and adapts to pathology. Modelling together numerous streams of dynamic data, however, presents sizable methodological challenges. In this paper, we present a novel workflow and sample interpretation of a data set incorporating brain, behavioural, and stimulus data from a music listening study. We use hidden Markov modelling (HMM) to extract network timeseries from continuous high-dimensional EEG and stimulus data, estimate timeseries variables consistent with HMM from continuous low-dimensional behavioural data, and model the multi-modal data together using partial least squares (PLS). We offer a sample interpretation of the results, including a discussion on the limitations of the currently available tools, and discuss future directions for dynamic multi-modal analysis focusing on naturalistic behaviours.

Neuroscience

What problem does this paper attempt to address?

The main goal of this paper is to propose a novel workflow to analyze multimodal dynamic network activity during natural music listening and to interpret the resulting data samples. Specifically, the study aims to address the following key issues:

1. **Developing an Analytical Framework**: The researchers aim to establish an analytical framework capable of comprehensively analyzing brain, behavior, and stimulus data. They are particularly focused on how to effectively integrate these different types of dynamic data in the context of natural music listening.

2. **Understanding Dynamic Relationships**: By using methods such as the Hidden Markov Model (HMM) to extract time-series information from continuous high-dimensional electroencephalogram (EEG) and stimulus data, and estimating time-series variables consistent with HMM from continuous low-dimensional behavioral data, they then use Partial Least Squares (PLS) to model these multimodal data. This approach aims to better understand the dynamic relationships between the brain, behavior, and the environment.

3. **Exploring Neural Mechanisms Under Natural Behavior**: Music listening, as a stimulus rich in information and capable of eliciting various responses, is well-suited for studying the dynamic changes in brain networks. The research hopes to reveal how underlying factors drive changes in network configurations by analyzing the brain network dynamics during music listening and exploring the connections between these changes and external stimuli (such as music).

4. **Addressing Methodological Challenges**: Faced with the methodological challenges of analyzing high-dimensional brain and behavioral data, the research team proposes a new workflow to demonstrate how to effectively handle such complex datasets and extract meaningful information from them.

In summary, the core of this research lies in utilizing advanced statistical and computational methods to reveal the dynamic characteristics of brain network activity in natural contexts and its association with behavioral performance, particularly in the specific context of music listening. Through this approach, the study hopes to provide important clues for further understanding how the human brain operates in the real world.