Abstract:We introduce a deep‐learning based multimodal data‐driven method for cerebellar pathway parcellation, which incorporates both measures of microstructure and connectivity, and measures of individual functional performance. We find that it is possible to identify multiple cerebellar pathway parcels with unique structure–function saliency patterns that are stable across training folds. Parcellation of human cerebellar pathways is essential for advancing our understanding of the human brain. Existing diffusion magnetic resonance imaging tractography parcellation methods have been successful in defining major cerebellar fibre tracts, while relying solely on fibre tract structure. However, each fibre tract may relay information related to multiple cognitive and motor functions of the cerebellum. Hence, it may be beneficial for parcellation to consider the potential importance of the fibre tracts for individual motor and cognitive functional performance measures. In this work, we propose a multimodal data‐driven method for cerebellar pathway parcellation, which incorporates both measures of microstructure and connectivity, and measures of individual functional performance. Our method involves first training a multitask deep network to predict various cognitive and motor measures from a set of fibre tract structural features. The importance of each structural feature for predicting each functional measure is then computed, resulting in a set of structure–function saliency values that are clustered to parcellate cerebellar pathways. We refer to our method as Deep Multimodal Saliency Parcellation (DeepMSP), as it computes the saliency of structural measures for predicting cognitive and motor functional performance, with these saliencies being applied to the task of parcellation. Applying DeepMSP to a large‐scale dataset from the Human Connectome Project Young Adult study (n = 1065), we found that it was feasible to identify multiple cerebellar pathway parcels with unique structure–function saliency patterns that were stable across training folds. We thoroughly experimented with all stages of the DeepMSP pipeline, including network selection, structure–function saliency representation, clustering algorithm, and cluster count. We found that a 1D convolutional neural network architecture and a transformer network architecture both performed comparably for the multitask prediction of endurance, strength, reading decoding, and vocabulary comprehension, with both architectures outperforming a fully connected network architecture. Quantitative experiments demonstrated that a proposed low‐dimensional saliency representation with an explicit measure of motor versus cognitive category bias achieved the best parcellation results, while a parcel count of four was most successful according to standard cluster quality metrics. Our results suggested that motor and cognitive saliencies are distributed across the cerebellar white matter pathways. Inspection of the final k = 4 parcellation revealed that the highest‐saliency parcel was most salient for the prediction of both motor and cognitive performance scores and included parts of the middle and superior cerebellar peduncles. Our proposed saliency‐based parcellation framework, DeepMSP, enables multimodal, data‐driven tractography parcellation. Through utilising both structural features and functional performance measures, this parcellation strategy may have the potential to enhance the study of structure–function relationships of the cerebellar pathways.

Unraveling somatotopic organization in the human brain using machine learning and adaptive supervoxel-based parcellations

Identifying Functional Subdivisions in the Human Brain Using Meta-Analytic Activation Modeling-Based Parcellation

Defining functional SMA and pre-SMA subregions in human MFC using resting state fMRI: Functional connectivity-based parcellation method

An algorithm for identifying task-specific brain subnetworks using the visuomotor system as an example

A somato-cognitive action network alternates with effector regions in motor cortex

Cerebro-spinal somatotopic organization uncovered through functional connectivity mapping

Local-Global Parcellation of the Human Cerebral Cortex from Intrinsic Functional Connectivity MRI

Individual-Specific Areal-Level Parcellations Improve Functional Connectivity Prediction of Behavior

Convergent functional architecture of the superior parietal lobule unraveled with multimodal neuroimaging approaches.

Deep multimodal saliency parcellation of cerebellar pathways: Linking microstructure and individual function through explainable multitask learning

fMRI-based spatio-temporal parcellations of the human brain

Connectivity-based Parcellation of Functional SubROIs in Putamen Using a Sparse Spatially Regularized Regression Model

Functional Connectivity-Based Parcellation of the Thalamus: an Unsupervised Clustering Method and Its Validity Investigation

Parcellation-based tractographic modeling of the salience network through meta-analysis

Atlas-guided parcellation: Individualized functionally-homogenous parcellation in cerebral cortex

Body Topography Parcellates Human Sensory and Motor Cortex

Sensory and motor cortices parcellations estimated via distance-weighted sparse representation with application to autism spectrum disorder

Combining Self-Organizing Mapping and Supervised Affinity Propagation Clustering Approach to Investigate Functional Brain Networks Involved in Motor Imagery and Execution with Fmri Measurements

Unrevealing Reliable Cortical Parcellation of Individual Brains Using Resting-State Functional Magnetic Resonance Imaging and Masked Graph Convolutions

Functional-based parcellation of the mouse prefrontal cortex for network perturbation analysis