Abstract:We introduce a deep‐learning based multimodal data‐driven method for cerebellar pathway parcellation, which incorporates both measures of microstructure and connectivity, and measures of individual functional performance. We find that it is possible to identify multiple cerebellar pathway parcels with unique structure–function saliency patterns that are stable across training folds. Parcellation of human cerebellar pathways is essential for advancing our understanding of the human brain. Existing diffusion magnetic resonance imaging tractography parcellation methods have been successful in defining major cerebellar fibre tracts, while relying solely on fibre tract structure. However, each fibre tract may relay information related to multiple cognitive and motor functions of the cerebellum. Hence, it may be beneficial for parcellation to consider the potential importance of the fibre tracts for individual motor and cognitive functional performance measures. In this work, we propose a multimodal data‐driven method for cerebellar pathway parcellation, which incorporates both measures of microstructure and connectivity, and measures of individual functional performance. Our method involves first training a multitask deep network to predict various cognitive and motor measures from a set of fibre tract structural features. The importance of each structural feature for predicting each functional measure is then computed, resulting in a set of structure–function saliency values that are clustered to parcellate cerebellar pathways. We refer to our method as Deep Multimodal Saliency Parcellation (DeepMSP), as it computes the saliency of structural measures for predicting cognitive and motor functional performance, with these saliencies being applied to the task of parcellation. Applying DeepMSP to a large‐scale dataset from the Human Connectome Project Young Adult study (n = 1065), we found that it was feasible to identify multiple cerebellar pathway parcels with unique structure–function saliency patterns that were stable across training folds. We thoroughly experimented with all stages of the DeepMSP pipeline, including network selection, structure–function saliency representation, clustering algorithm, and cluster count. We found that a 1D convolutional neural network architecture and a transformer network architecture both performed comparably for the multitask prediction of endurance, strength, reading decoding, and vocabulary comprehension, with both architectures outperforming a fully connected network architecture. Quantitative experiments demonstrated that a proposed low‐dimensional saliency representation with an explicit measure of motor versus cognitive category bias achieved the best parcellation results, while a parcel count of four was most successful according to standard cluster quality metrics. Our results suggested that motor and cognitive saliencies are distributed across the cerebellar white matter pathways. Inspection of the final k = 4 parcellation revealed that the highest‐saliency parcel was most salient for the prediction of both motor and cognitive performance scores and included parts of the middle and superior cerebellar peduncles. Our proposed saliency‐based parcellation framework, DeepMSP, enables multimodal, data‐driven tractography parcellation. Through utilising both structural features and functional performance measures, this parcellation strategy may have the potential to enhance the study of structure–function relationships of the cerebellar pathways.

Cerebellar Functional Parcellation Using Sparse Dictionary Learning Clustering.

Functional Subdivisions of the Cerebellum in Naturalistic Paradigm Functional Magnetic Resonance Imaging

A Connectivity-Based Parcellation Improved Functional Representation of the Human Cerebellum

Multigroup Recognition of Dementia Patients with Dynamic Brain Connectivity under Multimodal Cortex Parcellation

Hippocampus Parcellation via Discriminative Embedded Clustering of fMRI Functional Connectivity

Deep multimodal saliency parcellation of cerebellar pathways: Linking microstructure and individual function through explainable multitask learning

Functional boundaries in the human cerebellum revealed by a multi-domain task battery

BDEC:Brain Deep Embedded Clustering model

A Joint Constrained CCA Model for Network-Dependent Brain Subregion Parcellation

Striatal Subdivisions Estimated via Deep Embedded Clustering With Application to Parkinson's Disease

Atlas-guided parcellation: Individualized functionally-homogenous parcellation in cerebral cortex

Graph Learning for Cortical Parcellation from Tensor Decompositions of Resting-State fMRI

Semi-Supervised Learning for Individual-Level Functional Parcellation of the Human Precuneus

Individual-Specific Areal-Level Parcellations Improve Functional Connectivity Prediction of Behavior

Multi-scale and Focal Region Based Deep Learning Network for Fine Brain Parcellation.

T-distribution stochastic neighbor embedding for fine brain functional parcellation on rs-fMRI

Artificial Bee Colony Clustering with Self-Adaptive Crossover and Stepwise Search for Brain Functional Parcellation in Fmri Data.

A hierarchical atlas of the human cerebellum for functional precision mapping

Individualized Cortical Parcellation Using Masked Semi-supervised Graph Neural Network

Functional parcellation of the hippocampus by semi-supervised clustering of resting state fMRI data