Abstract:We introduce a deep‐learning based multimodal data‐driven method for cerebellar pathway parcellation, which incorporates both measures of microstructure and connectivity, and measures of individual functional performance. We find that it is possible to identify multiple cerebellar pathway parcels with unique structure–function saliency patterns that are stable across training folds. Parcellation of human cerebellar pathways is essential for advancing our understanding of the human brain. Existing diffusion magnetic resonance imaging tractography parcellation methods have been successful in defining major cerebellar fibre tracts, while relying solely on fibre tract structure. However, each fibre tract may relay information related to multiple cognitive and motor functions of the cerebellum. Hence, it may be beneficial for parcellation to consider the potential importance of the fibre tracts for individual motor and cognitive functional performance measures. In this work, we propose a multimodal data‐driven method for cerebellar pathway parcellation, which incorporates both measures of microstructure and connectivity, and measures of individual functional performance. Our method involves first training a multitask deep network to predict various cognitive and motor measures from a set of fibre tract structural features. The importance of each structural feature for predicting each functional measure is then computed, resulting in a set of structure–function saliency values that are clustered to parcellate cerebellar pathways. We refer to our method as Deep Multimodal Saliency Parcellation (DeepMSP), as it computes the saliency of structural measures for predicting cognitive and motor functional performance, with these saliencies being applied to the task of parcellation. Applying DeepMSP to a large‐scale dataset from the Human Connectome Project Young Adult study (n = 1065), we found that it was feasible to identify multiple cerebellar pathway parcels with unique structure–function saliency patterns that were stable across training folds. We thoroughly experimented with all stages of the DeepMSP pipeline, including network selection, structure–function saliency representation, clustering algorithm, and cluster count. We found that a 1D convolutional neural network architecture and a transformer network architecture both performed comparably for the multitask prediction of endurance, strength, reading decoding, and vocabulary comprehension, with both architectures outperforming a fully connected network architecture. Quantitative experiments demonstrated that a proposed low‐dimensional saliency representation with an explicit measure of motor versus cognitive category bias achieved the best parcellation results, while a parcel count of four was most successful according to standard cluster quality metrics. Our results suggested that motor and cognitive saliencies are distributed across the cerebellar white matter pathways. Inspection of the final k = 4 parcellation revealed that the highest‐saliency parcel was most salient for the prediction of both motor and cognitive performance scores and included parts of the middle and superior cerebellar peduncles. Our proposed saliency‐based parcellation framework, DeepMSP, enables multimodal, data‐driven tractography parcellation. Through utilising both structural features and functional performance measures, this parcellation strategy may have the potential to enhance the study of structure–function relationships of the cerebellar pathways.

Deep multimodal saliency parcellation of cerebellar pathways: linking microstructure and individual function through explainable multitask learning

Deep multimodal saliency parcellation of cerebellar pathways: Linking microstructure and individual function through explainable multitask learning

Atlas-guided parcellation: Individualized functionally-homogenous parcellation in cerebral cortex

Multigroup Recognition of Dementia Patients with Dynamic Brain Connectivity under Multimodal Cortex Parcellation

Parcellation-based tractographic modeling of the salience network through meta-analysis

DeepBundle: Fiber Bundle Parcellation with Graph Convolution Neural Networks

Cerebellar Functional Parcellation Using Sparse Dictionary Learning Clustering.

Tractography-Based Parcellation of Cerebellar Dentate Nuclei via a Deep Nonnegative Matrix Factorization Clustering Method

Multi-scale and Focal Region Based Deep Learning Network for Fine Brain Parcellation.

Graph Learning for Cortical Parcellation from Tensor Decompositions of Resting-State fMRI

Individual-Specific Areal-Level Parcellations Improve Functional Connectivity Prediction of Behavior

A Connectivity-Based Parcellation Improved Functional Representation of the Human Cerebellum

Multimodal laminar characterization of visual areas along the cortical hierarchy

Multi-Paradigm fMRI Fusion via Sparse Tensor Decomposition in Brain Functional Connectivity Study

Striatal Subdivisions Estimated via Deep Embedded Clustering With Application to Parkinson's Disease

Functional Subdivisions of the Cerebellum in Naturalistic Paradigm Functional Magnetic Resonance Imaging

A Novel Deep Learning Tractography Fiber Clustering Framework for Functionally Consistent White Matter Parcellation Using Multimodal Diffusion MRI and Functional MRI

DDParcel: Deep Learning Anatomical Brain Parcellation from Diffusion MRI.

Unraveling somatotopic organization in the human brain using machine learning and adaptive supervoxel-based parcellations

CerebNet: A fast and reliable deep-learning pipeline for detailed cerebellum sub-segmentation

Functional boundaries in the human cerebellum revealed by a multi-domain task battery