Abstract:We propose a geometric deep-learning-based framework, TractGeoNet, for performing regression using diffusion magnetic resonance imaging (dMRI) tractography and associated pointwise tissue microstructure measurements. By employing a point cloud representation, TractGeoNet can directly utilize tissue microstructure and positional information from all points within a fiber tract without the need to average or bin data along the streamline as traditionally required by dMRI tractometry methods. To improve regression performance, we propose a novel loss function, the Paired-Siamese Regression loss, which encourages the model to focus on accurately predicting the relative differences between regression label scores rather than just their absolute values. In addition, to gain insight into the brain regions that contribute most strongly to the prediction results, we propose a Critical Region Localization algorithm. This algorithm identifies highly predictive anatomical regions within the white matter fiber tracts for the regression task. We evaluate the effectiveness of the proposed method by predicting individual performance on two neuropsychological assessments of language using a dataset of 20 association white matter fiber tracts from 806 subjects from the Human Connectome Project Young Adult dataset. The results demonstrate superior prediction performance of TractGeoNet compared to several popular regression models that have been applied to predict individual cognitive performance based on neuroimaging features. Of the twenty tracts studied, we find that the left arcuate fasciculus tract is the most highly predictive of the two studied language performance assessments. Within each tract, we localize critical regions whose microstructure and point information are highly and consistently predictive of language performance across different subjects and across multiple independently trained models. These critical regions are widespread and distributed across both hemispheres and all cerebral lobes, including areas of the brain considered important for language function such as superior and anterior temporal regions, pars opercularis, and precentral gyrus. Overall, TractGeoNet demonstrates the potential of geometric deep learning to enhance the study of the brain's white matter fiber tracts and to relate their structure to human traits such as language performance.

Fiber Tract Shape Measures Inform Prediction of Non-Imaging Phenotypes

The shape of the brain's connections is predictive of cognitive performance: an explainable machine learning study

Cross-domain Fiber Cluster Shape Analysis for Language Performance Cognitive Score Prediction

TractShapeNet: Efficient Multi-Shape Learning with 3D Tractography Point Clouds

Predicting functional brain ROIs via fiber shape models.

Joint Prediction of Longitudinal Development of Cortical Surfaces and White Matter Fibers from Neonatal MRI

A Hybrid Multishape Learning Framework for Longitudinal Prediction of Cortical Surfaces and Fiber Tracts Using Neonatal Data

TractGraphFormer: Anatomically Informed Hybrid Graph CNN-Transformer Network for Classification from Diffusion MRI Tractography

White Matter Tracts are Point Clouds: Neuropsychological Score Prediction and Critical Region Localization via Geometric Deep Learning

Predicting Functional Cortical Rois Via Dti-Derived Fiber Shape Models

Deep White Matter Analysis: Fast, Consistent Tractography Segmentation Across Populations and Dmri Acquisitions

Accurate Corresponding Fiber Tract Segmentation Via FiberGeoMap Learner with Application to Autism.

Functional Informed Fiber Tracking Using Combination of Diffusion and Functional MRI.

TractoFormer: A Novel Fiber-level Whole Brain Tractography Analysis Framework Using Spectral Embedding and Vision Transformers

Unifying the analyses of anatomical and diffusion tensor images using volume-preserved warping.

TractGeoNet: A geometric deep learning framework for pointwise analysis of tract microstructure to predict language assessment performance

TractGraphCNN: Anatomically Informed Graph CNN for Classification Using Diffusion MRI Tractography.

Joint analysis of fiber shape and cortical folding patterns

TractoSCR: a novel supervised contrastive regression framework for prediction of neurocognitive measures using multi-site harmonized diffusion MRI tractography

Identifying Group-Wise Consistent White Matter Landmarks Via Novel Fiber Shape Descriptor