A Novel Deep Learning Tractography Fiber Clustering Framework for Functionally Consistent White Matter Parcellation Using Multimodal Diffusion MRI and Functional MRI

Jin Wang,Bocheng Guo,Yijie Li,Junyi Wang,Yuqian Chen,Jarrett Rushmore,Nikos Makris,Yogesh Rathi,Lauren J O'Donnell,Fan Zhang
2024-11-04
Abstract:Tractography fiber clustering using diffusion MRI (dMRI) is a crucial strategy for white matter (WM) parcellation. Current methods primarily use the geometric information of fibers (i.e., the spatial trajectories) to group similar fibers into clusters, overlooking the important functional signals present along the fiber tracts. There is increasing evidence that neural activity in the WM can be measured using functional MRI (fMRI), offering potentially valuable multimodal information for fiber clustering. In this paper, we develop a novel deep learning fiber clustering framework, namely Deep Multi-view Fiber Clustering (DMVFC), that uses joint dMRI and fMRI data to enable functionally consistent WM parcellation. DMVFC can effectively integrate the geometric characteristics of the WM fibers with the fMRI BOLD signals along the fiber tracts. It includes two major components: 1) a multi-view pretraining module to compute embedding features from fiber geometric information and functional signals separately, and 2) a collaborative fine-tuning module to simultaneously refine the two kinds of embeddings. In the experiments, we compare DMVFC with two state-of-the-art fiber clustering methods and demonstrate superior performance in achieving functionally meaningful and consistent WM parcellation results.
Image and Video Processing,Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem that this paper attempts to address is that current white matter (WM) fiber clustering methods mainly rely on the spatial trajectory information of fibers, while ignoring important functional signals within the fiber bundles. Specifically, existing clustering methods fail to explicitly capture the functional significance of fiber clusters, which limits their application in functionally consistent white matter parcellation. To overcome this limitation, the authors propose a novel deep learning framework—DeepMulti-viewFiberClustering (DMVFC), which combines diffusion magnetic resonance imaging (dMRI) and functional magnetic resonance imaging (fMRI) data to achieve functionally consistent white matter parcellation. By integrating the geometric features of fibers and the blood oxygen level-dependent (BOLD) signals from fMRI, DMVFC can more accurately identify fiber bundles with similar functional characteristics, thereby improving the consistency and functional significance of white matter parcellation.