Abstract:The use of convolutional neural networks (CNNs) has allowed accurate white matter (WM) tract segmentation on diffusion magnetic resonance imaging (dMRI). To train the CNN-based segmentation models, a large number of scans on which WM tracts are annotated need to be collected, and these annotated scans can be accumulated over a long period of time. However, when novel WM tracts that are different from existing annotated WM tracts are of interest, additional annotations are required for their segmentation. Due to the cost of manual annotations, methods have been developed for few-shot segmentation of novel WM tracts, where the segmentation knowledge is transferred from existing WM tracts to novel WM tracts and the amount of annotated data for novel WM tracts is reduced. Despite these developments, it is desirable to further reduce the amount of annotated data to the one-shot setting with a single annotated image. To address this problem, we develop an approach to one-shot segmentation of novel WM tracts. Our method follows the existing pretraining/fine-tuning framework that transfers segmentation knowledge from existing to novel WM tracts. First, as there is extremely scarce annotated data in the one-shot setting, we design several different data augmentation strategies so that extensive data augmentation can be performed to obtain extra synthetic training data. The data augmentation strategies are based on image masking and thus applicable to the one-shot setting. Second, to address overfitting and knowledge forgetting in the fine-tuning stage that can be more severe given limited training data, we propose an adaptive knowledge transfer strategy that selects the network weights to be updated. The data augmentation and adaptive knowledge transfer strategies are combined to train the segmentation model. Considering that the different data augmentation strategies can generate synthetic data that contain potentially conflicting information, we apply the data augmentation strategies separately, each leading to a different segmentation model. The results predicted by the different models are fused to produce the final segmentation. We validated our method on two brain dMRI datasets, including a public dataset and an in-house dataset. Different settings were considered for the validation, and the results show that the proposed method improves the one-shot segmentation of novel WM tracts.

A Registration- and Uncertainty-based Framework for White Matter Tract Segmentation With Only One Annotated Subject

Simultaneous Intracranial Artery Tracing and Segmentation from Magnetic Resonance Angiography by Joint Optimization from Multiplanar Reformation

Unifying the analyses of anatomical and diffusion tensor images using volume-preserved warping.

One-Shot Segmentation of Novel White Matter Tracts via Extensive Data Augmentation

Multimodal Spatial-Based Segmentation Framework for White Matter Lesions in Multi-Sequence Magnetic Resonance Images

One-shot segmentation of novel white matter tracts via extensive data augmentation and adaptive knowledge transfer

Improved White Matter Tract Segmentation for Unannotated Dataset.

A hybrid deep learning framework for integrated segmentation and registration: evaluation on longitudinal white matter tract changes

White matter hyperintensities segmentation using an ensemble of neural networks

Neuro4Neuro: A neural network approach for neural tract segmentation using large-scale population-based diffusion imaging

TractCloud: Registration-free tractography parcellation with a novel local-global streamline point cloud representation

An anatomical knowledge-based MRI deep learning pipeline for white matter hyperintensity quantification associated with cognitive impairment

Better Generalization of White Matter Tract Segmentation to Arbitrary Datasets with Scaled Residual Bootstrap

Superficial White Matter Analysis: An Efficient Point-cloud-based Deep Learning Framework with Supervised Contrastive Learning for Consistent Tractography Parcellation across Populations and dMRI Acquisitions

Direct segmentation of brain white matter tracts in diffusion MRI

Automatic Segmentation of White Matter Hyperintensities in Routine Clinical Brain MRI by 2D VB-Net: A Large-Scale Study

Tractometry-based Anomaly Detection for Single-subject White Matter Analysis

Quantifying white matter hyperintensity and brain volumes in heterogeneous clinical and low-field portable MRI

One-shot Joint Extraction, Registration and Segmentation of Neuroimaging Data

Deep White Matter Analysis: Fast, Consistent Tractography Segmentation Across Populations and Dmri Acquisitions

Multimodality White Matter Tract Segmentation Using CNN.