Abstract:Diffusion magnetic resonance imaging (dMRI) is an important tool in characterizing tissue microstructure based on biophysical models, which are typically multi-compartmental models with mathematically complex and highly non-linear forms. Resolving microstructures from these models with conventional optimization techniques is prone to estimation errors and requires dense sampling in the q-space with a long scan time. Deep learning based approaches have been proposed to overcome these limitations. Motivated by the superior performance of the Transformer in feature extraction than the convolutional structure, in this work, we present a learning-based framework based on Transformer, namely, a Microstructure Estimation Transformer with Sparse Coding (METSC) for dMRI-based microstructural parameter estimation. To take advantage of the Transformer while addressing its limitation in large training data requirement, we explicitly introduce an inductive bias-model bias into the Transformer using a sparse coding technique to facilitate the training process. Thus, the METSC is composed with three stages, an embedding stage, a sparse representation stage, and a mapping stage. The embedding stage is a Transformer-based structure that encodes the signal in a high-level space to ensure the core voxel of a patch is represented effectively. In the sparse representation stage, a dictionary is constructed by solving a sparse reconstruction problem that unfolds the Iterative Hard Thresholding (IHT) process. The mapping stage is essentially a decoder that computes the microstructural parameters from the output of the second stage, based on the weighted sum of normalized dictionary coefficients where the weights are also learned. We tested our framework on two dMRI models with downsampled q-space data, including the intravoxel incoherent motion (IVIM) model and the neurite orientation dispersion and density imaging (NODDI) model. The proposed method achieved up to 11.25 folds of acceleration while retaining high fitting accuracy for NODDI fitting, reducing the mean squared error (MSE) up to 70% compared with the previous q-space learning approach. METSC outperformed the other state-of-the-art learning-based methods, including the model-free and model-based methods. The network also showed robustness against noise and generalizability across different datasets. The superior performance of METSC indicates its potential to improve dMRI acquisition and model fitting in clinical applications.

Diffusion Tensor Estimation with Transformer Neural Networks

SwinDTI: swin transformer-based generalized fast estimation of diffusion tensor parameters from sparse data

TW-Net: Transformer Weighted Network for Neonatal Brain MRI Segmentation

Hybrid Graph Transformer for Tissue Microstructure Estimation with Undersampled Diffusion MRI Data

Ultrafast diffusion tensor imaging based on deep learning and multi-slice information sharing

Reliable Deep Diffusion Tensor Estimation: Rethinking the Power of Data-Driven Optimization Routine

Spatiotemporal DTI Brain Atlas of Neonates Based on Adaptive Kernel Regression

A microstructure estimation Transformer inspired by sparse representation for diffusion MRI

Diff-DTI: Fast Diffusion Tensor Imaging Using A Feature-Enhanced Joint Diffusion Model

Brain Network Transformer

Medical Transformer: Universal Brain Encoder for 3D MRI Analysis

Accelerated cardiac diffusion tensor imaging using deep neural network

SuperDTI: Ultrafast diffusion tensor imaging and fiber tractography with deep learning

FlexDTI: Flexible diffusion gradient encoding scheme-based highly efficient diffusion tensor imaging using deep learning

Machine-Learning Enhanced Diffusion Tensor Imaging with Four Encoding Directions

View-Disentangled Transformer for Brain Lesion Detection

Dilated transformer: residual axial attention for breast ultrasound image segmentation

dtiRIM: A generalisable deep learning method for diffusion tensor imaging

PTNet: A High-Resolution Infant MRI Synthesizer Based on Transformer

3D Transformer based on deformable patch location for differential diagnosis between Alzheimer's disease and Frontotemporal dementia