Abstract:Diffusion magnetic resonance imaging (dMRI) is an important tool in characterizing tissue microstructure based on biophysical models, which are typically multi-compartmental models with mathematically complex and highly non-linear forms. Resolving microstructures from these models with conventional optimization techniques is prone to estimation errors and requires dense sampling in the q-space with a long scan time. Deep learning based approaches have been proposed to overcome these limitations. Motivated by the superior performance of the Transformer in feature extraction than the convolutional structure, in this work, we present a learning-based framework based on Transformer, namely, a Microstructure Estimation Transformer with Sparse Coding (METSC) for dMRI-based microstructural parameter estimation. To take advantage of the Transformer while addressing its limitation in large training data requirement, we explicitly introduce an inductive bias-model bias into the Transformer using a sparse coding technique to facilitate the training process. Thus, the METSC is composed with three stages, an embedding stage, a sparse representation stage, and a mapping stage. The embedding stage is a Transformer-based structure that encodes the signal in a high-level space to ensure the core voxel of a patch is represented effectively. In the sparse representation stage, a dictionary is constructed by solving a sparse reconstruction problem that unfolds the Iterative Hard Thresholding (IHT) process. The mapping stage is essentially a decoder that computes the microstructural parameters from the output of the second stage, based on the weighted sum of normalized dictionary coefficients where the weights are also learned. We tested our framework on two dMRI models with downsampled q-space data, including the intravoxel incoherent motion (IVIM) model and the neurite orientation dispersion and density imaging (NODDI) model. The proposed method achieved up to 11.25 folds of acceleration while retaining high fitting accuracy for NODDI fitting, reducing the mean squared error (MSE) up to 70% compared with the previous q-space learning approach. METSC outperformed the other state-of-the-art learning-based methods, including the model-free and model-based methods. The network also showed robustness against noise and generalizability across different datasets. The superior performance of METSC indicates its potential to improve dMRI acquisition and model fitting in clinical applications.

Hybrid Graph Transformer for Tissue Microstructure Estimation with Undersampled Diffusion MRI Data

Towards Accurate Microstructure Estimation via 3D Hybrid Graph Transformer

Estimating Tissue Microstructure with Undersampled Diffusion Data via Graph Convolutional Neural Networks

Reconstructing High-Quality Diffusion MRI Data from Orthogonal Slice-Undersampled Data Using Graph Convolutional Neural Networks

A microstructure estimation Transformer inspired by sparse representation for diffusion MRI

Multifold Acceleration of Diffusion MRI Via Deep Learning Reconstruction from Slice-Undersampled Data.

Graph-Based Deep Learning for Prediction of Longitudinal Infant Diffusion MRI Data

Angular Resolution Enhancement of Diffusion MRI Data Using Inter-Subject Information Transfer.

Harmonizing 1.5T/3T Diffusion Weighted MRI through Development of Deep Learning Stabilized Microarchitecture Estimators

White Matter Geometry-Guided Score-Based Diffusion Model for Tissue Microstructure Imputation in Tractography Imaging

Ultrafast diffusion tensor imaging based on deep learning and multi-slice information sharing

Knowledge Transfer between Datasets for Learning-based Tissue Microstructure Estimation

Accelerated cardiac diffusion tensor imaging using deep neural network

DCT-net: Dual-domain cross-fusion transformer network for MRI reconstruction

Deep Learning Based Apparent Diffusion Coefficient Map Generation from Multi-parametric MR Images for Patients with Diffuse Gliomas

Image Quality Transfer of Diffusion MRI Guided By High-Resolution Structural MRI

DIMOND: DIffusion Model OptimizatioN with Deep Learning

Diffusion Transformer Model With Compact Prior for Low-dose PET Reconstruction

Estimation of Tissue Microstructure Using a Deep Network Inspired by a Sparse Reconstruction Framework

Diffusion Tensor Estimation with Transformer Neural Networks

Deep Learning-based Diffusion Tensor Cardiac Magnetic Resonance Reconstruction: A Comparison Study