Abstract:Super-resolved q-space deep learning (SR -q-DL) has been developed to estimate high-resolution (HR) tissue microstructure maps from low-quality diffusion magnetic resonance imaging (dMRI) scans acquired with a reduced number of diffusion gradients and low spatial resolution, where deep networks are designed for the estimation. However, existing methods do not exploit HR information from other modalities, which are generally acquired together with dMRI and could provide additional useful information for HR tissue microstructure estimation. In this work, we extend SR -q-DL and propose multimodal SR -q-DL, where information in low-resolution (LR) dMRI is combined with HR information from another modality for HR tissue microstructure estimation. Because the HR modality may not be as sensitive to tissue microstructure as dMRI, direct concatenation of multimodal information does not necessarily lead to improved estimation performance. Since existing deep networks for HR tissue microstructure estimation are patch-based and use redundant information in the spatial domain to enhance the spatial resolution, the HR information in the other modality could inform the deep networks about what input voxels are relevant for the computation of tissue microstructure. Thus, we propose to incorporate the HR information from the HR modality by designing an attention module that guides the computation of HR tissue microstructure from LR dMRI. Specifically, the attention module is integrated with the patch-based SR -q-DL framework that exploits the sparsity of diffusion signals. The sparse representation of the LR diffusion signals in the input patch is first computed with a network component that unrolls an iterative process for sparse reconstruction. Then, the proposed attention module computes a relevance map from the HR modality with sequential convolutional layers. The relevance map indicates the relevance of the LR sparse representation at each voxel for computing the patch of HR tissue microstructure. The relevance is applied to the LR sparse representation with voxelwise multiplication, and the weighted LR sparse representation is used to compute HR tissue microstructure with another network component that allows resolution enhancement. All weights in the proposed network for multimodal SR -q-DL are jointly learned and the estimation is end-to-end. To evaluate the proposed method, we performed experiments on brain dMRI scans together with images of additional HR modalities. In the experiments, the proposed method was applied to the estimation of tissue microstructure measures for different datasets and advanced biophysical models, where the benefit of incorporating multimodal information using the proposed method is shown. (c) 2021 Elsevier B.V. All rights reserved.

Super-Resolved q-Space Deep Learning.

Super-Resolved Q-Space Deep Learning with Uncertainty Quantification

Multimodal Super-Resolved Q-Space Deep Learning

Attention-based q-space Deep Learning Generalized for Accelerated Diffusion Magnetic Resonance Imaging

SUPER-RESOLUTION OF DIFFUSION MRI VIA JOINT CONSIDERATION OF SPATIAL AND ANGULAR SPACES USING GRAPH CNN

Super-resolution of diffusion-weighted images using space-customized learning model

XQ-SR: Joint X-Q Space Super-Resolution with Application to Infant Diffusion MRI

Noise Reduction in Diffusion MRI Using Non-Local Self-Similar Information in Joint X-Q Space.

Reconstructing High-Quality Diffusion MRI Data from Orthogonal Slice-Undersampled Data Using Graph Convolutional Neural Networks

A Unified Approach for Spatial and Angular Super-Resolution of Diffusion Tensor MRI.

An Improved Deep Network for Tissue Microstructure Estimation with Uncertainty Quantification.

A joint space-angle regularization approach for single 4D diffusion image super-resolution.

3D‐SRDM: 3D super‐resolution of MRI volumes based on diffusion model

CSR-dMRI: Continuous Super-Resolution of Diffusion MRI with Anatomical Structure-assisted Implicit Neural Representation Learning

Knowledge Transfer between Datasets for Learning-based Tissue Microstructure Estimation

DL-MRI: A Unified Framework of Deep Learning-Based MRI Super Resolution

Deep learning enables accurate brain tissue microstructure analysis based on clinically feasible diffusion magnetic resonance imaging

High-Resolution Reference Image Assisted Volumetric Super-Resolution of Cardiac Diffusion Weighted Imaging

Super-resolution Reconstruction of MR Image with a Novel Residual Learning Network Algorithm

Simultaneous q-Space Sampling Optimization and Reconstruction for Fast and High-fidelity Diffusion Magnetic Resonance Imaging

Q-space Conditioned Translation Networks for Directional Synthesis of Diffusion Weighted Images from Multi-modal Structural MRI