Abstract:Super-resolved q-space deep learning (SR -q-DL) has been developed to estimate high-resolution (HR) tissue microstructure maps from low-quality diffusion magnetic resonance imaging (dMRI) scans acquired with a reduced number of diffusion gradients and low spatial resolution, where deep networks are designed for the estimation. However, existing methods do not exploit HR information from other modalities, which are generally acquired together with dMRI and could provide additional useful information for HR tissue microstructure estimation. In this work, we extend SR -q-DL and propose multimodal SR -q-DL, where information in low-resolution (LR) dMRI is combined with HR information from another modality for HR tissue microstructure estimation. Because the HR modality may not be as sensitive to tissue microstructure as dMRI, direct concatenation of multimodal information does not necessarily lead to improved estimation performance. Since existing deep networks for HR tissue microstructure estimation are patch-based and use redundant information in the spatial domain to enhance the spatial resolution, the HR information in the other modality could inform the deep networks about what input voxels are relevant for the computation of tissue microstructure. Thus, we propose to incorporate the HR information from the HR modality by designing an attention module that guides the computation of HR tissue microstructure from LR dMRI. Specifically, the attention module is integrated with the patch-based SR -q-DL framework that exploits the sparsity of diffusion signals. The sparse representation of the LR diffusion signals in the input patch is first computed with a network component that unrolls an iterative process for sparse reconstruction. Then, the proposed attention module computes a relevance map from the HR modality with sequential convolutional layers. The relevance map indicates the relevance of the LR sparse representation at each voxel for computing the patch of HR tissue microstructure. The relevance is applied to the LR sparse representation with voxelwise multiplication, and the weighted LR sparse representation is used to compute HR tissue microstructure with another network component that allows resolution enhancement. All weights in the proposed network for multimodal SR -q-DL are jointly learned and the estimation is end-to-end. To evaluate the proposed method, we performed experiments on brain dMRI scans together with images of additional HR modalities. In the experiments, the proposed method was applied to the estimation of tissue microstructure measures for different datasets and advanced biophysical models, where the benefit of incorporating multimodal information using the proposed method is shown. (c) 2021 Elsevier B.V. All rights reserved.

XQ-SR: Joint X-Q Space Super-Resolution with Application to Infant Diffusion MRI

SUPER-RESOLUTION OF DIFFUSION MRI VIA JOINT CONSIDERATION OF SPATIAL AND ANGULAR SPACES USING GRAPH CNN

A Unified Approach for Spatial and Angular Super-Resolution of Diffusion Tensor MRI.

Angular Upsampling in Infant Diffusion MRI Using Neighborhood Matching in X-Q Space.

Super-Resolved Q-Space Deep Learning with Uncertainty Quantification

Noise Reduction in Diffusion MRI Using Non-Local Self-Similar Information in Joint X-Q Space.

Reconstructing High-Quality Diffusion MRI Data from Orthogonal Slice-Undersampled Data Using Graph Convolutional Neural Networks

Angular Resolution Enhancement of Diffusion MRI Data Using Inter-Subject Information Transfer.

Super-Resolved q-Space Deep Learning.

3D‐SRDM: 3D super‐resolution of MRI volumes based on diffusion model

A joint space-angle regularization approach for single 4D diffusion image super-resolution.

Rethinking Diffusion Model for Multi-Contrast MRI Super-Resolution

Longitudinally Guided Super-Resolution of Neonatal Brain Magnetic Resonance Images

Multimodal Super-Resolved Q-Space Deep Learning

Probing Brain Micro-architecture by Orientation Distribution Invariant Identification of Diffusion Compartments.

InverseSR: 3D Brain MRI Super-Resolution Using a Latent Diffusion Model

Super-resolution Reconstruction of Neonatal Brain Magnetic Resonance Images Via Residual Structured Sparse Representation

Robust Unsupervised Super-Resolution of Infant MRI via Dual-Modal Deep Image Prior

Submillimeter diffusion MRI using an in-plane segmented 3D multi-slab acquisition and denoiser-regularized reconstruction

<Emphasis Type="Italic">q</Emphasis>-Space Upsampling Using <Emphasis Type="Italic">x</Emphasis>-<Emphasis Type="Italic">q</Emphasis> Space Regularization

Arbitrary scale super-resolution diffusion model for brain MRI images