Abstract:Recent studies on T1-assisted MRI reconstruction for under-sampled images of other modalities have demonstrated the potential of further accelerating MRI acquisition of other modalities. Most of the state-of-the-art approaches have achieved improvement through the development of network architectures for fixed under-sampling patterns, without fully exploiting the complementary information between modalities. Although existing under-sampling pattern learning algorithms can be simply modified to allow the fully-sampled T1-weighted MR image to assist the pattern learning, no significant improvement on the reconstruction task can be achieved. To this end, we propose an iterative framework to optimize the under-sampling pattern for MRI acquisition of another modality that can complement the fully-sampled T1-weighted MR image at different under-sampling factors, while jointly optimizing the T1-assisted MRI reconstruction model. Specifically, our proposed method exploits the difference of latent information between the two modalities for determining the sampling patterns that can maximize the assistance power of T1-weighted MR image in improving the MRI reconstruction. We have demonstrated superior performance of our learned under-sampling patterns on a public dataset, compared to commonly used under-sampling patterns and state-of-the-art methods that can jointly optimize both the reconstruction network and the under-sampling pattern, up to 8-fold under-sampling factor.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is in multi - modal magnetic resonance imaging (Multi - Modal MRI), how to accelerate the MRI acquisition process by optimizing the undersampling pattern of the target modality (such as T2 - weighted or FLAIR MRI), while using the fully - sampled T1 - weighted MRI image to assist in reconstructing the undersampled target - modality image. Specifically, although existing methods can improve the quality of image reconstruction through network architecture improvements under a fixed undersampling pattern, these methods do not fully utilize the complementary information between different modalities. In addition, although existing undersampling pattern learning algorithms can be simply modified to allow the fully - sampled T1 - weighted MRI image to assist in pattern learning, there is no significant improvement in the reconstruction task. Therefore, the paper proposes an iterative framework, aiming to optimize the undersampling pattern of MRI acquisition of another modality, so that it can be complementary to the fully - sampled T1 - weighted MRI image at different undersampling rates, while jointly optimizing the T1 - assisted MRI reconstruction model. This method particularly emphasizes using the difference in latent information between the two modalities to determine the sampling pattern that can maximize the auxiliary role of the T1 - weighted MRI image in improving MRI reconstruction. The main contributions of the paper are: 1. Propose to optimize the undersampling pattern of target - modality data in multi - modal MRI reconstruction. 2. Apply a cross - modal translation network to utilize the statistical differences in k - space between the translated target - modality MRI image and the real target - modality MRI image. 3. Investigate the robustness of the proposed framework to small displacements between the reference modality and the target modality.

Fast T2w/FLAIR MRI Acquisition by Optimal Sampling of Information Complementary to Pre-acquired T1w MRI

Fast Multi-Contrast MRI Acquisition by Optimal Sampling of Information Complementary to Pre-Acquired MRI Contrast

Deep Learning for Under-Sampled Non-Cartesian ASL MRI Reconstruction

Parallel Imaging and Convolutional Neural Network Combined Fast MR Image Reconstruction: Applications in Low-Latency Accelerated Real-Time Imaging.

Ultra-Fast T2-Weighted MR Reconstruction Using Complementary T1-Weighted Information.

Spatial and Modal Optimal Transport for Fast Cross-Modal MRI Reconstruction

Learn Stable MRI Under-Sampling Pattern With Decoupled Sampling Preference

PILOT: Physics-Informed Learned Optimized Trajectories for Accelerated MRI

2D probabilistic undersampling pattern optimization for MR image reconstruction.

LUCMT: Learnable under-sampling and reconstructed network with cross multi-head attention transformer for accelerating MR image reconstruction

End-to-End Sequential Sampling and Reconstruction for MR Imaging.

End-to-End Sequential Sampling and Reconstruction for MRI

An Effective Co-support Guided Analysis Model for Multi-Contrast MRI Reconstruction

Sparse MRI Reconstruction Using Multi-Contrast Image Guided Graph Representation.

1D Probabilistic Undersampling Pattern Optimization for MR Image Reconstruction

Dual-Domain Multi-Contrast MRI Reconstruction with Synthesis-based Fusion Network

Image Reconstruction for Accelerated MR Scan With Faster Fourier Convolutional Neural Networks

Learning Task-Specific Strategies for Accelerated MRI

Medical Image Computing and Computer Assisted Intervention – MICCAI 2020: 23rd International Conference, Lima, Peru, October 4–8, 2020, Proceedings, Part II

Joint Image Reconstruction and Super-Resolution for Accelerated Magnetic Resonance Imaging

Undersampled Multi-contrast MRI Reconstruction Based on Double-domain Generative Adversarial Network