Abstract:To accelerate Magnetic Resonance (MR) imaging procedures, Multi-Contrast MR Reconstruction (MCMR) has become a prevalent trend that utilizes an easily obtainable modality as an auxiliary to support high-quality reconstruction of the target modality with under-sampled k-space measurements. The exploration of global dependency and complementary information across different modalities is essential for MCMR. However, existing methods either struggle to capture global dependency due to the limited receptive field or suffer from quadratic computational complexity. To tackle this dilemma, we propose a novel Frequency and Spatial Mutual Learning Network (FSMNet), which efficiently explores global dependencies across different modalities. Specifically, the features for each modality are extracted by the Frequency-Spatial Feature Extraction (FSFE) module, featuring a frequency branch and a spatial branch. Benefiting from the global property of the Fourier transform, the frequency branch can efficiently capture global dependency with an image-size receptive field, while the spatial branch can extract local features. To exploit complementary information from the auxiliary modality, we propose a Cross-Modal Selective fusion (CMS-fusion) module that selectively incorporate the frequency and spatial features from the auxiliary modality to enhance the corresponding branch of the target modality. To further integrate the enhanced global features from the frequency branch and the enhanced local features from the spatial branch, we develop a Frequency-Spatial fusion (FS-fusion) module, resulting in a comprehensive feature representation for the target modality. Extensive experiments on the BraTS and fastMRI datasets demonstrate that the proposed FSMNet achieves state-of-the-art performance for the MCMR task with different acceleration factors. The code is available at: <a class="link-external link-https" href="https://github.com/qic999/FSMNet" rel="external noopener nofollow">this https URL</a>.

HyperCMR: Enhanced Multi-Contrast CMR Reconstruction with Eagle Loss

High Spatial and Temporal Resolution Dynamic Contrast-Enhanced Magnetic Resonance Angiography (CE-MRA) Using Compressed Sensing with Magnitude Image Subtraction

Rethinking Multi-Contrast MRI Super-Resolution: Rectangle-Window Cross-Attention Transformer and Arbitrary-Scale Upsampling

CMRxRecon: An open cardiac MRI dataset for the competition of accelerated image reconstruction

The state-of-the-art in Cardiac MRI Reconstruction: Results of the CMRxRecon Challenge in MICCAI 2023

CMRxRecon: A publicly available k -space dataset and benchmark to advance deep learning for cardiac MRI

Deep Multi-contrast Cardiac MRI Reconstruction via vSHARP with Auxiliary Refinement Network

Accelerating Cardiac MRI Reconstruction with CMRatt: An Attention-Driven Approach

Deep Cardiac MRI Reconstruction with ADMM

DiffCMR: Fast Cardiac MRI Reconstruction with Diffusion Probabilistic Models

Accelerated Multi-Contrast MRI Reconstruction via Frequency and Spatial Mutual Learning

CMRxRecon2024: A Multi-Modality, Multi-View K-Space Dataset Boosting Universal Machine Learning for Accelerated Cardiac MRI

Multi-Contrast Complementary Learning for Accelerated MR Imaging

Cardiac MRI Segmentation with Focal Loss Constrained Deep Residual Networks

Motion-compensated MR CINE reconstruction with reconstruction-driven motion estimation

Multi-Contrast MRI Reconstruction Based on Frequency Domain Separation and Cross-Self-Attention

Reconstruction of Cardiac Cine MRI Using Motion-Guided Deformable Alignment and Multi-Resolution Fusion

A hybrid deep image prior and compressed sensing reconstruction method for highly accelerated 3D coronary magnetic resonance angiography

Cine cardiac MRI reconstruction using a convolutional recurrent network with refinement

Reconstruction of Cardiac Cine MRI Using Motion‐Guided Deformable Alignment and Multi‐Resolution Fusion

Towards Ultrafast MRI via Extreme k-Space Undersampling and Superresolution