Abstract:To accelerate Magnetic Resonance (MR) imaging procedures, Multi-Contrast MR Reconstruction (MCMR) has become a prevalent trend that utilizes an easily obtainable modality as an auxiliary to support high-quality reconstruction of the target modality with under-sampled k-space measurements. The exploration of global dependency and complementary information across different modalities is essential for MCMR. However, existing methods either struggle to capture global dependency due to the limited receptive field or suffer from quadratic computational complexity. To tackle this dilemma, we propose a novel Frequency and Spatial Mutual Learning Network (FSMNet), which efficiently explores global dependencies across different modalities. Specifically, the features for each modality are extracted by the Frequency-Spatial Feature Extraction (FSFE) module, featuring a frequency branch and a spatial branch. Benefiting from the global property of the Fourier transform, the frequency branch can efficiently capture global dependency with an image-size receptive field, while the spatial branch can extract local features. To exploit complementary information from the auxiliary modality, we propose a Cross-Modal Selective fusion (CMS-fusion) module that selectively incorporate the frequency and spatial features from the auxiliary modality to enhance the corresponding branch of the target modality. To further integrate the enhanced global features from the frequency branch and the enhanced local features from the spatial branch, we develop a Frequency-Spatial fusion (FS-fusion) module, resulting in a comprehensive feature representation for the target modality. Extensive experiments on the BraTS and fastMRI datasets demonstrate that the proposed FSMNet achieves state-of-the-art performance for the MCMR task with different acceleration factors. The code is available at: <a class="link-external link-https" href="https://github.com/qic999/FSMNet" rel="external noopener nofollow">this https URL</a>.

Multifrequency Trained Projection Nonlinear Framework for Electromagnetic Imaging With Contrast-Source Landweber–Kaczmarz

Forward Imaging Neural Network with Correction of Positional Misalignment for Fourier Ptychographic Microscopy.

A Modified Wavenumber Algorithm of Multi-Layered Structures with Oblique Incidence Based on Full-Matrix Capture

Enhanced Deep Learning Approach Based on the Deep Convolutional Encoder–Decoder Architecture for Electromagnetic Inverse Scattering Problems

Aberration Correction Method For Fourier Ptychographic Microscopy Based On Neural Network

A Convolutional Neural Network with Multifrequency and Structural Similarity Loss Functions for Electromagnetic Imaging

Fast Near-Field Frequency-Diverse Computational Imaging Based on End-to-End Deep-Learning Network

Multi-Frequency Progressive Refinement for Learned Inverse Scattering

Non-line-of-Sight Imaging via Neural Transient Fields

Accelerated Multi-Contrast MRI Reconstruction via Frequency and Spatial Mutual Learning

Multi-frequency subspace migration for imaging of perfectly conducting, arc-like cracks

Local Conditional Neural Fields for Versatile and Generalizable Large-Scale Reconstructions in Computational Imaging

A NOVEL LINEAR EM RECONSTRUCTION ALGORITHM WITH PHASELESS DATA

Self-Supervised Content-Consistent Contrast Enhancement Framework for Ultrafast Plane-Wave Imaging

Electromagnetic Source Imaging With a Combination of Sparse Bayesian Learning and Deep Neural Network

Learning-Based Subsurface Quantitative Imaging via Near-Field Scanning Microwave Microscopy

Near-field 3D Imaging Approach Combining MJSR and FGG-NUFFT

Mid-Range 2-D Fast Imaging in Pseudo-Polar Coordinate Format for Wideband Array

Fast 3-D Controlled-Source Electromagnetic Modeling Combining UPML and Rational Krylov Method

Fast image reconstruction for near-field terahertz imaging with multistatic non-uniform sparse arrays

High Resolution, High Contrast Beamformer Using Minimum Variance and Plane Wave Nonlinear Compounding with Low Complexity