Abstract:Compared to single-modality magnetic resonance (MR) image super-resolution (SR) methods, multi-modality MR image methods can utilize high-resolution reference modality (e.g., T1 modality) to provide valuable complementary information for low-resolution target modality (e.g., T2 modality) in SR reconstruction, which can further improve the quality of the SR images. Although they have achieved impressive results, these methods still suffer from the following drawbacks: (1) They can only handle fixed integer upsampling factors, such as 2X, 3X, and 4X, and require training and storing corresponding models for each upsampling factor, which is infeasible in clinical practice; (2) They only perform feature extraction and reconstruction in the image domain. However, the aliasing artifacts produced in the image domain are structural and non-local. Therefore, using only the image domain cannot effectively reconstruct high-quality aliasing-free SR images. To address these issues, we develop a brand-new Dual-Domain Implicit Network (DuDoINet) for multi-modality MR image arbitrary-scale SR. Specifically, we propose a dual-domain learning scheme for multi-modality MR image SR, which allows the network to sufficiently exploit the frequency and image domain information in MR images. In addition, we design implicit attention to achieve arbitrary-scale upsampling of MR images, which utilizes a continuously differentiable function that generates pixel values from pixel coordinates. Furthermore, we designed a deformable cross-modality attention mechanism that can adaptively transfer high-frequency details from the T1 to the T2 modality, better integrating valuable complementary information from the T1 modality. Extensive and comprehensive experiments on healthy subjects and patient datasets demonstrate that our DuDoINet outperforms SOTA methods, demonstrating its great potential for clinical practice.

D 3 U-Net: Dual-Domain Collaborative Optimization Deep Unfolding Network for Image Compressive Sensing

D3C2-Net: Dual-Domain Deep Convolutional Coding Network for Compressive Sensing

Deep Unfolding Network for Image Compressed Sensing by Content-adaptive Gradient Updating and Deformation-invariant Non-local Modeling

Dynamic Path-Controllable Deep Unfolding Network for Compressive Sensing

Multi-Channel Representation Learning Enhanced Unfolding Multi-Scale Compressed Sensing Network for High Quality Image Reconstruction

High-Throughput Deep Unfolding Network for Compressive Sensing MRI

Optimization-inspired Cumulative Transmission Network for image compressive sensing

ASAUN-CS: Adaptive Stage Activated Unfolding Network for Compressive Sensing

Fast Hierarchical Deep Unfolding Network for Image Compressed Sensing

Memory-Augmented Deep Unfolding Network for Compressive Sensing

DuDoINet: Dual-Domain Implicit Network for Multi-Modality MR Image Arbitrary-scale Super-Resolution

LR-CSNet: Low-Rank Deep Unfolding Network for Image Compressive Sensing

DeU-Net 2.0: Enhanced deformable U-Net for 3D cardiac cine MRI segmentation

Hybrid Transformer and Convolution for Image Compressed Sensing

Gates-Controlled Deep Unfolding Network for Image Compressed Sensing

SODAS-Net: Side-Information-Aided Deep Adaptive Shrinkage Network for Compressive Sensing

MCU-Net: A Multi-prior Collaborative Deep Unfolding Network with Gates-controlled Spatial Attention for Accelerated MR Image Reconstruction

A Dictionary Learning Based Unsupervised Neural Network for Single Image Compressed Sensing

Dynamic Proximal Unrolling Network for Compressive Imaging

Dense Deep Unfolding Network with 3D-CNN Prior for Snapshot Compressive Imaging

Optimization-Inspired Cross-Attention Transformer for Compressive Sensing