Abstract:Current multi-contrast MRI super-resolution (SR) methods often harness convolutional neural networks (CNNs) for feature extraction and fusion. However, existing models have some shortcomings that prohibit them from producing more satisfactory results. First, during the feature extraction, some high-frequency details in the images are lost, resulting in blurring boundaries in the reconstructed images, which may impede the following diagnosis and treatment. Second, the perceptual field of the convolution kernel is limited, making the networks difficult to capture long-range/non-local features. Third, most of these models are solely driven by training data, neglecting prior knowledge about the correlations among different contrasts, which, once well leveraged, will effectively enhance the performance with limited training data. In this paper, we propose a novel model to synergize wavelet transforms with a new cross-attention transformer to comprehensively tackle these challenges; we call it WavTrans. Specifically, we harness one-level wavelet transformation to obtain the detail and approximation coefficients in the reference contrast MR images (Ref). While the approximation coefficients are applied to compress the low-frequency global information, the detail coefficients are utilized to represent the high-frequency local structure and texture information. Then, we propose a new residual cross-attention swin transformer to extract and fuse extracted features to establish long-distance dependencies between features and maximize the restoration of high-frequency information in Tar. In addition, a multi-residual fusion module is designed to fuse the high-frequency information in the upsampled Tar and the original Ref to ensure the restoration of detailed information. Extensive experiments demonstrate that WavTrans outperforms the SOTA methods by a considerable margin with upsampling factors of 2-fold and 4-fold. Code will be available at https://github.com/XAIMI-Lab/WavTrans .

WaveMixSR-V2: Enhancing Super-resolution with Higher Efficiency

WaveMixSR: A Resource-efficient Neural Network for Image Super-resolution

WaveMix: A Resource-efficient Neural Network for Image Analysis

Super-resolution Reconstruction Algorithms Based on Fusion of Deep Learning Mechanism and Wavelet

WavePaint: Resource-efficient Token-mixer for Self-supervised Inpainting

WaveMix-Lite: A Resource-efficient Neural Network for Image Analysis

ShuffleMixer: An Efficient ConvNet for Image Super-Resolution

CAMixerSR: Only Details Need More "Attention"

Transforming Image Super-Resolution: A ConvFormer-based Efficient Approach

MixerSR: A New Feature Extraction Paradigm for Single Image Super-Resolution

Efficient Super-Resolution System with Block-Wise Hybridization and Quantized Winograd on FPGA

Rethinking Multi-Contrast MRI Super-Resolution: Rectangle-Window Cross-Attention Transformer and Arbitrary-Scale Upsampling

WavTrans: Synergizing Wavelet and Cross-Attention Transformer for Multi-contrast MRI Super-Resolution

Efficient Mixed Transformer for Single Image Super-Resolution

Single-image super-resolution reconstruction based on phase-aware visual multi-layer perceptron (MLP)

Single image super resolution via wavelet transform fusion and SRFeat network

Lightweight image super-resolution network based on extended convolution mixer

Waving Goodbye to Low-Res: A Diffusion-Wavelet Approach for Image Super-Resolution

Wavelet-based Residual Attention Network for Image Super-Resolution

Wave-U-Mamba: An End-To-End Framework For High-Quality And Efficient Speech Super Resolution