Abstract:Objective: Computed tomography (CT) and magnetic resonance imaging (MRI) are widely used in medical imaging modalities, and provide valuable information for clinical diagnosis and treatment. However, due to hardware limitations and radiation safety concerns, the acquired images are often limited in resolution. Super-resolution reconstruction (SR) techniques have been developed to enhance resolution of CT and MRI slices, which can potentially improve diagnostic accuracy. To capture more useful feature information and reconstruct higher quality super-resolution images, we proposed a novel hybrid framework SR model based on generative adversarial networks (GANs). Approach: The proposed SR model combines frequency domain and perceptual loss functions, which can work in both frequency domain and image domain. The proposed method consists of 4 parts: i) the discrete Fourier transform (DFT) operation transforms the image from the image domain to frequency domain; ii) a complex residual U-net performs SR in the frequency domain; iii) the inverse discrete Fourier transform (iDFT) operation based on data fusion transforms the image from the frequency domain to image domain; iv) an enhanced residual U-net network is used for SR of image domain. Main results: Experimental results on bladder MRI slices, abdomen CT slices, and brain MRI slices show that the proposed SR model outperforms state-of-the-art SR methods in terms of visual quality and objective quality metric such as the structural similarity (SSIM) and the peak signal-to-noise ratio (PSNR), which proves that the proposed model has better generalization and robustness. (Bladder dataset: upscaling factor of 2: SSIM=0.913, PSNR=31.203; upscaling factor of 4: SSIM=0.821, PSNR=28.604. Abdomen dataset: upscaling factor of 2: SSIM=0.929, PSNR=32.594; upscaling factor of 4: SSIM=0.834, PSNR=27.050. Brain dataset: SSIM=0.861, PSNR=26.945). Significance: Our proposed SR model is capable of super-resolution reconstruction for CT and MRI slices. The SR results provide a reliable and effective foundation for clinical diagnosis and treatment.

A Comparative Study of CNN-based Super-Resolution Methods in MRI Reconstruction and Its Beyond

Rethinking Multi-Contrast MRI Super-Resolution: Rectangle-Window Cross-Attention Transformer and Arbitrary-Scale Upsampling

Super-resolution Reconstruction of MR Image with a Novel Residual Learning Network Algorithm

Brain MRI Super-resolution Reconstruction Using a Multi-level and Parallel Conv-Deconv Network

DL-MRI: A Unified Framework of Deep Learning-Based MRI Super Resolution

Accelerated Super-resolution MR Image Reconstruction via a 3D Densely Connected Deep Convolutional Neural Network

Brain MRI Super-Resolution Using 3D Dilated Convolutional Encoder-Decoder Network

Super-resolution reconstruction of single anisotropic 3D MR images using residual convolutional neural network

3D-MRI super-resolution reconstruction using multi-modality based on multi-resolution CNN

Convolutional neural network based on sparse graph attention mechanism for MRI super-resolution

Medical Image Super-Resolution Reconstruction Algorithms Based on Deep Learning: A Survey

Simultaneous Single- and Multi-Contrast Super-Resolution for Brain MRI Images Based on a Convolutional Neural Network

Super-Resolution Reconstruction of 3T-Like Images from 0.35T MRI Using a Hybrid Attention Residual Network

Multi-Contrast Super-Resolution MRI Through a Progressive Network

Super-resolution Magnetic Resonance Imaging Reconstruction Using Deep Attention Networks

Brain MRI Super-Resolution Using Coupled-Projection Residual Network

Coupled-Projection Residual Network for MRI Super-Resolution

A Hybrid Convolutional Neural Network for Super-Resolution Reconstruction of MR Images.

Hybrid Feature Fusion Neural Network Integrating Transformer for DCE-MRI Super Resolution

A novel hybrid generative adversarial network for CT and MRI super-resolution reconstruction

Progressive Sub-band Residual-Learning Network for MR Image Super Resolution.