Abstract:Objective: Computed tomography (CT) and magnetic resonance imaging (MRI) are widely used in medical imaging modalities, and provide valuable information for clinical diagnosis and treatment. However, due to hardware limitations and radiation safety concerns, the acquired images are often limited in resolution. Super-resolution reconstruction (SR) techniques have been developed to enhance resolution of CT and MRI slices, which can potentially improve diagnostic accuracy. To capture more useful feature information and reconstruct higher quality super-resolution images, we proposed a novel hybrid framework SR model based on generative adversarial networks (GANs). Approach: The proposed SR model combines frequency domain and perceptual loss functions, which can work in both frequency domain and image domain. The proposed method consists of 4 parts: i) the discrete Fourier transform (DFT) operation transforms the image from the image domain to frequency domain; ii) a complex residual U-net performs SR in the frequency domain; iii) the inverse discrete Fourier transform (iDFT) operation based on data fusion transforms the image from the frequency domain to image domain; iv) an enhanced residual U-net network is used for SR of image domain. Main results: Experimental results on bladder MRI slices, abdomen CT slices, and brain MRI slices show that the proposed SR model outperforms state-of-the-art SR methods in terms of visual quality and objective quality metric such as the structural similarity (SSIM) and the peak signal-to-noise ratio (PSNR), which proves that the proposed model has better generalization and robustness. (Bladder dataset: upscaling factor of 2: SSIM=0.913, PSNR=31.203; upscaling factor of 4: SSIM=0.821, PSNR=28.604. Abdomen dataset: upscaling factor of 2: SSIM=0.929, PSNR=32.594; upscaling factor of 4: SSIM=0.834, PSNR=27.050. Brain dataset: SSIM=0.861, PSNR=26.945). Significance: Our proposed SR model is capable of super-resolution reconstruction for CT and MRI slices. The SR results provide a reliable and effective foundation for clinical diagnosis and treatment.

Realistic Medical Image Super-Resolution with Pyramidal Feature Multi-Distillation Networks for Intelligent Healthcare Systems

Super-resolution Reconstruction Algorithms Based on Fusion of Deep Learning Mechanism and Wavelet

RECONSTRUCTION OF HIGH-RESOLUTION HEPATIC TUMOR CT IMAGES USING AN AUGMENTATION-BASED SUPER-RESOLUTION TECHNIQUE

A Novel Fuzzy Hierarchical Fusion Attention Convolution Neural Network for Medical Image Super-Resolution Reconstruction

Multi-level feature extraction and reconstruction for 3D MRI image super-resolution

Super-Resolution Network with Information Distillation and Multi-Scale Attention for Medical CT Image

RIRGAN: an End-to-end Lightweight Multi-Task Learning Method for Brain MRI Super-Resolution and Denoising

Super‐resolution reconstruction algorithm for medical images by fusion of wavelet transform and multi‐scale adaptive feature selection

Learning deconvolutional deep neural network for high resolution medical image reconstruction

X-ray image super-resolution reconstruction based on a multiple distillation feedback network

More Realistic Low-Resolution OCT Image Generation Approach for Training Deep Neural Networks

Neighborhood evaluator for efficient super-resolution reconstruction of 2D medical images

Dynamic feature distillation and pyramid split large kernel attention network for lightweight image super-resolution

Super-resolution infrared imaging via multi-receptive field information distillation network

Dual Arbitrary Scale Super-Resolution for Multi-Contrast MRI

Image Super-Resolution Reconstruction Based on Dense Residual Attention and Multi-Scale Feature Fusion

A Multi-Scale Recursive Attention Feature Fusion Network for Image Super-Resolution Reconstruction Algorithm

A Hybrid Convolutional Neural Network for Super-Resolution Reconstruction of MR Images.

Super-Resolution Reconstruction of 3T-Like Images from 0.35T MRI Using a Hybrid Attention Residual Network

Iterative-in-Iterative Super-Resolution Biomedical Imaging Using One Real Image

A novel hybrid generative adversarial network for CT and MRI super-resolution reconstruction