Abstract:Objective: Computed tomography (CT) and magnetic resonance imaging (MRI) are widely used in medical imaging modalities, and provide valuable information for clinical diagnosis and treatment. However, due to hardware limitations and radiation safety concerns, the acquired images are often limited in resolution. Super-resolution reconstruction (SR) techniques have been developed to enhance resolution of CT and MRI slices, which can potentially improve diagnostic accuracy. To capture more useful feature information and reconstruct higher quality super-resolution images, we proposed a novel hybrid framework SR model based on generative adversarial networks (GANs). Approach: The proposed SR model combines frequency domain and perceptual loss functions, which can work in both frequency domain and image domain. The proposed method consists of 4 parts: i) the discrete Fourier transform (DFT) operation transforms the image from the image domain to frequency domain; ii) a complex residual U-net performs SR in the frequency domain; iii) the inverse discrete Fourier transform (iDFT) operation based on data fusion transforms the image from the frequency domain to image domain; iv) an enhanced residual U-net network is used for SR of image domain. Main results: Experimental results on bladder MRI slices, abdomen CT slices, and brain MRI slices show that the proposed SR model outperforms state-of-the-art SR methods in terms of visual quality and objective quality metric such as the structural similarity (SSIM) and the peak signal-to-noise ratio (PSNR), which proves that the proposed model has better generalization and robustness. (Bladder dataset: upscaling factor of 2: SSIM=0.913, PSNR=31.203; upscaling factor of 4: SSIM=0.821, PSNR=28.604. Abdomen dataset: upscaling factor of 2: SSIM=0.929, PSNR=32.594; upscaling factor of 4: SSIM=0.834, PSNR=27.050. Brain dataset: SSIM=0.861, PSNR=26.945). Significance: Our proposed SR model is capable of super-resolution reconstruction for CT and MRI slices. The SR results provide a reliable and effective foundation for clinical diagnosis and treatment.

Auxiliary Classifier GAN-Based Super-resolution Microwave Coincidence Imaging

Infrared Image Super Resolution Using Gan With Infrared Image Prior

Compressive Sensing Ghost Imaging Object Detection Using Generative Adversarial Networks

High-resolution Three-dimensional Microwave Imaging Using a Generative Adversarial Network

Reweighted-Dynamic-Grid-Based Microwave Coincidence Imaging With Grid Mismatch

Microwave Coincidence Imaging with Phase-Coded Stochastic Radiation Field

Off-Grid Microwave Coincidence Imaging Based on Directional Grid Fission

Multiattention Generative Adversarial Network for Remote Sensing Image Super-Resolution

R2D2-GAN: Robust Dual Discriminator Generative Adversarial Network for Microscopy Hyperspectral Image Super-Resolution

Super-Resolution Enhancement Method Based on Generative Adversarial Network for Integral Imaging Microscopy

Intelligent Microwave Staring Correlated Imaging

A Residual Dense Attention Generative Adversarial Network for Microscopic Image Super-Resolution

Unbiased Auxiliary Classifier GANs with MINE

A novel hybrid generative adversarial network for CT and MRI super-resolution reconstruction

MCBAM-GAN: The Gan Spatiotemporal Fusion Model Based on Multiscale and CBAM for Remote Sensing Images

A High-Resolution and Robust Microwave Correlation Imaging Method Based on URRF Using MC-AAMPE Algorithm

Diverse Sample Generation with Multi-Branch Conditional Generative Adversarial Network for Remote Sensing Objects Detection.

CT Super-resolution GAN Constrained by the Identical, Residual, and Cycle Learning Ensemble(GAN-CIRCLE)

3-D Auxiliary Classifier GAN for Hyperspectral Anomaly Detection via Weakly Supervised Learning

Mutual Information Compensation for High-Fidelity Image Generation With Limited Data

Adversarial generative network with the discriminator using measurements as an auxiliary input for single-pixel imaging