Abstract:Objective: Computed tomography (CT) and magnetic resonance imaging (MRI) are widely used in medical imaging modalities, and provide valuable information for clinical diagnosis and treatment. However, due to hardware limitations and radiation safety concerns, the acquired images are often limited in resolution. Super-resolution reconstruction (SR) techniques have been developed to enhance resolution of CT and MRI slices, which can potentially improve diagnostic accuracy. To capture more useful feature information and reconstruct higher quality super-resolution images, we proposed a novel hybrid framework SR model based on generative adversarial networks (GANs). Approach: The proposed SR model combines frequency domain and perceptual loss functions, which can work in both frequency domain and image domain. The proposed method consists of 4 parts: i) the discrete Fourier transform (DFT) operation transforms the image from the image domain to frequency domain; ii) a complex residual U-net performs SR in the frequency domain; iii) the inverse discrete Fourier transform (iDFT) operation based on data fusion transforms the image from the frequency domain to image domain; iv) an enhanced residual U-net network is used for SR of image domain. Main results: Experimental results on bladder MRI slices, abdomen CT slices, and brain MRI slices show that the proposed SR model outperforms state-of-the-art SR methods in terms of visual quality and objective quality metric such as the structural similarity (SSIM) and the peak signal-to-noise ratio (PSNR), which proves that the proposed model has better generalization and robustness. (Bladder dataset: upscaling factor of 2: SSIM=0.913, PSNR=31.203; upscaling factor of 4: SSIM=0.821, PSNR=28.604. Abdomen dataset: upscaling factor of 2: SSIM=0.929, PSNR=32.594; upscaling factor of 4: SSIM=0.834, PSNR=27.050. Brain dataset: SSIM=0.861, PSNR=26.945). Significance: Our proposed SR model is capable of super-resolution reconstruction for CT and MRI slices. The SR results provide a reliable and effective foundation for clinical diagnosis and treatment.

SwinGAN: A dual-domain Swin Transformer-based generative adversarial network for MRI reconstruction

Accelerating CS-MRI Reconstruction with Fine-Tuning Wasserstein Generative Adversarial Network

Fast MRI Reconstruction: How Powerful Transformers Are?

Swin Transformer for Fast MRI

Single-view Cone Beam CT Reconstruction with Swin Transformer Based Deep Learning.

Swin transformer-based GAN for multi-modal medical image translation

Learning Dynamic MRI Reconstruction with Convolutional Network Assisted Reconstruction Swin Transformer

Deep Learning Based MRI Reconstruction with Transformer

CS-MRI Reconstruction Using an Improved GAN with Dilated Residual Networks and Channel Attention Mechanism

A novel Swin transformer approach utilizing residual multi-layer perceptron for diagnosing brain tumors in MRI images

Swin-GAN: Generative Adversarial Network Based on Shifted Windows Transformer Architecture for Image Generation

Generative AI for Rapid Diffusion MRI with Improved Image Quality, Reliability and Generalizability

DBGAN: A dual-branch generative adversarial network for undersampled MRI reconstruction

Multi-branch Cascaded Swin Transformers with Attention to k-space Sampling Pattern for Accelerated MRI Reconstruction

GAN-TL: Generative Adversarial Networks with Transfer Learning for MRI Reconstruction

An Efficient Lightweight Generative Adversarial Network for Compressed Sensing Magnetic Resonance Imaging Reconstruction

A Modified Generative Adversarial Network Using Spatial and Channel-Wise Attention for CS-MRI Reconstruction.

DiffGAN: An adversarial diffusion model with local transformer for MRI reconstruction

ReeGAN: MRI image edge-preserving synthesis based on GANs trained with misaligned data

High-Resolution Pelvic MRI Reconstruction Using a Generative Adversarial Network with Attention and Cyclic Loss

A novel hybrid generative adversarial network for CT and MRI super-resolution reconstruction