Abstract:Objective: Computed tomography (CT) and magnetic resonance imaging (MRI) are widely used in medical imaging modalities, and provide valuable information for clinical diagnosis and treatment. However, due to hardware limitations and radiation safety concerns, the acquired images are often limited in resolution. Super-resolution reconstruction (SR) techniques have been developed to enhance resolution of CT and MRI slices, which can potentially improve diagnostic accuracy. To capture more useful feature information and reconstruct higher quality super-resolution images, we proposed a novel hybrid framework SR model based on generative adversarial networks (GANs). Approach: The proposed SR model combines frequency domain and perceptual loss functions, which can work in both frequency domain and image domain. The proposed method consists of 4 parts: i) the discrete Fourier transform (DFT) operation transforms the image from the image domain to frequency domain; ii) a complex residual U-net performs SR in the frequency domain; iii) the inverse discrete Fourier transform (iDFT) operation based on data fusion transforms the image from the frequency domain to image domain; iv) an enhanced residual U-net network is used for SR of image domain. Main results: Experimental results on bladder MRI slices, abdomen CT slices, and brain MRI slices show that the proposed SR model outperforms state-of-the-art SR methods in terms of visual quality and objective quality metric such as the structural similarity (SSIM) and the peak signal-to-noise ratio (PSNR), which proves that the proposed model has better generalization and robustness. (Bladder dataset: upscaling factor of 2: SSIM=0.913, PSNR=31.203; upscaling factor of 4: SSIM=0.821, PSNR=28.604. Abdomen dataset: upscaling factor of 2: SSIM=0.929, PSNR=32.594; upscaling factor of 4: SSIM=0.834, PSNR=27.050. Brain dataset: SSIM=0.861, PSNR=26.945). Significance: Our proposed SR model is capable of super-resolution reconstruction for CT and MRI slices. The SR results provide a reliable and effective foundation for clinical diagnosis and treatment.

Conversion Between CT and MRI Images Using Diffusion and Score-Matching Models

A Novel Method Of Synthetic Ct Generation From Mr Images Based On Convolutional Neural Networks

Cross-Modality Image Translation: CT Image Synthesis of MR Brain Images using Multi Generative Network with Perceptual Supervision

Synthetic CT Generation from MRI Using 3D Improved Diffusion Model

Synthetic CT Generation from MRI using 3D Transformer-based Denoising Diffusion Model

MRI to CT Synthesis Using Contrastive Learning

Texture-preserving diffusion model for CBCT-to-CT synthesis

Multi-modality MRI Arbitrary Transformation Using Unified Generative Adversarial Networks

Cross-conditioned Diffusion Model for Medical Image to Image Translation

MRI Reconstruction with Side Information using Diffusion Models

DDMM-Synth: A Denoising Diffusion Model for Cross-modal Medical Image Synthesis with Sparse-view Measurement Embedding

DiffCMR: Fast Cardiac MRI Reconstruction with Diffusion Probabilistic Models

MRI-Trans-GAN: 3D MRI Cross-Modality Translation

[CT and MRI fusion based on generative adversarial network and convolutional neural networks under image enhancement].

Mask-guided generative adversarial network for MRI-based CT synthesis

Multi-Conditional Constraint Generative Adversarial Network-Based MR Imaging from CT Scan Data

Mitigating Misalignment in MRI-to-CT Synthesis for Improved Synthetic CT Generation: an Iterative Refinement and Knowledge Distillation Approach.

Towards High-Quality MRI Reconstruction With Anisotropic Diffusion-Assisted Generative Adversarial Networks And Its Multi-Modal Images Extension

A novel hybrid generative adversarial network for CT and MRI super-resolution reconstruction

DiffGAN: An adversarial diffusion model with local transformer for MRI reconstruction

Medical Image Synthesis with Context-Aware Generative Adversarial Networks