Abstract:Recently, the diffusion model has emerged as a superior generative model that can produce high quality and realistic images. However, for medical image translation, the existing diffusion models are deficient in accurately retaining structural information since the structure details of source domain images are lost during the forward diffusion process and cannot be fully recovered through learned reverse diffusion, while the integrity of anatomical structures is extremely important in medical images. For instance, errors in image translation may distort, shift, or even remove structures and tumors, leading to incorrect diagnosis and inadequate treatments. Training and conditioning diffusion models using paired source and target images with matching anatomy can help. However, such paired data are very difficult and costly to obtain, and may also reduce the robustness of the developed model to out-of-distribution testing data. We propose a frequency-guided diffusion model (FGDM) that employs frequency-domain filters to guide the diffusion model for structure-preserving image translation. Based on its design, FGDM allows zero-shot learning, as it can be trained solely on the data from the target domain, and used directly for source-to-target domain translation without any exposure to the source-domain data during training. We evaluated it on three cone-beam CT (CBCT)-to-CT translation tasks for different anatomical sites, and a cross-institutional MR imaging translation task. FGDM outperformed the state-of-the-art methods (GAN-based, VAE-based, and diffusion-based) in metrics of Frechet Inception Distance (FID), Peak Signal-to-Noise Ratio (PSNR), and Structural Similarity Index Measure (SSIM), showing its significant advantages in zero-shot medical image translation.

What problem does this paper attempt to address?

The paper primarily addresses the issue of preserving structural integrity in medical image translation tasks, particularly achieving this goal without paired data. Specifically, the paper proposes a novel method called the Frequency-Guided Diffusion Model (FGDM), aimed at solving the problem of existing diffusion models failing to accurately retain structural information during medical image translation. Traditionally, diffusion models lose structural details of the source domain image during the forward diffusion process, and these details are difficult to fully recover through the reverse diffusion process. However, in medical images, the integrity and accuracy of anatomical structures are extremely important. For example, errors in image translation can lead to structural distortions, displacements, or even the removal of critical structures such as tumors, which could result in incorrect diagnoses and treatment plans. To address the above issues, the researchers proposed FGDM. This model uses frequency domain filters to guide the diffusion model in structure-preserving image translation. A key feature of FGDM is that it allows zero-shot learning, meaning the model only needs to be trained on target domain data and can then be directly used for translation tasks from the source domain to the target domain without encountering any source domain data during training. The paper evaluates FGDM's performance on cone-beam CT (CBCT) to CT translation tasks for different anatomical parts and cross-institutional magnetic resonance (MR) image translation tasks. The results show that FGDM outperforms existing state-of-the-art methods, including those based on Generative Adversarial Networks (GANs), Variational Autoencoders (VAEs), and diffusion models, in metrics such as Fréchet Inception Distance (FID), Peak Signal-to-Noise Ratio (PSNR), and Structural Similarity Index (SSIM). In summary, the main contribution of this paper is the proposal of a new diffusion model framework that can effectively preserve anatomical structure information in medical images without the need for paired data, thereby improving the quality and reliability of medical image translation.

Zero-shot Medical Image Translation via Frequency-Guided Diffusion Models

FDDM: Unsupervised Medical Image Translation with a Frequency-Decoupled Diffusion Model

Mutual Information Guided Diffusion for Zero-Shot Cross-Modality Medical Image Translation

Diffusion based Zero-shot Medical Image-to-Image Translation for Cross Modality Segmentation

Frequency Domain Decomposition Translation for Enhanced Medical Image Translation Using GANs

Target-Guided Diffusion Models for Unpaired Cross-modality Medical Image Translation

Robust Cross-modal Medical Image Translation Via Diffusion Model and Knowledge Distillation

Cascaded Multi-path Shortcut Diffusion Model for Medical Image Translation

Bi-level Guided Diffusion Models for Zero-Shot Medical Imaging Inverse Problems

Cross-conditioned Diffusion Model for Medical Image to Image Translation

2.5D Multi-view Averaging Diffusion Model for 3D Medical Image Translation: Application to Low-count PET Reconstruction with CT-less Attenuation Correction

Unsupervised Medical Image Translation with Adversarial Diffusion Models

Zero-shot-Learning Cross-Modality Data Translation Through Mutual Information Guided Stochastic Diffusion

Similarity-aware Syncretic Latent Diffusion Model for Medical Image Translation with Representation Learning

ContourDiff: Unpaired Image-to-Image Translation with Structural Consistency for Medical Imaging

Zero-shot Dynamic MRI Reconstruction with Global-to-local Diffusion Model

MedGAN: Medical Image Translation using GANs

Cross-Domain Medical Image Translation by Shared Latent Gaussian Mixture Model

MedDiff-FM: A Diffusion-based Foundation Model for Versatile Medical Image Applications

Adaptive Latent Diffusion Model for 3D Medical Image to Image Translation: Multi-modal Magnetic Resonance Imaging Study

A New Chapter for Medical Image Generation: The Stable Diffusion Method