Abstract:Recently, the diffusion model has emerged as a superior generative model that can produce high quality and realistic images. However, for medical image translation, the existing diffusion models are deficient in accurately retaining structural information since the structure details of source domain images are lost during the forward diffusion process and cannot be fully recovered through learned reverse diffusion, while the integrity of anatomical structures is extremely important in medical images. For instance, errors in image translation may distort, shift, or even remove structures and tumors, leading to incorrect diagnosis and inadequate treatments. Training and conditioning diffusion models using paired source and target images with matching anatomy can help. However, such paired data are very difficult and costly to obtain, and may also reduce the robustness of the developed model to out-of-distribution testing data. We propose a frequency-guided diffusion model (FGDM) that employs frequency-domain filters to guide the diffusion model for structure-preserving image translation. Based on its design, FGDM allows zero-shot learning, as it can be trained solely on the data from the target domain, and used directly for source-to-target domain translation without any exposure to the source-domain data during training. We evaluated it on three cone-beam CT (CBCT)-to-CT translation tasks for different anatomical sites, and a cross-institutional MR imaging translation task. FGDM outperformed the state-of-the-art methods (GAN-based, VAE-based, and diffusion-based) in metrics of Frechet Inception Distance (FID), Peak Signal-to-Noise Ratio (PSNR), and Structural Similarity Index Measure (SSIM), showing its significant advantages in zero-shot medical image translation.

Zero-Shot Translation using Diffusion Models

Zero-shot-Learning Cross-Modality Data Translation Through Mutual Information Guided Stochastic Diffusion

Improved Zero-shot Neural Machine Translation Via Ignoring Spurious Correlations.

The Missing Ingredient in Zero-Shot Neural Machine Translation

Mutual Information Guided Diffusion for Zero-Shot Cross-Modality Medical Image Translation

MirrorDiffusion: Stabilizing Diffusion Process in Zero-Shot Image Translation by Prompts Redescription and Beyond

Diffusion based Zero-shot Medical Image-to-Image Translation for Cross Modality Segmentation

Exploring Data Efficiency in Zero-Shot Learning with Diffusion Models

Motion-Zero: Zero-Shot Moving Object Control Framework for Diffusion-Based Video Generation

Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Model

Improving Zero-Shot Translation of Low-Resource Languages

Your Diffusion Model is Secretly a Zero-Shot Classifier

Zero-shot Medical Image Translation via Frequency-Guided Diffusion Models

VGDIFFZERO: Text-To-Image Diffusion Models Can Be Zero-Shot Visual Grounders.

Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation

Multilingual Neural Machine Translation for Zero-Resource Languages

Improving Zero-shot Neural Machine Translation on Language-specific Encoders-Decoders

Towards Zero-Shot Multimodal Machine Translation

Towards a Better Understanding of Variations in Zero-Shot Neural Machine Translation Performance

Going beyond Compositions, DDPMs Can Produce Zero-Shot Interpolations