Abstract:Objective: Artificial intelligence (AI) methods have gained popularity in medical imaging research. The size and scope of the training image datasets needed for successful AI model deployment does not always have the desired scale. In this paper, we introduce a medical image synthesis framework aimed at addressing the challenge of limited training datasets for AI models. Approach: The proposed 2D image synthesis framework is based on a diffusion model using a Swin-transformer-based network. This model consists of a forward Gaussian noise process and a reverse process using the Transformer-based Diffusion model for denoising. Training data includes four image datasets: chest X-rays, heart MRI, pelvic CT, and abdomen CT. We evaluated the authenticity, quality, and diversity of the synthetic images using visual Turing assessments conducted by three medical physicists, and four quantitative evaluations: the Inception score (IS), Fréchet Inception Distance score (FID), feature similarity and diversity score (DS, indicating diversity similarity) between the synthetic and true images. To leverage the framework value for training AI models, we conducted COVID-19 classification tasks using real images, synthetic images, and mixtures of both images. Main results: Visual Turing assessments showed an average accuracy of 0.64 (accuracy converging to 50% indicates a better realistic visual appearance of the synthetic images), sensitivity of 0.79, and specificity of 0.50. Average quantitative accuracy obtained from all datasets were IS=2.28, FID=37.27, FDS=0.20, and DS=0.86. For the COVID-19 classification task, the baseline network obtained an accuracy of 0.88 using a pure real dataset, 0.89 using a pure synthetic dataset, and 0.93 using a dataset mixed of real and synthetic data. Significance: A image synthesis framework was demonstrated for medical image synthesis, which can generate high-quality medical images of different imaging modalities with the purpose of supplementing existing training sets for AI model deployment. This method has potential applications in many data-driven medical imaging research.

Domain-Adaptive 3D Medical Image Synthesis: An Efficient Unsupervised Approach

A novel 3D unsupervised domain adaptation framework for cross-modality medical image segmentation

Unsupervised Domain Adaptation Approach for Vision-Based Semantic Understanding of Bridge Inspection Scenes Without Manual Annotations

Unsupervised Domain Adaptation for 3D Human Pose Estimation

DA-VSR: Domain Adaptable Volumetric Super-Resolution For Medical Images

Diffuse-UDA: Addressing Unsupervised Domain Adaptation in Medical Image Segmentation with Appearance and Structure Aligned Diffusion Models

Embracing the disharmony in medical imaging: A Simple and effective framework for domain adaptation

Enhancing and Adapting in the Clinic: Source-free Unsupervised Domain Adaptation for Medical Image Enhancement

VDM-DA: Virtual Domain Modeling for Source Data-free Domain Adaptation

Domain-Adaptive Single-View 3D Reconstruction

Unsupervised Domain Adaptation with Variational Approximation for Cardiac Segmentation

Domain Adaptation for Medical Image Classification Without Source Data

One-shot Generative Domain Adaptation in 3D GANs

Towards collaborative appearance and semantic adaptation for medical image segmentation

Rethinking Disentanglement in Unsupervised Domain Adaptation for Medical Image Segmentation

Unsupervised Model Adaptation for Source-free Segmentation of Medical Images

Domain-Adaptive Full-Face Gaze Estimation via Novel-View-Synthesis and Feature Disentanglement

2D medical image synthesis using transformer-based denoising diffusion probabilistic model

Improving synthetic 3D model-aided indoor image localization via domain adaptation

Adversarial Unsupervised Domain Adaptation for 3D Semantic Segmentation with 2D Image Fusion of Dense Depth