Abstract:Background and Objectives Spread through air spaces (STAS) is an emerging lung cancer infiltration pattern. Predicting its spread through CT scans is crucial. However, limited STAS data makes this prediction task highly challenging. Stable diffusion is capable of generating more diverse and higher-quality images compared to traditional GAN models, surpassing the dominating GAN family models in image synthesis over the past few years. To alleviate the issue of limited STAS data, we propose a method TDASD based on stable diffusion, which is able to generate high-resolution CT images of pulmonary nodules corresponding to specific nodular signs according to the medical professionals. Methods First, we apply the stable diffusion method for fine-tuning training on publicly available lung datasets. Subsequently, we extract nodules from our hospital's lung adenocarcinoma data and apply slight rotations to the original nodule CT slices within a reasonable range before undergoing another round of fine-tuning through stable diffusion. Finally, employing DDIM and Ksample sampling methods, we generate lung adenocarcinoma nodule CT images with signs based on prompts provided by doctors. The method we propose not only safeguards patient privacy but also enhances the diversity of medical images under limited data conditions. Furthermore, our approach to generating medical images incorporates medical knowledge, resulting in images that exhibit pertinent medical features, thus holding significant value in tumor discrimination diagnostics. Results Our TDASD method has the capability to generate medically meaningful images by optimizing input prompts based on medical descriptions provided by experts. The images generated by our method can improve the model's classification accuracy. Furthermore, Utilizing solely the data generated by our method for model training, the test results on the original real dataset reveal an accuracy rate that closely aligns with the testing accuracy achieved through training on real data. Conclusions The method we propose not only safeguards patient privacy but also enhances the diversity of medical images under limited data conditions. Furthermore, our approach to generating medical images incorporates medical knowledge, resulting in images that exhibit pertinent medical features, thus holding significant value in tumor discrimination diagnostics.

A New Chapter for Medical Image Generation: The Stable Diffusion Method

Enabling Competitive Performance of Medical Imaging with Diffusion Model-generated Images without Privacy Leakage

GH-DDM: the generalized hybrid denoising diffusion model for medical image generation

Diffusion Models for Medical Image Computing: A Survey

Advanced image generation for cancer using diffusion models

Denoising diffusion probabilistic models for 3D medical image generation

Spot the fake lungs: Generating Synthetic Medical Images using Neural Diffusion Models

Diffusion models in medical imaging: A comprehensive survey

Measurement Guidance in Diffusion Models: Insight from Medical Image Synthesis

Diffusion Models for Medical Image Analysis: A Comprehensive Survey

Anatomically-Controllable Medical Image Generation with Segmentation-Guided Diffusion Models

Beware of diffusion models for synthesizing medical images -- A comparison with GANs in terms of memorizing brain MRI and chest x-ray images

MAM-E: Mammographic Synthetic Image Generation with Diffusion Models

MediSyn: Text-Guided Diffusion Models for Broad Medical 2D and 3D Image Synthesis

Med-cDiff: Conditional Medical Image Generation with Diffusion Models

Voxel-wise Medical Images Generalization for Eliminating Distribution Shift

Latent Diffusion Model for Medical Image Standardization and Enhancement

How Good Are Synthetic Medical Images? An Empirical Study with Lung Ultrasound

2D medical image synthesis using transformer-based denoising diffusion probabilistic model

TDASD: Generating Medically Significant Fine-Grained Lung Adenocarcinoma Nodule CT Images Based on Stable Diffusion Models with Limited Sample Size

Denoising Diffusion Medical Models