Abstract:Semantic segmentation of medical images is pivotal in applications like disease diagnosis and treatment planning. While deep learning has excelled in automating this task, a major hurdle is the need for numerous annotated segmentation masks, which are resource-intensive to produce due to the required expertise and time. This scenario often leads to ultra low-data regimes, where annotated images are extremely limited, posing significant challenges for the generalization of conventional deep learning methods on test images. To address this, we introduce a generative deep learning framework, which uniquely generates high-quality paired segmentation masks and medical images, serving as auxiliary data for training robust models in data-scarce environments. Unlike traditional generative models that treat data generation and segmentation model training as separate processes, our method employs multi-level optimization for end-to-end data generation. This approach allows segmentation performance to directly influence the data generation process, ensuring that the generated data is specifically tailored to enhance the performance of the segmentation model. Our method demonstrated strong generalization performance across 9 diverse medical image segmentation tasks and on 16 datasets, in ultra-low data regimes, spanning various diseases, organs, and imaging modalities. When applied to various segmentation models, it achieved performance improvements of 10-20\% (absolute), in both same-domain and out-of-domain scenarios. Notably, it requires 8 to 20 times less training data than existing methods to achieve comparable results. This advancement significantly improves the feasibility and cost-effectiveness of applying deep learning in medical imaging, particularly in scenarios with limited data availability.

Using diffusion models to generate synthetic labeled data for medical image segmentation

Using Diffusion Models to Generate Synthetic Labelled Data for Medical Image Segmentation

Data Augmentation in Class-Conditional Diffusion Model for Semi-Supervised Medical Image Segmentation

Generating Synthetic Data for Medical Imaging

Synthetic Medical Images from Dual Generative Adversarial Networks

Auto-Generating Weak Labels for Real & Synthetic Data to Improve Label-Scarce Medical Image Segmentation

3D MRI Synthesis with Slice-Based Latent Diffusion Models: Improving Tumor Segmentation Tasks in Data-Scarce Regimes

Augmenting medical image classifiers with synthetic data from latent diffusion models

Anatomically-Controllable Medical Image Generation with Segmentation-Guided Diffusion Models

Data Augmentation for Surgical Scene Segmentation with Anatomy-Aware Diffusion Models

Medical Image Synthesis for Data Augmentation and Anonymization using Generative Adversarial Networks

How Good Are Synthetic Medical Images? An Empirical Study with Lung Ultrasound

Denoising diffusion probabilistic models for 3D medical image generation

Generative AI Enables Medical Image Segmentation in Ultra Low-Data Regimes

Enabling Competitive Performance of Medical Imaging with Diffusion Model-generated Images without Privacy Leakage

Generating and evaluating synthetic data in digital pathology through diffusion models

Mask-conditioned latent diffusion for generating gastrointestinal polyp images

Coupling AI and Citizen Science in Creation of Enhanced Training Dataset for Medical Image Segmentation

Enhancing Medical Image Segmentation with Deep Learning and Diffusion Models

Diffusion-based Data Augmentation for Skin Disease Classification: Impact Across Original Medical Datasets to Fully Synthetic Images