Abstract:Semantic segmentation of medical images is pivotal in applications like disease diagnosis and treatment planning. While deep learning has excelled in automating this task, a major hurdle is the need for numerous annotated segmentation masks, which are resource-intensive to produce due to the required expertise and time. This scenario often leads to ultra low-data regimes, where annotated images are extremely limited, posing significant challenges for the generalization of conventional deep learning methods on test images. To address this, we introduce a generative deep learning framework, which uniquely generates high-quality paired segmentation masks and medical images, serving as auxiliary data for training robust models in data-scarce environments. Unlike traditional generative models that treat data generation and segmentation model training as separate processes, our method employs multi-level optimization for end-to-end data generation. This approach allows segmentation performance to directly influence the data generation process, ensuring that the generated data is specifically tailored to enhance the performance of the segmentation model. Our method demonstrated strong generalization performance across 9 diverse medical image segmentation tasks and on 16 datasets, in ultra-low data regimes, spanning various diseases, organs, and imaging modalities. When applied to various segmentation models, it achieved performance improvements of 10-20\% (absolute), in both same-domain and out-of-domain scenarios. Notably, it requires 8 to 20 times less training data than existing methods to achieve comparable results. This advancement significantly improves the feasibility and cost-effectiveness of applying deep learning in medical imaging, particularly in scenarios with limited data availability.

DiverGen: Improving Instance Segmentation by Learning Wider Data Distribution with More Diverse Generative Data

Improving the Effectiveness of Deep Generative Data

Ensemble Data Augmentation for Imbalanced Fault Diagnosis.

Data-efficient 3D instance segmentation by transferring knowledge from synthetic scans

Generalize or Detect? Towards Robust Semantic Segmentation Under Multiple Distribution Shifts

DIAGen: Diverse Image Augmentation with Generative Models

JDGAN: Enhancing generator on extremely limited data via joint distribution

Data-Efficient Instance Generation from Instance Discrimination

Generative Expansion of Small Datasets: An Expansive Graph Approach

Generative AI Enables Medical Image Segmentation in Ultra Low-Data Regimes

Toward Understanding Generative Data Augmentation

Generative Active Learning for Long-tailed Instance Segmentation

A Comprehensive Survey on Data-Efficient GANs in Image Generation

Remote Sensing Data Augmentation Through Adversarial Training

ScribbleGen: Generative Data Augmentation Improves Scribble-supervised Semantic Segmentation

Boosting Data Analytics With Synthetic Volume Expansion

Dataset Diffusion: Diffusion-based Synthetic Dataset Generation for Pixel-Level Semantic Segmentation

Diversify, Don't Fine-Tune: Scaling Up Visual Recognition Training with Synthetic Images

Differentiable Augmentation for Data-Efficient GAN Training

Distribution-Aware Data Expansion with Diffusion Models