Abstract:Large-scale, big-variant, high-quality data are crucial for developing robust and successful deep-learning models for medical applications since they potentially enable better generalization performance and avoid overfitting. However, the scarcity of high-quality labeled data always presents significant challenges. This paper proposes a novel approach to address this challenge by developing controllable diffusion models for medical image synthesis, called DiffBoost. We leverage recent diffusion probabilistic models to generate realistic and diverse synthetic medical image data that preserve the essential characteristics of the original medical images by incorporating edge information of objects to guide the synthesis process. In our approach, we ensure that the synthesized samples adhere to medically relevant constraints and preserve the underlying structure of imaging data. Due to the random sampling process by the diffusion model, we can generate an arbitrary number of synthetic images with diverse appearances. To validate the effectiveness of our proposed method, we conduct an extensive set of medical image segmentation experiments on multiple datasets, including Ultrasound breast (+13.87%), CT spleen (+0.38%), and MRI prostate (+7.78%), achieving significant improvements over the baseline segmentation methods. The promising results demonstrate the effectiveness of our \textcolor{black}{DiffBoost} for medical image segmentation tasks and show the feasibility of introducing a first-ever text-guided diffusion model for general medical image segmentation tasks. With carefully designed ablation experiments, we investigate the influence of various data augmentations, hyper-parameter settings, patch size for generating random merging mask settings, and combined influence with different network architectures. Source code are available at <a class="link-external link-https" href="https://github.com/NUBagciLab/DiffBoost" rel="external noopener nofollow">this https URL</a>.

PalScDiff: A diffusion-based framework with progressive augmentation learning and semantic consistency for breast ultrasound tumor segmentation

PGDiffSeg: Prior-Guided Denoising Diffusion Model with Parameter-Shared Attention for Breast Cancer Segmentation

Panoptic Segmentation of Mammograms with Text-To-Image Diffusion Model

Balancing Regional and Global Information: an Interactive Segmentation Framework for Ultrasound Breast Lesion.

DiffSeg: A Segmentation Model for Skin Lesions Based on Diffusion Difference

Diff-UNet: A Diffusion Embedded Network for Volumetric Segmentation

Multi-Level Global Context Cross Consistency Model for Semi-Supervised Ultrasound Image Segmentation with Diffusion Model

Diffusion model-based text-guided enhancement network for medical image segmentation

BerDiff: Conditional Bernoulli Diffusion Model for Medical Image Segmentation

TransDiffSeg: Transformer-Based Conditional Diffusion Segmentation Model for Abdominal Multi-Objective

DiffBoost: Enhancing Medical Image Segmentation via Text-Guided Diffusion Model

MedSegDiff: Medical Image Segmentation with Diffusion Probabilistic Model

Enhancing Label-efficient Medical Image Segmentation with Text-guided Diffusion Models

DiffusionDCI: A Novel Diffusion-based Unified Framework for Dynamic Full-Field OCT Image Generation and Segmentation

Pancreatic Tumor Segmentation as Anomaly Detection in CT Images Using Denoising Diffusion Models

P-MSDiff: Parallel Multi-Scale Diffusion for Remote Sensing Image Segmentation

DermoSegDiff: A Boundary-aware Segmentation Diffusion Model for Skin Lesion Delineation

Anatomically-Controllable Medical Image Generation with Segmentation-Guided Diffusion Models

Diffusion Kinetic Model for Breast Cancer Segmentation in Incomplete DCE-MRI

Diff-SFCT: A Diffusion Model with Spatial-Frequency Cross Transformer for Medical Image Segmentation.

FDiff-Fusion:Denoising diffusion fusion network based on fuzzy learning for 3D medical image segmentation