Abstract:Accurate segmentation of multiple organs in Computed Tomography (CT) images plays a vital role in computer-aided diagnosis systems. Various supervised-learning approaches have been proposed recently. However, these methods heavily depend on a large amount of high-quality labeled data, which is expensive to obtain in practice. In this study, we present a label-efficient learning approach using a pre-trained diffusion model for multi-organ segmentation tasks in CT images. First, a denoising diffusion model was trained using unlabeled CT data, generating additional two-dimensional (2D) CT images. Then the pre-trained denoising diffusion network was transferred to the downstream multi-organ segmentation task, effectively creating a semi-supervised learning model that requires only a small amount of labeled data. Furthermore, linear classification and fine-tuning decoder strategies were employed to enhance the network's segmentation performance. Our generative model at 256x256 resolution achieves impressive performance in terms of Fréchet inception distance, spatial Fréchet inception distance, and F1-score, with values of 11.32, 46.93, and 73.1\%, respectively. These results affirm the diffusion model's ability to generate diverse and realistic 2D CT images. Additionally, our method achieves competitive multi-organ segmentation performance compared to state-of-the-art methods on the FLARE 2022 dataset, particularly in limited labeled data scenarios. Remarkably, even with only 1\% and 10\% labeled data, our method achieves Dice similarity coefficients (DSCs) of 71.56\% and 78.51\% after fine-tuning, respectively. The method achieves a DSC score of 51.81\% using just four labeled CT scans. These results demonstrate the efficacy of our approach in overcoming the limitations of supervised learning heavily reliant on large-scale labeled data.

Label group diffusion for image and image pair segmentation

Interactive Image Segmentation Based on Label Pair Diffusion

Lattice Boltzmann Anisotropic Diffusion Model Based Image Segmentation

Context-guided diffusion for label propagation on graphs

Label-efficient Segmentation via Affinity Propagation

Label-Efficient Semantic Segmentation with Diffusion Models

Diffusion-based Image Translation with Label Guidance for Domain Adaptive Semantic Segmentation

DFormer: Diffusion-guided Transformer for Universal Image Segmentation

A diffusion approach to seeded image segmentation

Image Segmentation Using Adaptive Loopy Belief Propagation

Label-efficient Multi-organ Segmentation Method with Diffusion Model

P-MSDiff: Parallel Multi-Scale Diffusion for Remote Sensing Image Segmentation

Enhancing Label-efficient Medical Image Segmentation with Text-guided Diffusion Models

LDLS: 3-D Object Segmentation Through Label Diffusion From 2-D Images

Denoising Diffusions in Latent Space for Medical Image Segmentation

Image Augmentation with Controlled Diffusion for Weakly-Supervised Semantic Segmentation

Unleashing the Potential of the Diffusion Model in Few-shot Semantic Segmentation

Adaptive Level Set Model for Image Segmentation Based on Tensor Diffusion

Cold SegDiffusion: A Novel Diffusion Model for Medical Image Segmentation

An Anisotropic Diffusion System with Nonlinear Time-Delay Structure Tensor for Image Enhancement and Segmentation

Using Label Propagation to Get Confidence Map for Segmentation