Abstract:Diffusion models (DPMs) have demonstrated remarkable performance in image generation, often times outperforming other generative models. Since their introduction, the powerful noise-to-image denoising pipeline has been extended to various discriminative tasks, including image segmentation. In case of medical imaging, often times the images are large 3D scans, where segmenting one image using DPMs become extremely inefficient due to large memory consumption and time consuming iterative sampling process. In this work, we propose a novel conditional generative modeling framework (LDSeg) that performs diffusion in latent space for medical image segmentation. Our proposed framework leverages the learned inherent low-dimensional latent distribution of the target object shapes and source image embeddings. The conditional diffusion in latent space not only ensures accurate n-D image segmentation for multi-label objects, but also mitigates the major underlying problems of the traditional DPM based segmentation: (1) large memory consumption, (2) time consuming sampling process and (3) unnatural noise injection in forward/reverse process. LDSeg achieved state-of-the-art segmentation accuracy on three medical image datasets with different imaging modalities. Furthermore, we show that our proposed model is significantly more robust to noises, compared to the traditional deterministic segmentation models, which can be potential in solving the domain shift problems in the medical imaging domain. Codes are available at: <a class="link-external link-https" href="https://github.com/LDSeg/LDSeg" rel="external noopener nofollow">this https URL</a>.

Unsupervised discovery of 3d hierarchical structure with generative diffusion features

Unsupervised Discovery of 3D Hierarchical Structure with Generative Diffusion Features

Capturing implicit hierarchical structure in 3D biomedical images with self-supervised hyperbolic representations

Unsupervised Learning of 3D Structure from Images

Unsupervised Monocular Depth Estimation Based on Hierarchical Feature-Guided Diffusion

Hierarchical Insights: Exploiting Structural Similarities for Reliable 3D Semantic Segmentation

Diff-UNet: A Diffusion Embedded Network for Volumetric Segmentation

Nested Diffusion Models Using Hierarchical Latent Priors

View-Consistent Hierarchical 3D Segmentation Using Ultrametric Feature Fields

Probing the Latent Hierarchical Structure of Data via Diffusion Models

LaGeM: A Large Geometry Model for 3D Representation Learning and Diffusion

DiffusionSeg: Adapting Diffusion Towards Unsupervised Object Discovery.

Unsupervised 3D out-of-distribution detection with latent diffusion models

A Phase Transition in Diffusion Models Reveals the Hierarchical Nature of Data

Self-supervised Learning of Dense Hierarchical Representations for Medical Image Segmentation

Unsupervised Discovery of Interpretable Directions in h-space of Pre-trained Diffusion Models

Unsupervised learning of hierarchical spatial structures in images

Denoising Diffusions in Latent Space for Medical Image Segmentation

Deep Hierarchical Semantic Segmentation

3D Object Understanding with 3D Convolutional Neural Networks

HOLODIFFUSION: Training a 3D Diffusion Model using 2D Images