Abstract:Recent advances in computer vision have led to significant progress in the generation of realistic image data, with denoising diffusion probabilistic models proving to be a particularly effective method. In this study, we demonstrate that diffusion models can effectively generate fully-annotated microscopy image data sets through an unsupervised and intuitive approach, using rough sketches of desired structures as the starting point. The proposed pipeline helps to reduce the reliance on manual annotations when training deep learning-based segmentation approaches and enables the segmentation of diverse datasets without the need for human annotations. We demonstrate that segmentation models trained with a small set of synthetic image data reach accuracy levels comparable to those of generalist models trained with a large and diverse collection of manually annotated image data, thereby offering a streamlined and specialized application of segmentation models. Modern generative techniques have unlocked the potential to create realistic image data of high quality, prompting the possibility of substituting real image data in segmentation training workflows. Our study highlights the capacity of denoising diffusion probabilistic models to generate high-quality microscopy image data. With adjustments to the generation process, these models can produce realistic fully-annotated image datasets through an intuitive and unsupervised approach. The parameters of the generative pipeline undergo optimization through various evaluations, resulting in synthetic image data that exhibits high PSNR scores. Our practical experiments encompass multiple scenarios, including manual annotations, initial segmentations, and simulations as starting points, demonstrating the versatility of our approach. Importantly, we compare the performance of segmentation models trained on a limited set of synthetic image data with those trained on a vast and diverse collection of manually annotated data, demonstrating the potential of our pipeline to alleviate the reliance on extensive manually annotated datasets. Our approach lays the groundwork for similar applications, thereby promoting the much-needed availability of publicly accessible fully-annotated image datasets and advancing the goal of annotation-free segmentation.

Annotated Biomedical Video Generation using Denoising Diffusion Probabilistic Models and Flow Fields

Neural Cell Video Synthesis via Optical-Flow Diffusion

Denoising Diffusion Probabilistic Models for Generation of Realistic Fully-Annotated Microscopy Image Data Sets

Denoising diffusion probabilistic models for generation of realistic fully-annotated microscopy image datasets

Cascaded Diffusion Models for 2D and 3D Microscopy Image Synthesis to Enhance Cell Segmentation

Two-stage Generative Models of Simulating Training Data at the Voxel Level for Large-Scale Microscopy Bioimage Segmentation

Denoising diffusion probabilistic models for 3D medical image generation

Retinal OCT Synthesis with Denoising Diffusion Probabilistic Models for Layer Segmentation

Paired Diffusion: Generation of related, synthetic PET-CT-Segmentation scans using Linked Denoising Diffusion Probabilistic Models

Optical Flow Representation Alignment Mamba Diffusion Model for Medical Video Generation

SynCellFactory: Generative Data Augmentation for Cell Tracking

Denoising Diffusion Probabilistic Models for Image Inpainting of Cell Distributions in the Human Brain

The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimation

Baikal: Unpaired Denoising of Fluorescence Microscopy Images using Diffusion Models

Improving 3D deep learning segmentation with biophysically motivated cell synthesis

An Organism Starts with a Single Pix-Cell: A Neural Cellular Diffusion for High-Resolution Image Synthesis

An unobtrusive quality supervision approach for medical image annotation

3D fluorescence microscopy data synthesis for segmentation and benchmarking

Generative modeling of living cells with SO(3)-equivariant implicit neural representations

This microtubule does not exist: Super-resolution microscopy image generation by a diffusion model

Diffusion Probabilistic Modeling for Video Generation