Abstract:Creating in-silico data with generative AI promises a cost-effective alternative to staining, imaging, and annotating whole slide images in computational pathology. Diffusion models are the state-of-the-art solution for generating in-silico images, offering unparalleled fidelity and realism. Using appearance transfer diffusion models allows for zero-shot image generation, facilitating fast application and making model training unnecessary. However current appearance transfer diffusion models are designed for natural images, where the main task is to transfer the foreground object from an origin to a target domain, while the background is of insignificant importance. In computational pathology, specifically in oncology, it is however not straightforward to define which objects in an image should be classified as foreground and background, as all objects in an image may be of critical importance for the detailed understanding the tumor micro-environment. We contribute to the applicability of appearance transfer diffusion models to immunohistochemistry-stained images by modifying the appearance transfer guidance to alternate between class-specific AdaIN feature statistics matchings using existing segmentation masks. The performance of the proposed method is demonstrated on the downstream task of supervised epithelium segmentation, showing that the number of manual annotations required for model training can be reduced by 75%, outperforming the baseline approach. Additionally, we consulted with a certified pathologist to investigate future improvements. We anticipate this work to inspire the application of zero-shot diffusion models in computational pathology, providing an efficient method to generate in-silico images with unmatched fidelity and realism, which prove meaningful for downstream tasks, such as training existing deep learning models or finetuning foundation models.

Artificial Immunofluorescence in a Flash: Rapid Synthetic Imaging from Brightfield Through Residual Diffusion

Artificial immunofluorescence in a flash: Rapid synthetic imaging from brightfield through residual diffusion

Deep Learning Enhanced Fluorescence Emission Difference Microscopy

Can Generative AI Replace Immunofluorescent Staining Processes? A Comparison Study of Synthetically Generated CellPainting Images from Brightfield

Random Multi-Channel Image Synthesis for Multiplexed Immunofluorescence Imaging

Rapid and Extreme Low-light Superresolution Imaging Via Artificial Intelligence

QUAL-IF-AI: Quality Control of Immunofluorescence Images using Artificial Intelligence

Explainable Machine Learning for Profiling the Immunological Synapse and Functional Characterization of Therapeutic Antibodies.

Image Processing for Fusion Identification Between the GLUT4 Storage Vesicles and the Plasma Membrane

ReagentTF: a Rapid and Versatile Optical Clearing Method for Biological Imaging(conference Presentation)

Fast imaging of 15 intracellular compartments and interactions by deep learning segmentation of super-resolution data

Mask-guided cross-image attention for zero-shot in-silico histopathologic image generation with a diffusion model

Single-sample image-fusion upsampling of fluorescence lifetime images

Artificial confocal microscopy for deep label-free imaging

Real-time Fluorescence Imaging Flow Cytometry Enabled by Motion Deblurring and Deep Learning Algorithms.

Generative adversarial network enables rapid and robust fluorescence lifetime image analysis in live cells

Enhanced detection of fluorescence fluctuations for high-throughput super-resolution imaging

Single-frame deep-learning super-resolution microscopy for intracellular dynamics imaging

Cascaded Diffusion Models for 2D and 3D Microscopy Image Synthesis to Enhance Cell Segmentation

Fluorescence Separation Based on the Spatiotemporal Gaussian Mixture Model for Dynamic Fluorescence Molecular Tomography

Deep Learning-Inferred Multiplex ImmunoFluorescence for IHC Image Quantification