Abstract:Hematoxylin and Eosin (H&E) staining is the most commonly used for disease diagnosis and tumor recurrence tracking. Hematoxylin excels at highlighting nuclei, whereas eosin stains the cytoplasm. However, H&E stain lacks details for differentiating different types of cells relevant to identifying the grade of the disease or response to specific treatment variations. Pathologists require special immunohistochemical (IHC) stains that highlight different cell types. These stains help in accurately identifying different regions of disease growth and their interactions with the cell's microenvironment. The advent of deep learning models has made Image-to-Image (I2I) translation a key research area, reducing the need for expensive physical staining processes. Pix2Pix and CycleGAN are still the most commonly used methods for virtual staining applications. However, both suffer from hallucinations or staining irregularities when H&E stain has less discriminate information about the underlying cells IHC needs to highlight (e.g.,CD3 lymphocytes). Diffusion models are currently the state-of-the-art models for image generation and conditional generation tasks. However, they require extensive and diverse datasets (millions of samples) to converge, which is less feasible for virtual staining applications.Inspired by the success of multitask deep learning models for limited dataset size, we propose StainDiffuser, a novel multitask dual diffusion architecture for virtual staining that converges under a limited training budget. StainDiffuser trains two diffusion processes simultaneously: (a) generation of cell-specific IHC stain from H&E and (b) H&E-based cell segmentation using coarse segmentation only during training. Our results show that StainDiffuser produces high-quality results for easier (CK8/18,epithelial marker) and difficult stains(CD3, Lymphocytes).

Super-resolved virtual staining of label-free tissue using diffusion models

Superresolution Microscopy Imaging Based on Wide-Field Stochastic Fluorescent Bleaching

3D resoution enhancement in saturated competition microscopy

Sub-60-nm 3D super-resolution imaging via saturated I5S

Superresolution Via Saturated Virtual Modulation Microscopy

Multi-color Virtual Fluorescence Emission Difference Microscopy

Virtual staining of defocused autofluorescence images of unlabeled tissue using deep neural networks

Deep learning-based virtual histology staining using auto-fluorescence of label-free tissue

Virtual Staining of Label-Free Tissue in Imaging Mass Spectrometry

Resolution Enhancement and Background Suppression in Optical Super‐Resolution Imaging for Biological Applications

Deep learning-enabled virtual histological staining of biological samples

StainDiffuser: MultiTask Dual Diffusion Model for Virtual Staining

Digital synthesis of histological stains using micro-structured and multiplexed virtual staining of label-free tissue

Deep learning-based virtual H& E staining from label-free autofluorescence lifetime images

Cross-modal Diffusion Modelling for Super-resolved Spatial Transcriptomics

From Diffusion to Resolution: Leveraging 2D Diffusion Models for 3D Super-Resolution Task

Label-free evaluation of lung and heart transplant biopsies using virtual staining

Versatile Stain Transfer in Histopathology Using a Unified Diffusion Framework

Super-resolution label-free volumetric vibrational imaging

Robust virtual staining of landmark organelles

Virtual stain transfer in histology via cascaded deep neural networks