Abstract:Staining is a crucial step in histopathology that prepares tissue sections for microscopic examination. Hematoxylin and eosin (H&E) staining, also known as basic or routine staining, is used in 80% of histopathology slides worldwide. To enhance the histopathology workflow, recent research has focused on integrating generative artificial intelligence and deep learning models. These models have the potential to improve staining accuracy, reduce staining time, and minimize the use of hazardous chemicals, making histopathology a safer and more efficient field. In this study, we introduce a novel three-stage, dual contrastive learning-based, image-to-image generative (DCLGAN) model for virtually applying an "H&E stain" to unstained skin tissue images. The proposed model utilizes a unique learning setting comprising two pairs of generators and discriminators. By employing contrastive learning, our model maximizes the mutual information between traditional H&E-stained and virtually stained H&E patches. Our dataset consists of pairs of unstained and H&E-stained images, scanned with a brightfield microscope at 20 × magnification, providing a comprehensive set of training and testing images for evaluating the efficacy of our proposed model. Two metrics, Fréchet Inception Distance (FID) and Kernel Inception Distance (KID), were used to quantitatively evaluate virtual stained slides. Our analysis revealed that the average FID score between virtually stained and H&E-stained images (80.47) was considerably lower than that between unstained and virtually stained slides (342.01), and unstained and H&E stained (320.4) indicating a similarity virtual and H&E stains. Similarly, the mean KID score between H&E stained and virtually stained images (0.022) was significantly lower than the mean KID score between unstained and H&E stained (0.28) or unstained and virtually stained (0.31) images. In addition, a group of experienced dermatopathologists evaluated traditional and virtually stained images and demonstrated an average agreement of 78.8% and 90.2% for paired and single virtual stained image evaluations, respectively. Our study demonstrates that the proposed three-stage dual contrastive learning-based image-to-image generative model is effective in generating virtual stained images, as indicated by quantified parameters and grader evaluations. In addition, our findings suggest that GAN models have the potential to replace traditional H&E staining, which can reduce both time and environmental impact. This study highlights the promise of virtual staining as a viable alternative to traditional staining techniques in histopathology.

TC-CycleGAN: Improved CycleGAN with Texture Constraints for Virtual Staining of Pathological Images.

GAN-based Virtual Re-Staining: A Promising Solution for Whole Slide Image Analysis

Structural Cycle GAN for Virtual Immunohistochemistry Staining of Gland Markers in the Colon

Region-guided CycleGANs for Stain Transfer in Whole Slide Images

Dual Contrastive Learning Guided Pathological Image Re-Staining.

Virtual Staining of Multiphoton Images Based on CycleGAN and Pix2pix

Effective Immunohistochemistry Pathology Microscopy Image Generation Using CycleGAN

Stain Style Transfer for Histological Images Using S3CGAN

Ensuring accurate stain reproduction in deep generative networks for virtual immunohistochemistry

Stain Style Transfer of Histopathology Images Via Structure-Preserved Generative Learning

SCPAT-GAN: Structural Constrained and Pathology Aware Convolutional Transformer-GAN for Virtual Histology Staining of Human Coronary OCT images

CytoGAN: Unpaired staining transfer by structure preservation for cytopathology image analysis

Unpaired Stain Transfer Using Pathology-Consistent Constrained Generative Adversarial Networks

Virtual Immunohistochemistry Staining for Histological Images Assisted by Weakly-supervised Learning

Using machine learning for chemical-free histological tissue staining

Multi-domain stain normalization for digital pathology: A cycle-consistent adversarial network for whole slide images

Structurally constrained and pathology-aware convolutional transformer generative adversarial network for virtual histology staining of human coronary optical coherence tomography images

Dual contrastive learning based image-to-image translation of unstained skin tissue into virtually stained H&E images

Virtual stain transfer in histology via cascaded deep neural networks

Editable Stain Transformation Of Histological Images Using Unpaired GANs

Generating Bright-Field Images of Stained Tissue Slices from Mueller Matrix Polarimetric Images with CycleGAN Using Unpaired Dataset