Abstract:Staining is a crucial step in histopathology that prepares tissue sections for microscopic examination. Hematoxylin and eosin (H&E) staining, also known as basic or routine staining, is used in 80% of histopathology slides worldwide. To enhance the histopathology workflow, recent research has focused on integrating generative artificial intelligence and deep learning models. These models have the potential to improve staining accuracy, reduce staining time, and minimize the use of hazardous chemicals, making histopathology a safer and more efficient field. In this study, we introduce a novel three-stage, dual contrastive learning-based, image-to-image generative (DCLGAN) model for virtually applying an "H&E stain" to unstained skin tissue images. The proposed model utilizes a unique learning setting comprising two pairs of generators and discriminators. By employing contrastive learning, our model maximizes the mutual information between traditional H&E-stained and virtually stained H&E patches. Our dataset consists of pairs of unstained and H&E-stained images, scanned with a brightfield microscope at 20 × magnification, providing a comprehensive set of training and testing images for evaluating the efficacy of our proposed model. Two metrics, Fréchet Inception Distance (FID) and Kernel Inception Distance (KID), were used to quantitatively evaluate virtual stained slides. Our analysis revealed that the average FID score between virtually stained and H&E-stained images (80.47) was considerably lower than that between unstained and virtually stained slides (342.01), and unstained and H&E stained (320.4) indicating a similarity virtual and H&E stains. Similarly, the mean KID score between H&E stained and virtually stained images (0.022) was significantly lower than the mean KID score between unstained and H&E stained (0.28) or unstained and virtually stained (0.31) images. In addition, a group of experienced dermatopathologists evaluated traditional and virtually stained images and demonstrated an average agreement of 78.8% and 90.2% for paired and single virtual stained image evaluations, respectively. Our study demonstrates that the proposed three-stage dual contrastive learning-based image-to-image generative model is effective in generating virtual stained images, as indicated by quantified parameters and grader evaluations. In addition, our findings suggest that GAN models have the potential to replace traditional H&E staining, which can reduce both time and environmental impact. This study highlights the promise of virtual staining as a viable alternative to traditional staining techniques in histopathology.

Deep learning-based transformation of the H&E stain into special stains

Virtual stain transfer in histology via cascaded deep neural networks

Digital synthesis of histological stains using micro-structured and multiplexed virtual staining of label-free tissue

Deep learning-enabled virtual histological staining of biological samples

Dual contrastive learning based image-to-image translation of unstained skin tissue into virtually stained H&E images

Scalable, Trustworthy Generative Model for Virtual Multi-Staining from H&E Whole Slide Images

Unpaired Multi-Domain Stain Transfer for Kidney Histopathological Images

Single color digital H&E staining with In-and-Out Net

Computational Histological Staining and Destaining of Prostate Core Biopsy RGB Images with Generative Adversarial Neural Networks

Deep learning-based virtual histology staining using auto-fluorescence of label-free tissue

Virtual multi-staining in a single-section view for renal pathology using generative adversarial networks

Quantifying the effects of data augmentation and stain color normalization in convolutional neural networks for computational pathology

Staining Condition Visualization in Digital Histopathological Whole-Slide Images

A Deep Learning Method for Automatic Evaluation of Diagnostic Information from Multi-Stained Histopathological Images

Generative adversarial network based digital stain conversion for generating RGB EVG stained image from hyperspectral H&E stained image

PhaseStain: Digital staining of label-free quantitative phase microscopy images using deep learning

A Laplacian Pyramid Based Generative H&E Stain Augmentation Network

Unstained Tissue Imaging and Virtual Hematoxylin and Eosin Staining of Histologic Whole Slide Images

Transformation from hematoxylin-and-eosin staining to Ki-67 immunohistochemistry digital staining images using deep learning: experimental validation on the labeling index

Computational tissue staining of non-linear multimodal imaging using supervised and unsupervised deep learning

Unpaired Stain Style Transfer Using Invertible Neural Networks Based on Channel Attention and Long-Range Residual