Abstract:Multiplex brightfield imaging offers the advantage of simultaneously analyzing multiple biomarkers on a single slide, as opposed to single biomarker labeling on multiple consecutive slides. To accurately analyze multiple biomarkers localized at the same cellular compartment, two representative biomarker sets were selected as assay models - cMET-PDL1-EGFR and CD8-LAG3-PDL1, where all three biomarkers can co-localize on the cell membrane. One of the most crucial preliminary stages for analyzing such assay is identifying each unique chromogen on individual cells. This is a challenging problem due to the co-localization of membrane stains from all the three biomarkers. It requires advanced color unmixing for creating the equivalent singleplex images from each triplex image for each biomarker. In this project, we developed a cycle-Generative Adversarial Network (cycle-GAN) method for unmixing the triplex images generated from the above-mentioned assays. Three different models were designed to generate the singleplex image for each of the three stains Tamra (purple), QM-Dabsyl (yellow) and Green. A notable novelty of our approach was that the input to the network were images in the optical density domain instead of conventionally used RGB images. The use of the optical density domain helped in reducing the blurriness of the synthetic singleplex images, which was often observed when the network was trained on RGB images. The cycle-GAN models were validated on 10,800 lung, gastric and colon images for the cMET-PDL1-EGFR assay and 3600 colon images for the CD8-LAG3-PDL1 assay. Visual as well as quantified assessments demonstrated that the proposed method is effective and efficient when compared with the manual reviewing results and is readily applicable to various multiplex assays.

Generating Bright-Field Images of Stained Tissue Slices from Mueller Matrix Polarimetric Images with CycleGAN Using Unpaired Dataset

Stain transformation using Mueller matrix guided generative adversarial networks

Deep-learning-based cross-modality translation from Stokes image to bright-field contrast

Computational immunohistochemistry staining on lung tissues based on Mueller matrix microscopy

Using machine learning for chemical-free histological tissue staining

Unpaired Stain Transfer Using Pathology-Consistent Constrained Generative Adversarial Networks

Virtual Staining of Multiphoton Images Based on CycleGAN and Pix2pix

Distinguishing tissue structures via polarization staining images based on different combinations of Mueller matrix polar decomposition parameters

Automatic Generation of Pathological Benchmark Dataset from Hyperspectral Images of Double Stained Tissues

A Novel Generative Artificial Intelligence Method for Interference Study on Multiplex Brightfield Immunohistochemistry Images

Computational tissue staining of non-linear multimodal imaging using supervised and unsupervised deep learning

Multi-domain stain normalization for digital pathology: A cycle-consistent adversarial network for whole slide images

CytoGAN: Unpaired staining transfer by structure preservation for cytopathology image analysis

Deep Learning-Based Polarization Feature Retrieval from a Single Stokes Vector

Computational image translation from Mueller matrix polarimetry to bright‐field microscopy

TC-CycleGAN: Improved CycleGAN with Texture Constraints for Virtual Staining of Pathological Images.

Effective Immunohistochemistry Pathology Microscopy Image Generation Using CycleGAN

Generative Image Translation for Data Augmentation in Colorectal Histopathology Images

GAN-based Virtual Re-Staining: A Promising Solution for Whole Slide Image Analysis

Mapping microstructural features of pathological tissues by pixel clustering of Mueller matrix images

Computational Histological Staining and Destaining of Prostate Core Biopsy RGB Images with Generative Adversarial Neural Networks