Abstract:Histopathological visualizations are a pillar of modern medicine and biological research. Surgical oncology relies exclusively on post-operative histology to determine definitive surgical success and guide adjuvant treatments. The current histology workflow is based on bright-field microscopic assessment of histochemical stained tissues and has some major limitations. For example, the preparation of stained specimens for brightfield assessment requires lengthy sample processing, delaying interventions for days or even weeks. Therefore, there is a pressing need for improved histopathology methods. In this paper, we present a deep-learning-based approach for virtual label-free histochemical staining of total-absorption photoacoustic remote sensing (TA-PARS) images of unstained tissue. TA-PARS provides an array of directly measured label-free contrasts such as scattering and total absorption (radiative and non-radiative), ideal for developing H&E colorizations without the need to infer arbitrary tissue structures. We use a Pix2Pix generative adversarial network to develop visualizations analogous to H&E staining from label-free TA-PARS images. Thin sections of human skin tissue were first virtually stained with the TA-PARS, then were chemically stained with H&E producing a one-to-one comparison between the virtual and chemical staining. The one-to-one matched virtually- and chemically- stained images exhibit high concordance validating the digital colorization of the TA-PARS images against the gold standard H&E. TA-PARS images were reviewed by four dermatologic pathologists who confirmed they are of diagnostic quality, and that resolution, contrast, and color permitted interpretation as if they were H&E. The presented approach paves the way for the development of TA-PARS slide-free histological imaging, which promises to dramatically reduce the time from specimen resection to histological imaging.

Deep learning-based virtual histology staining using auto-fluorescence of label-free tissue

Deep Learning Virtual Colorization Overcoming Chromatic Aberrations in Singlet Lens Microscopy

Deep learning-enabled virtual histological staining of biological samples

Virtual staining of defocused autofluorescence images of unlabeled tissue using deep neural networks

Digital synthesis of histological stains using micro-structured and multiplexed virtual staining of label-free tissue

Deep Learning for Virtual Histological Staining of Bright-Field Microscopic Images of Unlabeled Carotid Artery Tissue

Label-Free Virtual HER2 Immunohistochemical Staining of Breast Tissue using Deep Learning

Deep learning-based virtual H& E staining from label-free autofluorescence lifetime images

Virtual histological staining of unlabeled autopsy tissue

Virtual stain transfer in histology via cascaded deep neural networks

Virtual Histology with Photon Absorption Remote Sensing using a Cycle-Consistent Generative Adversarial Network with Weakly Registered Pairs

Deep learning for rapid virtual H&E staining of label-free glioma tissue from hyperspectral images

Super-resolved virtual staining of label-free tissue using diffusion models

PhaseStain: Digital staining of label-free quantitative phase microscopy images using deep learning

Deep learning-based virtual staining, segmentation, and classification in label-free photoacoustic histology of human specimens

Virtual Gram staining of label-free bacteria using darkfield microscopy and deep learning

Virtual birefringence imaging and histological staining of amyloid deposits in label-free tissue using autofluorescence microscopy and deep learning

Deep learning enables ultraviolet photoacoustic microscopy based histological imaging with near real-time virtual staining

Virtual histological staining of label-free total absorption photoacoustic remote sensing (TA-PARS)

Autofluorescence Virtual Staining System for H&E Histology and Multiplex Immunofluorescence Applied to Immuno-Oncology Biomarkers in Lung Cancer

Label-free evaluation of lung and heart transplant biopsies using virtual staining