Abstract:Deep learning-based virtual staining was developed to introduce image contrast to label-free tissue sections, digitally matching the histological staining, which is time-consuming, labor-intensive, and destructive to tissue. Standard virtual staining requires high autofocusing precision during the whole slide imaging of label-free tissue, which consumes a significant portion of the total imaging time and can lead to tissue photodamage. Here, we introduce a fast virtual staining framework that can stain defocused autofluorescence images of unlabeled tissue, achieving equivalent performance to virtual staining of in-focus label-free images, also saving significant imaging time by lowering the microscope's autofocusing precision. This framework incorporates a virtual-autofocusing neural network to digitally refocus the defocused images and then transforms the refocused images into virtually stained images using a successive network. These cascaded networks form a collaborative inference scheme: the virtual staining model regularizes the virtual-autofocusing network through a style loss during the training. To demonstrate the efficacy of this framework, we trained and blindly tested these networks using human lung tissue. Using 4x fewer focus points with 2x lower focusing precision, we successfully transformed the coarsely-focused autofluorescence images into high-quality virtually stained H&E images, matching the standard virtual staining framework that used finely-focused autofluorescence input images. Without sacrificing the staining quality, this framework decreases the total image acquisition time needed for virtual staining of a label-free whole-slide image (WSI) by ~32%, together with a ~89% decrease in the autofocusing time, and has the potential to eliminate the laborious and costly histochemical staining process in pathology.

Virtual staining of defocused autofluorescence images of unlabeled tissue using deep neural networks

Deep Learning Virtual Colorization Overcoming Chromatic Aberrations in Singlet Lens Microscopy

Deep learning-based virtual histology staining using auto-fluorescence of label-free tissue

Deep Learning Virtual Zernike Phase Contrast Imaging for Singlet Microscopy

Digital synthesis of histological stains using micro-structured and multiplexed virtual staining of label-free tissue

Super-resolved virtual staining of label-free tissue using diffusion models

Deep learning-enabled virtual histological staining of biological samples

Rapid Whole Slide Imaging via Learning-based Two-shot Virtual Autofocusing

Virtual stain transfer in histology via cascaded deep neural networks

Virtual histological staining of unlabeled autopsy tissue

Deep Learning for Virtual Histological Staining of Bright-Field Microscopic Images of Unlabeled Carotid Artery Tissue

Autofluorescence Virtual Staining System for H&E Histology and Multiplex Immunofluorescence Applied to Immuno-Oncology Biomarkers in Lung Cancer

Deep learning for rapid virtual H&E staining of label-free glioma tissue from hyperspectral images

Label-free evaluation of lung and heart transplant biopsies using virtual staining

Deep learning-based virtual H& E staining from label-free autofluorescence lifetime images

Virtual Gram staining of label-free bacteria using darkfield microscopy and deep learning

Robust virtual staining of landmark organelles

Label-Free Virtual HER2 Immunohistochemical Staining of Breast Tissue using Deep Learning

Virtual brightfield and fluorescence staining for Fourier ptychography via unsupervised deep learning

Digital staining in optical microscopy using deep learning -- a review

Virtual birefringence imaging and histological staining of amyloid deposits in label-free tissue using autofluorescence microscopy and deep learning