Abstract:Fluorescence microscopy plays a vital role in understanding the subcellular structures of living cells. However, it requires considerable effort in sample preparation related to chemical fixation, staining, cost, and time. To reduce those factors, we present a virtual fluorescence staining method based on deep neural networks (VirFluoNet) to transform fluorescence images of molecular labels into other molecular fluorescence labels in the same field-of-view. To achieve this goal, we develop and train a conditional generative adversarial network (cGAN) to perform digital fluorescence imaging demonstrated on human osteosarcoma U2OS cell fluorescence images captured under Cell Painting staining protocol. A detailed comparative analysis is also conducted on the performance of the cGAN network between predicting fluorescence channels based on phase contrast or based on another fluorescence channel using human breast cancer MDA-MB-231 cell line as a test case. In addition, we implement a deep learning model to perform autofocusing on another human U2OS fluorescence dataset as a preprocessing step to defocus an out-focus channel in U2OS dataset. A quantitative index of image prediction error is introduced based on signal pixel-wise spatial and intensity differences with ground truth to evaluate the performance of prediction to high-complex and throughput fluorescence. This index provides a rational way to perform image segmentation on error signals and to understand the likelihood of mis-interpreting biology from the predicted image. In total, these findings contribute to the utility of deep learning image regression for fluorescence microscopy datasets of biological cells, balanced against savings of cost, time, and experimental effort. Furthermore, the approach introduced here holds promise for modeling the internal relationships between organelles and biomolecules within living cells.

Deep Learning Virtual Colorful Lens-Free On-Chip Microscopy

Deep Learning Virtual Colorization Overcoming Chromatic Aberrations in Singlet Lens Microscopy

Deep Learning Colorful Ptychographic Iterative Engine Lens-Less Diffraction Microscopy

Deep Learning Enhanced Fluorescence Emission Difference Microscopy

Deep Learning Virtual Zernike Phase Contrast Imaging for Singlet Microscopy

Deep learning-based color holographic microscopy

Multicolor localization microscopy by deep learning

Lens-Free Imaging Method Based on Generative Adversarial Networks

Deep learning for lensless imaging

Virtual Staining of Multiphoton Images Based on CycleGAN and Pix2pix

Portable Multi-Spectral Lens-Less Microscope with Wavelength-Self-calibrating Imaging Sensor

Color Lensless In-Line Holographic Microscope with Sunlight Illumination for Weakly-Scattered Amplitude Objects

Portable Deep Learning Singlet Multi-Spectral Microscope

Lensless Computational Imaging with a Hybrid Framework of Holographic Propagation and Deep Learning.

Virtual organelle self-coding for fluorescence imaging via adversarial learning

Image Enhancement in Lensless Inline Holographic Microscope by Inter-Modality Learning with Denoising Convolutional Neural Network

Virtual brightfield and fluorescence staining for Fourier ptychography via unsupervised deep learning

Computational Imaging Of Label-Free Cells Using Lens-Less Digital Holography

Deep Learning-Based Virtual Phase Contrast Imaging Method

Image Restoration and Color Fusion of Digital Microscopes.

High-throughput, high-resolution registration-free generated adversarial network microscopy