Abstract:Fluorescence microscopy plays a vital role in understanding the subcellular structures of living cells. However, it requires considerable effort in sample preparation related to chemical fixation, staining, cost, and time. To reduce those factors, we present a virtual fluorescence staining method based on deep neural networks (VirFluoNet) to transform fluorescence images of molecular labels into other molecular fluorescence labels in the same field-of-view. To achieve this goal, we develop and train a conditional generative adversarial network (cGAN) to perform digital fluorescence imaging demonstrated on human osteosarcoma U2OS cell fluorescence images captured under Cell Painting staining protocol. A detailed comparative analysis is also conducted on the performance of the cGAN network between predicting fluorescence channels based on phase contrast or based on another fluorescence channel using human breast cancer MDA-MB-231 cell line as a test case. In addition, we implement a deep learning model to perform autofocusing on another human U2OS fluorescence dataset as a preprocessing step to defocus an out-focus channel in U2OS dataset. A quantitative index of image prediction error is introduced based on signal pixel-wise spatial and intensity differences with ground truth to evaluate the performance of prediction to high-complex and throughput fluorescence. This index provides a rational way to perform image segmentation on error signals and to understand the likelihood of mis-interpreting biology from the predicted image. In total, these findings contribute to the utility of deep learning image regression for fluorescence microscopy datasets of biological cells, balanced against savings of cost, time, and experimental effort. Furthermore, the approach introduced here holds promise for modeling the internal relationships between organelles and biomolecules within living cells.

Fluo-Fluo translation based on deep learning

Deep Learning Enhanced Fluorescence Emission Difference Microscopy

Virtual organelle self-coding for fluorescence imaging via adversarial learning

Virtual Fluorescence Translation for Biological Tissue by Conditional Generative Adversarial Network

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

High-quality Label-Free Prediction of Fluorescence Images Through Stimulated Raman Scattering Imaging and Recurrent Deep Neural Network.

Enhancing fluorescence microscopy performance with Richardson-Lucy based deep learning

Deep learning enables cross-modality super-resolution in fluorescence microscopy

Global Pixel Transformers for Virtual Staining of Microscopy Images

Automatic Cell Counting in Flourescent Microscopy Using Deep Learning

Deep learning permits imaging of multiple structures with the same fluorophores

Fast imaging of 15 intracellular compartments and interactions by deep learning segmentation of super-resolution data

Deep learning-based virtual histology staining using auto-fluorescence of label-free tissue

Prediction of Maximum Absorption Wavelength Using Deep Neural Networks

In Silico Labeling: Predicting Fluorescent Labels in Unlabeled Images

Deep learning method for detecting fluorescence spots in cancer diagnostics via fluorescence in situ hybridization

Predicting fluorescent labels in label-free microscopy images with pix2pix and adaptive loss in Light My Cells challenge

Analyzing Protein Dynamics from Fluorescence Intensity Traces Using Unsupervised Deep Learning Network

Fluorescent Neuronal Cells v2: multi-task, multi-format annotations for deep learning in microscopy

Deep learning-assisted co-registration of full-spectral autofluorescence lifetime microscopic images with H&E-stained histology images

Fluorescence diffuse optical monitoring of bioreactors: a hybrid deep learning and model-based approach for tomography