Abstract:Fluorescence microscopy plays a vital role in understanding the subcellular structures of living cells. However, it requires considerable effort in sample preparation related to chemical fixation, staining, cost, and time. To reduce those factors, we present a virtual fluorescence staining method based on deep neural networks (VirFluoNet) to transform fluorescence images of molecular labels into other molecular fluorescence labels in the same field-of-view. To achieve this goal, we develop and train a conditional generative adversarial network (cGAN) to perform digital fluorescence imaging demonstrated on human osteosarcoma U2OS cell fluorescence images captured under Cell Painting staining protocol. A detailed comparative analysis is also conducted on the performance of the cGAN network between predicting fluorescence channels based on phase contrast or based on another fluorescence channel using human breast cancer MDA-MB-231 cell line as a test case. In addition, we implement a deep learning model to perform autofocusing on another human U2OS fluorescence dataset as a preprocessing step to defocus an out-focus channel in U2OS dataset. A quantitative index of image prediction error is introduced based on signal pixel-wise spatial and intensity differences with ground truth to evaluate the performance of prediction to high-complex and throughput fluorescence. This index provides a rational way to perform image segmentation on error signals and to understand the likelihood of mis-interpreting biology from the predicted image. In total, these findings contribute to the utility of deep learning image regression for fluorescence microscopy datasets of biological cells, balanced against savings of cost, time, and experimental effort. Furthermore, the approach introduced here holds promise for modeling the internal relationships between organelles and biomolecules within living cells.

DeepLearnMOR: a Deep-Learning Framework for Fluorescence Image-Based Classification of Organelle Morphology.

Deep Learning Enhanced Fluorescence Emission Difference Microscopy

Image Enhancement For Fluorescence Microscopy Based On Deep Learning With Prior Knowledge Of Aberration

Enhancing fluorescence microscopy performance with Richardson-Lucy based deep learning

Evaluation Of Deep Learning Strategies For Nucleus Segmentation In Fluorescence Images

Deep learning-based segmentation of subcellular organelles in high-resolution phase-contrast images

Deep Mining of Subtle Differences in Cell Morphology Via Deep Learning

DeepNoise: Signal and Noise Disentanglement based on Classifying Fluorescent Microscopy Images via Deep Learning

Fluo-Fluo translation based on deep learning

Deep Learning Based Fluorescence Microscopy Imaging Technologies and Applications

Virtual organelle self-coding for fluorescence imaging via adversarial learning

Joint regression-classification deep learning framework for analyzing fluorescence lifetime images using NADH and FAD

Automated segmentation of cell organelles in volume electron microscopy using deep learning

From Organelle Morphology to Whole-Plant Phenotyping: A Phenotypic Detection Method Based on Deep Learning

Deep Learning in Fluorescence Imaging and Analysis

Generalizable Morphological Profiling of Cells by Interpretable Unsupervised Learning

Plantorganelle Hunter is an effective deep-learning-based method for plant organelle phenotyping in electron microscopy

Efficient Cell Classification of Mitochondrial Images by Using Deep Learning

High-quality Label-Free Prediction of Fluorescence Images Through Stimulated Raman Scattering Imaging and Recurrent Deep Neural Network.

Deep Learning-Enhanced Fluorescence Microscopy Via Degeneration Decoupling.

Deep Self-Learning Enables Fast, High-Fidelity Isotropic Resolution Restoration for Volumetric Fluorescence Microscopy.