Abstract:Live-cell imaging has opened an exciting window into the role cellular heterogeneity plays in dynamic, living systems. A major critical challenge for this class of experiments is the problem of image segmentation, or determining which parts of a microscope image correspond to which individual cells. Current approaches require many hours of manual curation and depend on approaches that are difficult to share between labs. They are also unable to robustly segment the cytoplasms of mammalian cells. Here, we show that deep convolutional neural networks, a supervised machine learning method, can solve this challenge for multiple cell types across the domains of life. We demonstrate that this approach can robustly segment fluorescent images of cell nuclei as well as phase images of the cytoplasms of individual bacterial and mammalian cells from phase contrast images without the need for a fluorescent cytoplasmic marker. These networks also enable the simultaneous segmentation and identification of different mammalian cell types grown in co-culture. A quantitative comparison with prior methods demonstrates that convolutional neural networks have improved accuracy and lead to a significant reduction in curation time. We relay our experience in designing and optimizing deep convolutional neural networks for this task and outline several design rules that we found led to robust performance. We conclude that deep convolutional neural networks are an accurate method that require less curation time, are generalizable to a multiplicity of cell types, from bacteria to mammalian cells, and expand live-cell imaging capabilities to include multi-cell type systems.

Fast, live-cell imaging of 15 intracellular compartments by deep learning segmentation of super-resolution data

Fast imaging of 15 intracellular compartments and interactions by deep learning segmentation of super-resolution data

Single-frame Structured Illumination Microscopy for Fast Live-Cell Imaging

Dynamic live-cell super-resolution imaging with parallelized fluorescence emission difference microscopy

Deep Learning Enhanced Fluorescence Emission Difference Microscopy

Deep learning permits imaging of multiple structures with the same fluorophores

Field-dependent deep learning enables high-throughput whole-cell 3D super-resolution imaging

Single-frame deep-learning super-resolution microscopy for intracellular dynamics imaging

Enhancing fluorescence microscopy performance with Richardson-Lucy based deep learning

Deep Learning Facilitated Whole Live Cell Fast Super-Resolution Imaging

Rapid and Extreme Low-light Superresolution Imaging Via Artificial Intelligence

Deep-learning accelerated super-resolution radial fluctuations (SRRF) enables real-time live cell imaging

Fast 3D cell tracking with wide-field fluorescence microscopy through deep learning

Video-rate 3D imaging of living cells using Fourier view-channel-depth light field microscopy

Zero-shot learning enables instant denoising and super-resolution in optical fluorescence microscopy

Deep Learning Automates the Quantitative Analysis of Individual Cells in Live-Cell Imaging Experiments

Multi-color 4D Superresolution Light-Sheet Microscopy Reveals Organelle Interactions at Isotropic 100-Nm Resolution and Sub-Second Timescales

Deep learning enables cross-modality super-resolution in fluorescence microscopy

High-speed Super-Multiplex Organelle Imaging

X-Microscopy: Multicolor Super Resolution Image Reconstruction from Conventional Microscopy with Deep Learning

Rationalized deep learning super-resolution microscopy for sustained live imaging of rapid subcellular processes