Abstract:Motivation: Super-resolution fluorescence microscopy with a resolution beyond the diffraction limit of light, has become an indispensable tool to directly visualize biological structures in living cells at a nanometer-scale resolution. Despite advances in high-density super-resolution fluorescent techniques, existing methods still have bottlenecks, including extremely long execution time, artificial thinning and thickening of structures, and lack of ability to capture latent structures.Results: Here, we propose a novel deep learning guided Bayesian inference (DLBI) approach, for the time-series analysis of high-density fluorescent images. Our method combines the strength of deep learning and statistical inference, where deep learning captures the underlying distribution of the fluorophores that are consistent with the observed time-series fluorescent images by exploring local features and correlation along time-axis, and statistical inference further refines the ultrastructure extracted by deep learning and endues physical meaning to the final image. In particular, our method contains three main components. The first one is a simulator that takes a high-resolution image as the input, and simulates time-series low-resolution fluorescent images based on experimentally calibrated parameters, which provides supervised training data to the deep learning model. The second one is a multi-scale deep learning module to capture both spatial information in each input low-resolution image as well as temporal information among the time-series images. And the third one is a Bayesian inference module that takes the image from the deep learning module as the initial localization of fluorophores and removes artifacts by statistical inference. Comprehensive experimental results on both real and simulated datasets demonstrate that our method provides more accurate and realistic local patch and large-field reconstruction than the state-of-the-art method, the 3B analysis, while our method is more than two orders of magnitude faster.Availability and implementation: The main program is available at https://github.com/lykaust15/DLBI.Supplementary information: Supplementary data are available at Bioinformatics online.

DLBI: deep learning guided Bayesian inference for structure reconstruction of super-resolution fluorescence microscopy

Deep Learning Enhanced Fluorescence Emission Difference Microscopy

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

Deep learning permits imaging of multiple structures with the same fluorophores

Rationalized deep learning super-resolution microscopy for sustained live imaging of rapid subcellular processes

Super-resolution reconstruction of structured illumination microscopy using deep-learning and sparse deconvolution

Rapid and Extreme Low-light Superresolution Imaging Via Artificial Intelligence

DBlink: dynamic localization microscopy in super spatiotemporal resolution via deep learning

Deep Learning for Super-Resolution Localization Microscopy

A Hybrid Reconstruction of the Physical Model with the Deep-Learning That Improves Structured Illumination Microscopy

Single-frame deep-learning super-resolution microscopy for intracellular dynamics imaging

Deep Learning in Fluorescence Imaging and Analysis

Deep learning-based spectroscopic single-molecule localization microscopy

Deep Learning Enables Confocal Laser-Scanning Microscopy with Enhanced Resolution

Bayesian Localization Microscopy Based on Intensity Distribution of Fluorophores.

Structured Illumination Microscopy with Uncertainty Quantification

Deep learning-based super-resolution fluorescence microscopy on small datasets

Deep Learning-Enhanced Fluorescence Microscopy Via Degeneration Decoupling.

Reconstructing 3D Biomedical Architectural Order at Multiple Spatial Scales with Multimodal Stack Input

AI-based analysis of super-resolution microscopy: Biological discovery in the absence of ground truth

Super Resolution Reconstruction of Fluorescence Microscopy Images by a Convolutional Network with Physical Priors.