Abstract:Motivation: Super-resolution fluorescence microscopy with a resolution beyond the diffraction limit of light, has become an indispensable tool to directly visualize biological structures in living cells at a nanometer-scale resolution. Despite advances in high-density super-resolution fluorescent techniques, existing methods still have bottlenecks, including extremely long execution time, artificial thinning and thickening of structures, and lack of ability to capture latent structures.Results: Here, we propose a novel deep learning guided Bayesian inference (DLBI) approach, for the time-series analysis of high-density fluorescent images. Our method combines the strength of deep learning and statistical inference, where deep learning captures the underlying distribution of the fluorophores that are consistent with the observed time-series fluorescent images by exploring local features and correlation along time-axis, and statistical inference further refines the ultrastructure extracted by deep learning and endues physical meaning to the final image. In particular, our method contains three main components. The first one is a simulator that takes a high-resolution image as the input, and simulates time-series low-resolution fluorescent images based on experimentally calibrated parameters, which provides supervised training data to the deep learning model. The second one is a multi-scale deep learning module to capture both spatial information in each input low-resolution image as well as temporal information among the time-series images. And the third one is a Bayesian inference module that takes the image from the deep learning module as the initial localization of fluorophores and removes artifacts by statistical inference. Comprehensive experimental results on both real and simulated datasets demonstrate that our method provides more accurate and realistic local patch and large-field reconstruction than the state-of-the-art method, the 3B analysis, while our method is more than two orders of magnitude faster.Availability and implementation: The main program is available at https://github.com/lykaust15/DLBI.Supplementary information: Supplementary data are available at Bioinformatics online.

A Hybrid Reconstruction of the Physical Model with the Deep-Learning That Improves Structured Illumination Microscopy

Deep Learning Enhanced Fluorescence Emission Difference Microscopy

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

Adaptive Optics For Structured Illumination Microscopy Based On Deep Learning

Wavefront Reconstruction Based on Deep Transfer Learning for Microscopy.

Hybrid deep learning and physics-based neural network for programmable illumination computational microscopy

Incorporating the Image Formation Process into Deep Learning Improves Network Performance

Super-resolution reconstruction of structured illumination microscopy using deep-learning and sparse deconvolution

Deep learning-enhanced fluorescence microscopy via confocal physical imaging model.

Deep learning enables contrast-robust super-resolution reconstruction in structured illumination microscopy

Deep‐MSIM: Fast Image Reconstruction with Deep Learning in Multifocal Structured Illumination Microscopy (Adv. Sci. 27/2023)

Reconstructing 3D Biomedical Architectural Order at Multiple Spatial Scales with Multimodal Stack Input

Deep Learning-Enhanced Fluorescence Microscopy Via Degeneration Decoupling.

Evaluation and development of deep neural networks for image super-resolution in optical microscopy

Rationalized deep learning super-resolution microscopy for sustained live imaging of rapid subcellular processes

Simulation-driven Learning: a Deep Learning Approach for Image Scanning Microscopy Via Physical Imaging Models

Deep-Learning-Based Image Reconstruction and Enhancement in Optical Microscopy

DLBI: deep learning guided Bayesian inference for structure reconstruction of super-resolution fluorescence microscopy

Physical prior-guided deep learning for SIM reconstruction: modeling object-to-image degradation

Deep‐MSIM: Fast Image Reconstruction with Deep Learning in Multifocal Structured Illumination Microscopy

Deep Learning Enables Confocal Laser-Scanning Microscopy with Enhanced Resolution