Abstract:Motivation: Super-resolution fluorescence microscopy with a resolution beyond the diffraction limit of light, has become an indispensable tool to directly visualize biological structures in living cells at a nanometer-scale resolution. Despite advances in high-density super-resolution fluorescent techniques, existing methods still have bottlenecks, including extremely long execution time, artificial thinning and thickening of structures, and lack of ability to capture latent structures.Results: Here, we propose a novel deep learning guided Bayesian inference (DLBI) approach, for the time-series analysis of high-density fluorescent images. Our method combines the strength of deep learning and statistical inference, where deep learning captures the underlying distribution of the fluorophores that are consistent with the observed time-series fluorescent images by exploring local features and correlation along time-axis, and statistical inference further refines the ultrastructure extracted by deep learning and endues physical meaning to the final image. In particular, our method contains three main components. The first one is a simulator that takes a high-resolution image as the input, and simulates time-series low-resolution fluorescent images based on experimentally calibrated parameters, which provides supervised training data to the deep learning model. The second one is a multi-scale deep learning module to capture both spatial information in each input low-resolution image as well as temporal information among the time-series images. And the third one is a Bayesian inference module that takes the image from the deep learning module as the initial localization of fluorophores and removes artifacts by statistical inference. Comprehensive experimental results on both real and simulated datasets demonstrate that our method provides more accurate and realistic local patch and large-field reconstruction than the state-of-the-art method, the 3B analysis, while our method is more than two orders of magnitude faster.Availability and implementation: The main program is available at https://github.com/lykaust15/DLBI.Supplementary information: Supplementary data are available at Bioinformatics online.

A Transfer Learning Based Super-Resolution Microscopy for Biopsy Slice Images: The Joint Methods Perspective

Wavefront Reconstruction Based on Deep Transfer Learning for Microscopy.

RECONSTRUCTION OF HIGH-RESOLUTION HEPATIC TUMOR CT IMAGES USING AN AUGMENTATION-BASED SUPER-RESOLUTION TECHNIQUE

Resolution Enhancement and Background Suppression in Optical Super‐Resolution Imaging for Biological Applications

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

Iterative-in-Iterative Super-Resolution Biomedical Imaging Using One Real Image

RIRGAN: an End-to-end Lightweight Multi-Task Learning Method for Brain MRI Super-Resolution and Denoising

Evaluation and development of deep neural networks for image super-resolution in optical microscopy

Super-resolution and segmentation deep learning for breast cancer histopathology image analysis

Super-resolution of biomedical volumes with 2D supervision

Towards Arbitrary-Scale Histopathology Image Super-resolution: An Efficient Dual-branch Framework via Implicit Self-texture Enhancement

X-Microscopy: Multicolor Super Resolution Image Reconstruction from Conventional Microscopy with Deep Learning

Deep Learning for Super-resolution Ultrasound Imaging with Spatiotemporal Data

A super-resolution strategy for mass spectrometry imaging via transfer learning

Joint Image Reconstruction and Super-Resolution for Accelerated Magnetic Resonance Imaging

Inter-slice Super-resolution of Magnetic Resonance Images by Pre-training and Self-supervised Fine-tuning

DLBI: deep learning guided Bayesian inference for structure reconstruction of super-resolution fluorescence microscopy

Super-resolution reconstruction of structured illumination microscopy using deep-learning and sparse deconvolution

Super-resolution reconstruction for early cervical cancer magnetic resonance imaging based on deep learning

Transfer Learning for Automatic Joint Segmentation of Thyroid and Breast Lesions from Ultrasound Images.

Super resolution of histopathological frozen sections via deep learning preserving tissue structure