Abstract:Super-resolution localization microscopy techniques (e.g., STORM or PALM), breaks the optics diffraction limit, making possible the observation of sub-cellular structures in vivo. However, long acquisition time is required to maintain a desired high spatial resolution. To overcome the limitation, an effective method is to increase the density of activated emitters in each frame. The high-density emitters will cause them to overlap, which makes it difficult to accurately resolve each emitter location. Although some methods have been proposed to identify the overlapped emitters, these methods are computationally intensive and parameter dependent. To address these problems, in this paper, we proposed a novel method based on convolutional neural networks (CNN) for super-resolution localization microscopy, termed as DL-SRLM. DL-SRLM is capable of learning the nonlinear mapping between a camera frame (i.e., the experimentally acquired low-resolution image) and the true locations of emitters in the corresponding image region (i.e., the recovered super-resolution image). As a result, the method provides the possibility to faster resolve the high-density emitters, without requiring the parameters. To evaluate the performance of DL-SRLM, a series of simulations with varying emitter densities, signal-to-noise ratios (SNRs), and point spread functions (PSFs) were performed. The results show that DL-SRLM can accurately resolve the locations of high-density emitters, even if when the raw measurement data contained noise or was generated by using inaccurate PSF. In addition, DL-SRLM greatly improve the computational speed (~ 15 ms/frame) compared with the current methods while avoiding the effect of the parameters on the super-resolution imaging performance.

Deep Learning for Super-Resolution Localization Microscopy

Ultra-fast, Universal Super-Resolution Radial Fluctuations (SRRF) Algorithm for Live-Cell Super-Resolution Microscopy.

Deep Learning Enhanced Fluorescence Emission Difference Microscopy

Deep Learning Massively Accelerates Super-Resolution Localization Microscopy

Super-resolution Localization Microscopy with Large Field-of-view for Mapping Synaptic Connectivity at Multiple Scales (conference Presentation)

Rapid and Extreme Low-light Superresolution Imaging Via Artificial Intelligence

Deep learning using a residual deconvolutional network enables real-time high-density single-molecule localization microscopy

Super-resolution reconstruction of structured illumination microscopy using deep-learning and sparse deconvolution

Super-resolution Single-Molecule Microscopic Reconstruction Based on Improved Deep-Storm

Single-frame deep-learning super-resolution microscopy for intracellular dynamics imaging

Evaluation and development of deep neural networks for image super-resolution in optical microscopy

Deep learning for fast super-resolution ultrasound microvessel imaging

DeepSTORM3D: dense 3D localization microscopy and PSF design by deep learning

Rationalized deep learning super-resolution microscopy for sustained live imaging of rapid subcellular processes

Untrained Neural Network Enabling Fast and Universal Structured-Illumination Microscopy

Self-STORM: Deep Unrolled Self-Supervised Learning for Super-Resolution Microscopy

High-axial-resolution Single-Molecule Localization under Dense Excitation with a Multi-Channel Deep U-Net.

Localization of Ultra-dense Emitters with Neural Networks

ULM-MbCNRT: In vivo Ultrafast Ultrasound Localization Microscopy by Combining Multi-branch CNN and Recursive Transformer

Deep-learning accelerated super-resolution radial fluctuations (SRRF) enables real-time live cell imaging

Divide and Conquer: Real-time Maximum Likelihood Fitting of Multiple Emitters for Super-Resolution Localization Microscopy