Abstract:Supreresolution (SR) fluorescence microscopy breaks the optical diffraction limit and achieves unprecedented nanoscale resolution, thus producing a huge impact on biological research. Structured illumination microscopy (SIM) is one of the most broadly used SR techniques. SIM applies varying, nonuniform illumination to samples. A dedicated computational algorithm is then used to retrieve SR information from nine or fifteen sequentially acquired images, for 2D or 2D/3D reconstruction respectively. Super-resolution radial fluctuation (SRRF) is a purely computational SR approach, that can retrieve high frequency information by spatio-temporally analyzing the stochastically fluctuating signals from image time series (typically >200 frames). We utilized deep neural networks to directly reconstruct super-resolved images out of a series of images taken with either structured or conventional wide-field illumination microscopy. This substantially reduced the number of images compared to state-of-the-art methods (as few as 3 images for SIM and 5 images for SRRF). Further, leveraging skip-layer connected U-Nets, we could restore high quality, high-resolution images from raw data with over 100 times less photons. We validated our results for different cellular structures, including microtubules, mitochondria, adhesions and actin filaments. We demonstrated its applications in ultra-fast, multi-color superresolution imaging of living cells. A ready-to-use open source package is available.

Rapid and Extreme Low-light Superresolution Imaging Via Artificial Intelligence

Ultra-fast, Universal Super-Resolution Radial Fluctuations (SRRF) Algorithm for Live-Cell Super-Resolution Microscopy.

Single-frame Structured Illumination Microscopy for Fast Live-Cell Imaging

Untrained Neural Network Enabling Fast and Universal Structured-Illumination Microscopy

Simultaneous Two-Angle Axial Ratiometry for Fast Live and Long-Term Axial Super-Resolution Fluorescence Imaging

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

Deep-learning accelerated super-resolution radial fluctuations (SRRF) enables real-time live cell imaging

Super-Resolution Structured Illumination Microscopy Reconstruction Using a Least-Squares Solver

Rapid, artifact-reduced, image reconstruction for super-resolution structured illumination microscopy

Rapid Image Deconvolution and Multiview Fusion for Optical Microscopy.

Super-resolution reconstruction of structured illumination microscopy using deep-learning and sparse deconvolution

Single-frame deep-learning super-resolution microscopy for intracellular dynamics imaging

Fast Long-Term Super-Resolution Imaging with Hessian Structured Illumination Microscopy

High-speed Image Reconstruction for Optically Sectioned, Super-Resolution Structured Illumination Microscopy

Evaluation and development of deep neural networks for image super-resolution in optical microscopy

Rationalized deep learning super-resolution microscopy for sustained live imaging of rapid subcellular processes

Fast and Lightweight Network for Single Frame Structured Illumination Microscopy Super-Resolution

X-Microscopy: Multicolor Super Resolution Image Reconstruction from Conventional Microscopy with Deep Learning

Augmented Super-Resolution Radial Fluctuations (aSRRF) Pushing the Limits of Structured Illumination Microscopy.

Structured Illumination Microscopy with Interleaved Reconstruction (SIMILR)

Deep learning enables structured illumination microscopy with low light levels and enhanced speed