Abstract:Supreresolution (SR) fluorescence microscopy breaks the optical diffraction limit and achieves unprecedented nanoscale resolution, thus producing a huge impact on biological research. Structured illumination microscopy (SIM) is one of the most broadly used SR techniques. SIM applies varying, nonuniform illumination to samples. A dedicated computational algorithm is then used to retrieve SR information from nine or fifteen sequentially acquired images, for 2D or 2D/3D reconstruction respectively. Super-resolution radial fluctuation (SRRF) is a purely computational SR approach, that can retrieve high frequency information by spatio-temporally analyzing the stochastically fluctuating signals from image time series (typically >200 frames). We utilized deep neural networks to directly reconstruct super-resolved images out of a series of images taken with either structured or conventional wide-field illumination microscopy. This substantially reduced the number of images compared to state-of-the-art methods (as few as 3 images for SIM and 5 images for SRRF). Further, leveraging skip-layer connected U-Nets, we could restore high quality, high-resolution images from raw data with over 100 times less photons. We validated our results for different cellular structures, including microtubules, mitochondria, adhesions and actin filaments. We demonstrated its applications in ultra-fast, multi-color superresolution imaging of living cells. A ready-to-use open source package is available.

Super-resolution reconstruction of structured illumination microscopy using deep-learning and sparse deconvolution

Untrained Neural Network Enabling Fast and Universal Structured-Illumination Microscopy

Structured Illumination Microscopy with Modified Joint Richardson-Lucy Deconvolution

Fast reconstruction algorithm for structured illumination microscopy.

Single-frame Structured Illumination Microscopy for Fast Live-Cell Imaging

Regularized Deconvolution for Structured Illumination Microscopy Via Accelerated Linearized ADMM

Real-time reconstruction using electro-optics modulator-based structured illumination microscopy

Three-dimensional super-resolution imaging of live whole cells using structured illumination microscopy

3D Super-Resolution Microscopy Based on Nonlinear Gradient Descent Structured Illumination.

Super-Resolution Structured Illumination Microscopy Reconstruction Using a Least-Squares Solver

Adaptive Optics For Structured Illumination Microscopy Based On Deep Learning

A cascaded deep network for reconstruction of structured illumination microscopy

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

Surpassing the resolution limitation of structured illumination microscopy by an untrained neural network

Deep learning enables structured illumination microscopy with low light levels and enhanced speed

Evaluation and development of deep neural networks for image super-resolution in optical microscopy

Deep learning enables contrast-robust super-resolution reconstruction in structured illumination microscopy

Fast and Lightweight Network for Single Frame Structured Illumination Microscopy Super-Resolution

Rapid and Extreme Low-light Superresolution Imaging Via Artificial Intelligence

Deep‐MSIM: Fast Image Reconstruction with Deep Learning in Multifocal Structured Illumination Microscopy