Abstract:Despite the grand advances in fluorescence microscopy, the photon budget of fluorescent molecules remains the fundamental limiting factor for major imaging parameters, such as temporal resolution, duration, contrast, and even spatial resolution. Computational methods can strategically utilize the fluorescence photons against the imaging noise, to break the abovementioned limits. Here, we propose a multi-resolution analysis (MRA) approach to recharacterize and extract the two main characteristics of fluorescence images: (1) high contrast across the edge, and (2) high continuity along the edge. By regularizing the solution using framelet and curvelet domain sparsity, we develop MRA deconvolution algorithm for fluorescence image, which allows fine detail recovery even with negative signal-to-noise-ratio (SNR), and can provide more than 2-fold physical resolution enhancement with conspicuously fewer artifacts than maximum likelihood estimation (MLE) methods. Furthermore, we develop DeepMRA deconvolution algorithm that can provide computational background inhibition through a bias thresholding mechanism while deconvolving a fluorescence image. Compared with conventional background mitigation schemes, this novel deconvolution canonical form can deal with severer background and better preserve the high-frequency and low-intensity details, which are commonly disrupted by other algorithms. We demonstrate that the MRA and DeepMRA deconvolution algorithms can improve the SNR and resolution of biological images in various microscopies, such as wide-field, confocal, spinning-disk confocal (SD-confocal), light-sheet, structured illumination microscopy (SIM), and stimulated excitation depletion (STED) microscopy.

Noise-robust phase-space deconvolution for light-field microscopy

In Vivo Light-Field Encoded Nano-Imaging in a Narrow Space

Extended Depth of Field Reconstruction with Complex Field Estimation

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

Design of a light field microscope with uniform spatial resolution across an extended 3D volume

Real-time volumetric reconstruction of biological dynamics with light-field microscopy and deep learning

Spatial-temporal Low-Rank Prior for Low-Light Volumetric Fluorescence Imaging

Artifact-free 3D Deconvolution for Light Field Microscopy

Computational Optical Sectioning with an Incoherent Multiscale Scattering Model for Light-Field Microscopy.

High-resolution 3D light-field imaging

Virtual-scanning light-field microscopy for robust snapshot high-resolution volumetric imaging

Fast light-field 3D microscopy with out-of-distribution detection and adaptation through Conditional Normalizing Flows

Rapid Image Deconvolution and Multiview Fusion for Optical Microscopy.

Multi-focus Light-Field Microscopy for High-Speed Large-Volume Imaging

Wide-Field, High-Resolution Reconstruction in Computational Multi-Aperture Miniscope Using a Fourier Neural Network

Improving signal-to-background ratio by orders of magnitude in high-speed volumetric imaging in vivo by robust Fourier light field microscopy

Noise-robust, Physical Genuine Deconvolution Algorithm for Fluorescence Microscopy Enabled by Multi-Resolution Analysis

Phase Guided Light Field for Spatial-Depth High Resolution 3D Imaging

Noise-robust, physical microscopic deconvolution algorithm enabled by multi-resolution analysis regularization

Compact, Hybrid Light-Sheet and Fourier Light-Field Microscopy with a Single Objective for High-Speed Volumetric Imaging in Vivo

Robust Depth Estimation for Light Field Microscopy