Abstract:Wide-field fluorescence microscopy through axial scanning provides a simple way for volumetric imaging of cellular and intracellular activities, but the optical transfer function (OTF) of wide-field microscopy suffers from axial frequency deficiencies, leading to strong interference from out-of-focus fluorescence signals and reduced imaging quality. Richardson-Lucy (RL) deconvolution and its variants are commonly employed to reduce inter-plane signal interference of wide-field microscopy. However, these methods are still affected by the "missing cone" issue inherent in the OTF, compromising both the axial resolution and optical sectioning capability. Existing deep learning methods could realize high-fidelity 3D image stack restoration, but relying on high-quality paired datasets or specific assumptions about sample distributions. Here, we propose a novel method named physics-informed ellipsoidal coordinate encoding implicit neural representation (PIECE-INR), to tackle the challenges of background signal interference and resolution loss in axial scanning image stacks using the wide-field microscopy. In PIECE-INR, we integrate the wide-field fluorescence imaging model with the self-supervised INR network for high-fidelity reconstruction of 3D fluorescence data without the need of additional ground truth data for training. We further design a novel ellipsoidal coordinate encoding based on the system's OTF constraints and incorporate implicit priors derived from the physical model as the loss function into the reconstruction process. Our approach enables block-wise reconstruction of large-scale images by using localized physical information. We demonstrate state-of-the-art performance of our PIECE-INR method in volumetric imaging of live HeLa cells, large-volume C. elegans whole-embryo, and mitochondrial dynamics.

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

Untrained Neural Network Enabling Fast and Universal Structured-Illumination Microscopy

Deep Learning Enhanced Fluorescence Emission Difference Microscopy

Super Resolution Reconstruction of Fluorescence Microscopy Images by a Convolutional Network with Physical Priors.

Wide-Field, High-Resolution Reconstruction in Computational Multi-Aperture Miniscope Using a Fourier Neural Network

Rapid and Extreme Low-light Superresolution Imaging Via Artificial Intelligence

Real-Time Resolution Enhancement of Confocal Laser Scanning Microscopy via Deep Learning

Zero-shot learning enables instant denoising and super-resolution in optical fluorescence microscopy

Super-resolution reconstruction of structured illumination microscopy using deep-learning and sparse deconvolution

Robust single-shot 3D fluorescence imaging in scattering media with a simulator-trained neural network

Overcoming photon and spatiotemporal sparsity in fluorescence lifetime imaging with SparseFLIM

High-Throughput Deep Learning Microscopy Using Multi-Angle Super-Resolution

Deep-learning-augmented Microscopy for Super-Resolution Imaging of Nanoparticles.

Single-frame deep-learning super-resolution microscopy for intracellular dynamics imaging

Deep Self-Learning Enables Fast, High-Fidelity Isotropic Resolution Restoration for Volumetric Fluorescence Microscopy.

Physics-Informed Ellipsoidal Coordinate Encoding Implicit Neural Representation for high-resolution volumetric wide-field microscopy

Evaluation and development of deep neural networks for image super-resolution in optical microscopy

Deep learning enables cross-modality super-resolution in fluorescence microscopy

A Physics-Inspired Deep Learning Framework for an Efficient Fourier Ptychographic Microscopy Reconstruction under Low Overlap Conditions

Extending resolution of structured illumination microscopy with sparse deconvolution