Abstract:Wide-field fluorescence microscopy through axial scanning provides a simple way for volumetric imaging of cellular and intracellular activities, but the optical transfer function (OTF) of wide-field microscopy suffers from axial frequency deficiencies, leading to strong interference from out-of-focus fluorescence signals and reduced imaging quality. Richardson-Lucy (RL) deconvolution and its variants are commonly employed to reduce inter-plane signal interference of wide-field microscopy. However, these methods are still affected by the "missing cone" issue inherent in the OTF, compromising both the axial resolution and optical sectioning capability. Existing deep learning methods could realize high-fidelity 3D image stack restoration, but relying on high-quality paired datasets or specific assumptions about sample distributions. Here, we propose a novel method named physics-informed ellipsoidal coordinate encoding implicit neural representation (PIECE-INR), to tackle the challenges of background signal interference and resolution loss in axial scanning image stacks using the wide-field microscopy. In PIECE-INR, we integrate the wide-field fluorescence imaging model with the self-supervised INR network for high-fidelity reconstruction of 3D fluorescence data without the need of additional ground truth data for training. We further design a novel ellipsoidal coordinate encoding based on the system's OTF constraints and incorporate implicit priors derived from the physical model as the loss function into the reconstruction process. Our approach enables block-wise reconstruction of large-scale images by using localized physical information. We demonstrate state-of-the-art performance of our PIECE-INR method in volumetric imaging of live HeLa cells, large-volume C. elegans whole-embryo, and mitochondrial dynamics.

A Multi-resolution Adaptive Encoding Method for 3-D Reconstruction of DPO-SDF

DPO-SDF: Differentiable Physical Optics Method with Signed Distance Field for 3-D Reconstruction of Perfect Electric Conductors

A Progressive Sampling Method for 3-D Reconstruction of DPO-SDF

Differentiable Physical Optics Method for 3-D Reconstruction of Dielectric Objects

MB-DECTNet: A Model-Based Unrolled Network for Accurate 3D DECT Reconstruction

I2-SDF: Intrinsic Indoor Scene Reconstruction and Editing Via Raytracing in Neural SDFs

AniSDF: Fused-Granularity Neural Surfaces with Anisotropic Encoding for High-Fidelity 3D Reconstruction

Anti-Aliased Neural Implicit Surfaces with Encoding Level of Detail

3QFP: Efficient neural implicit surface reconstruction using Tri-Quadtrees and Fourier feature Positional encoding

2L3: Lifting Imperfect Generated 2D Images into Accurate 3D

Physics-Informed Ellipsoidal Coordinate Encoding Implicit Neural Representation for high-resolution volumetric wide-field microscopy

A Robust 3-D Reconstruction Approach Based on Correspondence Retrieval Using Deep Image Prior

GSDF: 3DGS Meets SDF for Improved Rendering and Reconstruction

DI-Fusion: Online Implicit 3D Reconstruction with Deep Priors

3D Reconstruction with Fast Dipole Sums

NeuralTO: Neural Reconstruction and View Synthesis of Translucent Objects

PermutoSDF: Fast Multi-View Reconstruction with Implicit Surfaces using Permutohedral Lattices

Efficient Implicit Neural Reconstruction Using LiDAR

Physics Constrained Unsupervised Deep Learning for Rapid, High Resolution Scanning Coherent Diffraction Reconstruction

Hybrid Iteration and Optimization-based Three-dimensional Reconstruction for Space Non-Cooperative Targets with Monocular Vision and Sparse Lidar Fusion

OmniNeRF: Hybriding Omnidirectional Distance and Radiance fields for Neural Surface Reconstruction