Abstract:Deep learning has transformed computational imaging, but traditional pixel-based representations limit their ability to capture continuous, multiscale details of objects. Here we introduce a novel Local Conditional Neural Fields (LCNF) framework, leveraging a continuous implicit neural representation to address this limitation. LCNF enables flexible object representation and facilitates the reconstruction of multiscale information. We demonstrate the capabilities of LCNF in solving the highly ill-posed inverse problem in Fourier ptychographic microscopy (FPM) with multiplexed measurements, achieving robust, scalable, and generalizable large-scale phase retrieval. Unlike traditional neural fields frameworks, LCNF incorporates a local conditional representation that promotes model generalization, learning multiscale information, and efficient processing of large-scale imaging data. By combining an encoder and a decoder conditioned on a learned latent vector, LCNF achieves versatile continuous-domain super-resolution image reconstruction. We demonstrate accurate reconstruction of wide field-of-view, high-resolution phase images using only a few multiplexed measurements. LCNF robustly captures the continuous object priors and eliminates various phase artifacts, even when it is trained on imperfect datasets. The framework exhibits strong generalization, reconstructing diverse objects even with limited training data. Furthermore, LCNF can be trained on a physics simulator using natural images and successfully applied to experimental measurements on biological samples. Our results highlight the potential of LCNF for solving large-scale inverse problems in computational imaging, with broad applicability in various deep-learning-based techniques.

Space-time reconstruction for lensless imaging using implicit neural representations

Three Dimensional Reconstruction Using a Lenslet Light Field Camera

Image Reconstruction for Lensless Imaging Using a Phase Congruency Perception Model

3D reconstruction from focus for lensless imaging

All-day Thin-Lens Computational Imaging with Scene-Specific Learning Recovery

Towards Lensless Image Deblurring with Prior-Embedded Implicit Neural Representations in the Low-Data Regime

Lensless cameras using a mask based on almost perfect sequence through deep learning

FlatNet: Towards Photorealistic Scene Reconstruction from Lensless Measurements

Subspace Model-Assisted Deep Learning for Improved Image Reconstruction.

Inverting the Imaging Process by Learning an Implicit Camera Model

Learned reconstructions for practical mask-based lensless imaging

Intelligent Phase Imaging Guided by Physics Models

Learning the invisible: a hybrid deep learning-shearlet framework for limited angle computed tomography

Spatiotemporal implicit neural representation for unsupervised dynamic MRI reconstruction

Physics to the Rescue: Deep Non-line-of-sight Reconstruction for High-speed Imaging

PhoCoLens: Photorealistic and Consistent Reconstruction in Lensless Imaging

Explicit-restriction Convolutional Framework for Lensless Imaging

Single-shot Lensless Imaging with Fresnel Zone Aperture and Incoherent Illumination.

Local Conditional Neural Fields for Versatile and Generalizable Large-Scale Reconstructions in Computational Imaging

Non-line-of-Sight Imaging via Neural Transient Fields

Single View Refractive Index Tomography with Neural Fields