Abstract:Deep learning has transformed computational imaging, but traditional pixel-based representations limit their ability to capture continuous, multiscale details of objects. Here we introduce a novel Local Conditional Neural Fields (LCNF) framework, leveraging a continuous implicit neural representation to address this limitation. LCNF enables flexible object representation and facilitates the reconstruction of multiscale information. We demonstrate the capabilities of LCNF in solving the highly ill-posed inverse problem in Fourier ptychographic microscopy (FPM) with multiplexed measurements, achieving robust, scalable, and generalizable large-scale phase retrieval. Unlike traditional neural fields frameworks, LCNF incorporates a local conditional representation that promotes model generalization, learning multiscale information, and efficient processing of large-scale imaging data. By combining an encoder and a decoder conditioned on a learned latent vector, LCNF achieves versatile continuous-domain super-resolution image reconstruction. We demonstrate accurate reconstruction of wide field-of-view, high-resolution phase images using only a few multiplexed measurements. LCNF robustly captures the continuous object priors and eliminates various phase artifacts, even when it is trained on imperfect datasets. The framework exhibits strong generalization, reconstructing diverse objects even with limited training data. Furthermore, LCNF can be trained on a physics simulator using natural images and successfully applied to experimental measurements on biological samples. Our results highlight the potential of LCNF for solving large-scale inverse problems in computational imaging, with broad applicability in various deep-learning-based techniques.

Real-Valued Network for Imaging Through Multimode Fiber

Untrained Neural Network Enabling Fast and Universal Structured-Illumination Microscopy

Color Router-based Long-wave Infrared Multispectral Imaging

Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

The Integration of Neural Network and Physical Reconstruction Model for Fourier Ptychographic Microscopy

Spatially Variant Deblur and Image Enhancement in a Single Multimode Fiber Imaged by Deep Learning

Imaging through a multimode optical fiber with principal component analysis and a variational autoencoder

Learning to transmit images through optical speckle of a multimode fiber with high fidelity

Single-ended Recovery of Optical fiber Transmission Matrices using Neural Networks

Neural Network-Based Multimode Fiber Imaging and Characterization Under Thermal Perturbations

Multimode optical fiber transmission with a deep learning network

An Implementation of Complex-Valued Matrix-Vector Multiplication Based on MZI Array for Photonic Neural Networks

Single-shot enhanced imaging through multimode fiber based on self-learning networks

Seeing through multimode fibers with real-valued intensity transmission matrices

Reconstructing Images Through Multimode Fibers From the Up-Conversion Speckle Patterns via Deep Learning

Ghost Imaging by Single-Layer Neural Network Based on Forward Physical Model

Fiber neural networks for the intelligent optical fiber communications

Axial super-resolution optical coherence tomography via complex-valued network

Multimode fiber image reconstruction based on parallel neural network with small training set under wide temperature variations

Local Conditional Neural Fields for Versatile and Generalizable Large-Scale Reconstructions in Computational Imaging

Non-line-of-Sight Imaging via Neural Transient Fields