Abstract:Deep learning has transformed computational imaging, but traditional pixel-based representations limit their ability to capture continuous, multiscale details of objects. Here we introduce a novel Local Conditional Neural Fields (LCNF) framework, leveraging a continuous implicit neural representation to address this limitation. LCNF enables flexible object representation and facilitates the reconstruction of multiscale information. We demonstrate the capabilities of LCNF in solving the highly ill-posed inverse problem in Fourier ptychographic microscopy (FPM) with multiplexed measurements, achieving robust, scalable, and generalizable large-scale phase retrieval. Unlike traditional neural fields frameworks, LCNF incorporates a local conditional representation that promotes model generalization, learning multiscale information, and efficient processing of large-scale imaging data. By combining an encoder and a decoder conditioned on a learned latent vector, LCNF achieves versatile continuous-domain super-resolution image reconstruction. We demonstrate accurate reconstruction of wide field-of-view, high-resolution phase images using only a few multiplexed measurements. LCNF robustly captures the continuous object priors and eliminates various phase artifacts, even when it is trained on imperfect datasets. The framework exhibits strong generalization, reconstructing diverse objects even with limited training data. Furthermore, LCNF can be trained on a physics simulator using natural images and successfully applied to experimental measurements on biological samples. Our results highlight the potential of LCNF for solving large-scale inverse problems in computational imaging, with broad applicability in various deep-learning-based techniques.

Neural Field Convolutions by Repeated Differentiation

2D Neural Fields with Learned Discontinuities

Generalizable Neural Fields as Partially Observed Neural Processes

A Memory-Efficient Dynamic Image Reconstruction Method using Neural Fields

Continuous Field Reconstruction from Sparse Observations with Implicit Neural Networks

A Temporal Kernel Approach for Deep Learning with Continuous-time Information

Continuous Neural Decoding Method Based on General Regression Neural Network.

Neural Gaussian Scale-Space Fields

Local Conditional Neural Fields for Versatile and Generalizable Large-Scale Reconstructions in Computational Imaging

MDNF: Multi-Diffusion-Nets for Neural Fields on Meshes

CUF: Continuous Upsampling Filters

Image Neural Field Diffusion Models

Convolutions and More as Einsum: A Tensor Network Perspective with Advances for Second-Order Methods

ReLU Fields: The Little Non-linearity That Could

Deep Continuous Networks

Extreme Compression of Adaptive Neural Images

BANF: Band-limited Neural Fields for Levels of Detail Reconstruction

Covariant spatio-temporal receptive fields for neuromorphic computing

Non-linear Convolution Filters for CNN-based Learning

Receptive Field Refinement for Convolutional Neural Networks Reliably Improves Predictive Performance