Abstract:Implicit neural representations (INRs) have emerged as a powerful tool for solving inverse problems in computer vision and computational imaging. INRs represent images as continuous domain functions realized by a neural network taking spatial coordinates as inputs. However, unlike traditional pixel representations, little is known about the sample complexity of estimating images using INRs in the context of linear inverse problems. Towards this end, we study the sampling requirements for recovery of a continuous domain image from its low-pass Fourier coefficients by fitting a single hidden-layer INR with ReLU activation and a Fourier features layer using a generalized form of weight decay regularization. Our key insight is to relate minimizers of this non-convex parameter space optimization problem to minimizers of a convex penalty defined over an infinite-dimensional space of measures. We identify a sufficient number of samples for which an image realized by a width-1 INR is exactly recoverable by solving the INR training problem, and give a conjecture for the general width-$W$ case. To validate our theory, we empirically assess the probability of achieving exact recovery of images realized by low-width single hidden-layer INRs, and illustrate the performance of INR on super-resolution recovery of more realistic continuous domain phantom images.

What problem does this paper attempt to address?

### Problems Addressed by the Paper This paper primarily explores the sample complexity issue of Implicit Neural Representations (INRs) in linear inverse problems in computer vision and computational imaging. Specifically: 1. **Background**: - Implicit Neural Representations (INRs) have been proven to be powerful tools for solving inverse problems in computer vision and computational imaging. INRs represent images as continuous domain functions realized through neural networks, with inputs being spatial coordinates. - Unlike traditional pixel representations, little is known about the sample complexity required for using INRs to estimate images when dealing with linear inverse problems. 2. **Research Objectives**: - Investigate the sampling requirements for recovering continuous domain images from low-pass Fourier coefficients. - Focus on using single hidden layer INRs (with ReLU activation functions and Fourier feature layers) and fitting these coefficients through a generalized form of weight decay regularization. - Propose a method to relate the minimizers of the non-convex parameter space optimization problem to the minimizers of a convex penalty over an infinite-dimensional measure space. 3. **Main Contributions**: - Identify a sufficient number of samples that allow for the exact recovery of images represented by INRs with a width of 1 by solving the INR training problem, and conjecture on the case for widths greater than 1. - Validate the theoretical conjectures through numerical simulations and demonstrate the practical performance of INRs in super-resolution recovery of continuous domain phantom images. In summary, this paper aims to explore the number of samples required for image reconstruction using Implicit Neural Representations and proposes a corresponding theoretical framework and experimental validation.

Towards a Sampling Theory for Implicit Neural Representations

A Sampling Theory Perspective on Activations for Implicit Neural Representations

Revisiting Implicit Neural Representations in Low-Level Vision

Where Do We Stand with Implicit Neural Representations? A Technical and Performance Survey

Implicit Neural Representations and the Algebra of Complex Wavelets

HOIN: High-Order Implicit Neural Representations

Partition Speeds Up Learning Implicit Neural Representations Based on Exponential-Increase Hypothesis

Seeing Implicit Neural Representations as Fourier Series

Implicit Neural Representation for MRI Parallel Imaging Reconstruction

ReLUs Are Sufficient for Learning Implicit Neural Representations

UncertaINR: Uncertainty Quantification of End-to-End Implicit Neural Representations for Computed Tomography

Spatiotemporal implicit neural representation for unsupervised dynamic MRI reconstruction

Disorder-Invariant Implicit Neural Representation

Optimizing 3D Geometry Reconstruction from Implicit Neural Representations

Streaming Neural Images

Implicit Neural Representation Learning for Hyperspectral Image Super-Resolution

FINER: Flexible spectral-bias tuning in Implicit NEural Representation by Variable-periodic Activation Functions

Residual-Based Implicit Neural Representation for Synthetic Aperture Radar Images

Implicit Neural Representation in Medical Imaging: A Comparative Survey

Implicit Neural Representations with Fourier Kolmogorov-Arnold Networks