Abstract:Spectral computational methods leverage modal or nonlocal representations of data, and a physically realized approach to spectral computation pertains to encoded diffraction. Encoded diffraction offers a hybrid approach that pairs analog wave propagation with digital back-end electronics, however the intermediate sensor patterns are correlations rather than linear signal weights, which limits the development of robust and efficient downstream analyses. Here, with vortex encoders, we show that the solution for the signal field from sensor intensity adopts the form of polynomial regression, which is subsequently solved with a learned, linear transformation. This result establishes an analytic rationale for a spectral-methods paradigm in physically realized machine learning systems. To demonstrate this paradigm, we quantify the learning that is transferred with an image basis using speckle parameters, Singular-Value Decomposition Entropy ($H_{SVD}$) and Speckle-Analogue Density (SAD). We show that $H_{SVD}$, a proxy for image complexity, indicates the rate at which a model converges. Similarly, SAD, an averaged spatial frequency, marks a threshold for structurally similar reconstruction. With a vortex encoder, this approach with parameterized training may be extended to distill features. In fact, with images reconstructed with our models, we achieve classification accuracies that rival decade-old, state-of-the-art computer algorithms. This means that the process of learning compressed spectral correlations distills features to aid image classification, even when the goal images are feature-agnostic speckles. Our work highlights opportunities for analytic and axiom-driven machine-learning designs appropriate for real-time applications.

Learning Boolean functions with concentrated spectra

On Learning with LAD

Data-Driven Learning of Boolean Networks and Functions by Optimal Causation Entropy Principle (BoCSE)

Three lectures on Fourier analysis and learning theory

The More the Merrier: On Evolving Five-valued Spectra Boolean Functions

Monotone probability distributions over the Boolean cube can be learned with sublinear samples

Efficient MPS representations and quantum circuits from the Fourier modes of classical image data

Learning smooth functions in high dimensions: from sparse polynomials to deep neural networks

Learning Combinatorial Functions from Pairwise Comparisons

Learning Logistic Circuits

Agnostically Learning Boolean Functions with Finite Polynomial Representation.

Error Bounds for Real Function Classes Based on Discretized Vapnik-Chervonenkis Dimensions.

Learning Polynomial Problems with $SL(2,\mathbb{R})$ Equivariance

Hardness of Learning Boolean Functions from Label Proportions

BOLD: Boolean Logic Deep Learning

Boolean functions whose Fourier transform is concentrated on pairwise disjoint subsets of the input

On Exactly Learning Disjunctions and DNFs Without Equivalence Queries.

Parameterized Learning and Distillation with Vortex-encoded Spectral Correlations

Probabilistic learning of boolean functions applied to the binary classification problem with categorical covariates

Learning Binary Codes and Binary Weights for Efficient Classification

Spectral Maps for Learning Reduced Representations of Molecular Systems