Abstract:The problem of recovering a signal $\boldsymbol x\in \mathbb{R}^n$ from a quadratic system $\{y_i=\boldsymbol x^\top\boldsymbol A_i\boldsymbol x,\ i=1,\ldots,m\}$ with full-rank matrices $\boldsymbol A_i$ frequently arises in applications such as unassigned distance geometry and sub-wavelength imaging. With i.i.d. standard Gaussian matrices $\boldsymbol A_i$, this paper addresses the high-dimensional case where $m\ll n$ by incorporating prior knowledge of $\boldsymbol x$. First, we consider a $k$-sparse $\boldsymbol x$ and introduce the thresholded Wirtinger flow (TWF) algorithm that does not require the sparsity level $k$. TWF comprises two steps: the spectral initialization that identifies a point sufficiently close to $\boldsymbol x$ (up to a sign flip) when $m=O(k^2\log n)$, and the thresholded gradient descent which, when provided a good initialization, produces a sequence linearly converging to $\boldsymbol x$ with $m=O(k\log n)$ measurements. Second, we explore the generative prior, assuming that $x$ lies in the range of an $L$-Lipschitz continuous generative model with $k$-dimensional inputs in an $\ell_2$-ball of radius $r$. With an estimate correlated with the signal, we develop the projected gradient descent (PGD) algorithm that also comprises two steps: the projected power method that provides an initial vector with $O\big(\sqrt{\frac{k \log L}{m}}\big)$ $\ell_2$-error given $m=O(k\log(Lnr))$ measurements, and the projected gradient descent that refines the $\ell_2$-error to $O(\delta)$ at a geometric rate when $m=O(k\log\frac{Lrn}{\delta^2})$. Experimental results corroborate our theoretical findings and show that: (i) our approach for the sparse case notably outperforms the existing provable algorithm sparse power factorization; (ii) leveraging the generative prior allows for precise image recovery in the MNIST dataset from a small number of quadratic measurements.

Fast quadratic sensing via nonconvex optimization

Non-convex matrix sensing: Breaking the quadratic rank barrier in the sample complexity

Convergence of Projected Subgradient Method with Sparse or Low-Rank Constraints

Fast Sparse Recovery Via Non-Convex Optimization

An Oracle Gradient Regularized Newton Method for Quadratic Measurements Regression

A Fast Convex Conjugated Algorithm for Sparse Recovery

Nonconvex Low-Rank Matrix Recovery with Arbitrary Outliers via Median-Truncated Gradient Descent

Beyond Procrustes: Balancing-Free Gradient Descent for Asymmetric Low-Rank Matrix Sensing

A Unified Computational and Statistical Framework for Nonconvex Low-rank Matrix Estimation

A Unified Variance Reduction-Based Framework for Nonconvex Low-Rank Matrix Recovery

A NONCONVEX ALGORITHM FOR SIMULTANEOUSLY SPARSE AND LOW-RANK MATRIX RECONSTRUCTION

A Single-Mode Quasi Riemannian Gradient Descent Algorithm for Low-Rank Tensor Recovery

Sharpness and well-conditioning of nonsmooth convex formulations in statistical signal recovery

Solving Quadratic Systems with Full-Rank Matrices Using Sparse or Generative Priors

Efficient Compressive Phase Retrieval with Constrained Sensing Vectors

An improved greedy algorithm for signal recovery from random measurements

Robust Sparse Recovery Via Non-Convex Optimization

A piecewise linear programming algorithm for sparse signal reconstruction

Robust Recovery of Low-Rank Matrices Via Non-Convex Optimization

A Universal Variance Reduction-Based Catalyst for Nonconvex Low-Rank Matrix Recovery

A Fast Alternating Direction Method for TVL1-L2 Signal Reconstruction from Partial Fourier Data