Abstract:In phase retrieval, we want to recover an unknown signal x∈Cd\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${{\varvec{x}}}\in {{\mathbb {C}}}^d$$\end{document} from n quadratic measurements of the form yi=|⟨ai,x⟩|2+wi\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$y_i = |\langle {{\varvec{a}}}_i,{{\varvec{x}}}\rangle |^2+w_i$$\end{document}, where ai∈Cd\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${{\varvec{a}}}_i\in {{\mathbb {C}}}^d$$\end{document} are known sensing vectors and wi\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$w_i$$\end{document} is measurement noise. We ask the following weak recovery question: What is the minimum number of measurements n needed to produce an estimator x^(y)\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${\hat{{{\varvec{x}}}}}({{\varvec{y}}})$$\end{document} that is positively correlated with the signal x\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${{\varvec{x}}}$$\end{document}? We consider the case of Gaussian vectors ai\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${{\varvec{a}}}_i$$\end{document}. We prove that—in the high-dimensional limit—a sharp phase transition takes place, and we locate the threshold in the regime of vanishingly small noise. For n≤d-o(d)\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$n\le d-o(d)$$\end{document}, no estimator can do significantly better than random and achieve a strictly positive correlation. For n≥d+o(d)\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$n\ge d+o(d)$$\end{document}, a simple spectral estimator achieves a positive correlation. Surprisingly, numerical simulations with the same spectral estimator demonstrate promising performance with realistic sensing matrices. Spectral methods are used to initialize non-convex optimization algorithms in phase retrieval, and our approach can boost the performance in this setting as well. Our impossibility result is based on classical information-theoretic arguments. The spectral algorithm computes the leading eigenvector of a weighted empirical covariance matrix. We obtain a sharp characterization of the spectral properties of this random matrix using tools from free probability and generalizing a recent result by Lu and Li. Both the upper bound and lower bound generalize beyond phase retrieval to measurements yi\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$y_i$$\end{document} produced according to a generalized linear model. As a by-product of our analysis, we compare the threshold of the proposed spectral method with that of a message passing algorithm.

Criterion of Significance Level for Selection of Order of Spectral Estimation of Entropy Maximum

Ranking power spectra: a proof of concept.

Likelihood Analysis of Power Spectra and Generalized Moment Problems

Order Parameters for Minimax Entropy Distributions: when Does High Level Knowledge Help?

Minimum Total Error Entropy Method for Parameter Estimation

A New Spectral Measure of Complexity and Its Capabilities for Detecting Signals in Noise

Comparison of information criteria for detection of useful signal in noisy environment

Statistical complexity as a criterion for the useful signal detection problem

Ensemble Improved Permutation Entropy: A New Approach for Time Series Analysis

Combining eigenvalues and variation of eigenvectors for order determination

An Extended Result on the Optimal Estimation under the Minimum Error Entropy Criterion

The Principle of Uncertain Maximum Entropy

Δ-Entropy: Definition, Properties and Applications in System Identification with Quantized Data

A Novel Uncertainty Parameter SR (Signal To Residual Spectrum Ratio) Evaluation Approach For Speech Enhancement

Using the Magnitude-Squared Coherence for Determining Order-Chaos Transition in a System Governed by Logistic Equation Dynamics

Maximum Probability and Relative Entropy Maximization. Bayesian Maximum Probability and Empirical Likelihood

Generalized Maximum Entropy Methods as Limits of the Average Spectrum Method

A Cautionary Tale of Entropic Criteria in Assessing the Validity of the Maximum Entropy Principle

Minimax-robust estimation problems for stationary stochastic sequences

Fundamental Limits of Weak Recovery with Applications to Phase Retrieval