Abstract:Suppose a discrete-time signal $S(t)$, $0 \leq t < N$, is a superposition of atoms taken from a combined time–frequency dictionary made of spike sequences $1_{\{t = \tau\}}$ and sinusoids $\exp\{2\pi i w t /N)/\sqrt{N}$. Can one recover, from knowledge of $S$ alone, the precise collection of atoms going to make up $S$? Because every discrete-time signal can be represented as a superposition of spikes alone, or as a superposition of sinusoids alone, there is no unique way of writing $S$ as a sum of spikes and sinusoids in general. We prove that if $S$ is representable as a highly sparse superposition of atoms from this time–frequency dictionary, then there is only one such highly sparse representation of $S$, and it can be obtained by solving the convex optimization problem of minimizing the $\ell^1$ norm of the coefficients among all decompositions. Here “highly sparse” means that $N_t + N_w < \sqrt{N}/2$ where $N_t$ is the number of time atoms, $N_w$ is the number of frequency atoms, and $N$ is the length of the discrete-time signal. Underlying this result is a general $\ell^1$ uncertainty principle which says that if two bases are mutually incoherent, no nonzero signal can have a sparse representation in both bases simultaneously. For the above setting, the bases are sinuosids and spikes, and mutual incoherence is measured in terms of the largest inner product between different basis elements. The uncertainty principle holds for a variety of interesting basis pairs, not just sinusoids and spikes. The results have idealized applications to band-limited approximation with gross errors, to error-correcting encryption, and to separation of uncoordinated sources. Related phenomena hold for functions of a real variable, with basis pairs such as sinusoids and wavelets, and for functions of two variables, with basis pairs such as wavelets and ridgelets. In these settings, if a function $f$ is representable by a sufficiently sparse superposition of terms taken from both bases, then there is only one such sparse representation; it may be obtained by minimum $\ell^1$ norm atomic decomposition. The condition “sufficiently sparse” becomes a multiscale condition; for example, that the number of wavelets at level $j$ plus the number of sinusoids in the $j$th dyadic frequency band are together less than a constant times $2^{j/2}$.

Uncertainty Principles on Finite Abelian Groups, Restriction Theory, and Applications to Sparse Signal Recovery

The Shift Bound for Abelian Codes and Generalizations of the Donoho-Stark Uncertainty Principle

Signal Recovery with Partially Known Signal Support

I T ] 8 S ep 2 01 3 Sparse Recovery with Coherent Tight Frames via Analysis Dantzig Selector and Analysis LASSO ∗

On Sparse Recovery Algorithms in Unions of Orthonormal Bases

Effective support, Dirac combs, and signal recovery

New Bounds for Restricted Isometry Constants with Coherent Tight Frames

Sparse Recovery with Coherent Tight Frame via Analysis Dantzig Selector and Analysis LASSO

Uncertainty Principle, Shannon-Nyquist Sampling and Beyond

On an uncertainty result by Donoho and Stark

Recovery of Signals with Low Density

On unified view of nullspace-type conditions for recoveries associated with general sparsity structures

Signals on Graphs: Uncertainty Principle and Sampling

Global and Local Uncertainty Principles for Signals on Graphs

Uncertainty principles and ideal atomic decomposition

Separation of a subspace-sparse signal: Algorithms and conditions

Perturbation Analysis of Signal Space Fast Iterative Hard Thresholding with Redundant Dictionaries

On Graph Uncertainty Principle and Eigenvector Delocalization

Support Recovery in the Phase Retrieval Model: Information-Theoretic Fundamental Limits

Sparse Recovery Via Differential Inclusions

Sharpened Uncertainty Principle