Abstract:Approximation of high-dimensional functions is a problem in many scientific fields that is only feasible if advantageous structural properties, such as sparsity in a given basis, can be exploited. A relevant tool for analysing sparse approximations is Stechkin's lemma. In its standard form, however, this lemma does not allow to explain convergence rates for a wide range of relevant function classes. This work presents a new weighted version of Stechkin's lemma that improves the best $n$-term rates for weighted $\ell^p$-spaces and associated function classes such as Sobolev or Besov spaces. For the class of holomorphic functions, which occur as solutions of common high-dimensional parameter-dependent PDEs, we recover exponential rates that are not directly obtainable with Stechkin's lemma. Since weighted $\ell^p$-summability induces weighted sparsity, compressed sensing algorithms can be used to approximate the associated functions. To break the curse of dimensionality, which these algorithms suffer, we recall that sparse approximations can be encoded efficiently using tensor networks with sparse component tensors. We also demonstrate that weighted $\ell^p$-summability induces low ranks, which motivates a second tensor train format with low ranks and a single weighted sparse core. We present new alternating algorithms for best $n$-term approximation in both formats. To analyse the sample complexity for the new model classes, we derive a novel result of independent interest that allows the transfer of the restricted isometry property from one set to another sufficiently close set. Although they lead up to the analysis of our final model class, our contributions on weighted Stechkin and the restricted isometry property are of independent interest and can be read independently.

Sparse signal reconstruction via the approximations of <inline-formula><tex-math id="M1">\begin{document}$ \ell_{0} $\end{document}</tex-math></inline-formula> quasinorm

Sparse signal reconstruction via the approximations of egin{document}$ ell_{0} $end{document} quasinorm

Sparse Approximate Reconstruction Decomposed by Two Optimization Problems

Geophysical Data Sparse Reconstruction Based on L0-Norm Minimization

On the Schatten P-Quasi-norm Minimization for Low-Rank Matrix Recovery

Sparse Signal Reconstruction Based on Multiparameter Approximation Function with Smoothedl0Norm

Sparse Signal Recovery Via Exponential Metric Approximation

Sparse Recovery: The Square of Norms

Sparse Signal Recovery Via Minimax-Concave Penalty and ℓ 1 -Norm Loss Function.

A Truncated Approximate Difference Algorithm for Sparse Signal Recovery

Sparse Recovery: The Square of $\ell_1/\ell_2$ Norms

Nonconvex Sorted $$\ell _1$$ ℓ 1 Minimization for Sparse Approximation

Lp quasi-norm minimization: algorithm and applications

Gradient Projection with Approximate L0 Norm Minimization for Sparse Reconstruction in Compressed Sensing

High-dimensional sparse trigonometric approximation in the uniform norm and consequences for sampling recovery

Low-Rank Approximation via Generalized Reweighted Iterative Nuclear and Frobenius Norms

Weighted sparsity and sparse tensor networks for least squares approximation

Analyzing Weighted $\ell_1$ Minimization for Sparse Recovery with Nonuniform Sparse Models\footnote{The results of this paper were presented in part at the International Symposium on Information Theory, ISIT 2009}

Subspace Weighted L(2,1) Minimization For Sparse Signal Recovery

Nonconvex Sorted ℓ _1 Minimization for Sparse Approximation

From Least Squares to Sparse: A Non-Convex Approach with Guarantee

Sparse signal reconstruction via the approximations of &lt;inline-formula&gt;&lt;tex-math id="M1"&gt;\begin{document}$ \ell_{0} $\end{document}&lt;/tex-math&gt;&lt;/inline-formula&gt; quasinorm

Sparse signal reconstruction via the approximations of egin{document}$ ell_{0} $end{document} quasinorm