Robert J. Kunsch,Marcin Wnuk
Abstract:We study approximation of the embedding $\ell_p^m \rightarrow \ell_{\infty}^m$, $1 \leq p \leq 2$, based on randomized adaptive algorithms that use arbitrary linear functionals as information on a problem instance. We show upper bounds for which the complexity $n$ exhibits only a $(\log\log m)$-dependence. Our results for $p=1$ lead to an example of a gap of order $n$ (up to logarithmic factors) for the error between best adaptive and non-adaptive Monte Carlo methods. This is the largest possible gap for linear problems.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the uniform approximation problem of vectors. Specifically, it is to study the approximation problem of the embedding $\ell_m^p \hookrightarrow \ell_m^\infty$ based on randomized adaptive algorithms, where $1 \leq p \leq 2$. These algorithms use any linear functional as the information of problem instances. The main goal of the paper is to show the upper bound so that the complexity only depends on $(\log \log m)$, and for the case of $p = 1$, it shows that the error gap between the adaptive and non - adaptive Monte Carlo methods can reach $n$ (ignoring the logarithmic factor), which is the largest possible gap in linear problems.
### Specific problem description
1. **Approximation problem**: Study the embedding approximation problem from $\ell_m^p$ to $\ell_m^\infty$, that is, how to approximate the representation of a vector under different norms with a finite number of measurements (linear functionals).
2. **Comparison between adaptive and non - adaptive algorithms**: Explore whether the adaptive method is more powerful than the non - adaptive method, especially in the deterministic setting, whether the adaptive method can significantly improve performance.
3. **Error bounds**: Find the minimum errors $eran(n,S)$ and $eran,nonada(n,S)$, which correspond to the error bounds of the adaptive and non - adaptive random algorithms respectively, and show the gap between them.
4. **Complexity analysis**: Through the analysis of the upper and lower bounds, prove that the complexity of the adaptive algorithm only depends on $(\log \log m)$, while the non - adaptive algorithm depends on $(\log m)$.
### Main contributions
- Propose an adaptive algorithm for the problem of approximating $\ell_m^1 \hookrightarrow \ell_m^\infty$ and show its upper bound.
- Combining the existing lower bound of the non - adaptive algorithm, prove that the error gap between the adaptive and non - adaptive methods can reach $n$ (ignoring the logarithmic factor), which is the largest possible gap in linear problems.
- Provide a detailed algorithm description and analysis, including key steps such as hash functions, bucket selection, and identification of single heavy hitters.
### Application background
This research is not only of great significance for understanding the embedding problems of finite - dimensional sequence spaces, but also provides a theoretical basis for the approximation of more complex infinite - dimensional operators (such as Sobolev embeddings). In addition, it is also applicable to other fields that require efficient information processing, such as data stream algorithms and sparse recovery problems.