On the power of random information

Aicke Hinrichs,David Krieg,Erich Novak,Joscha Prochno,Mario Ullrich
DOI: https://doi.org/10.48550/arXiv.1903.00681
2019-03-02
Abstract:We study approximation and integration problems and compare the quality of optimal information with the quality of random information. For some problems random information is almost optimal and for some other problems random information is much worse than optimal information. We prove new results and give a short survey of known results.
Numerical Analysis,Probability
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to evaluate and compare the quality of random information and optimal information in approximation and integration problems. Specifically, the researchers explored whether in some problems, random information is almost as good as optimal information, while in some other problems, random information may be much worse than optimal information. ### Research Background 1. **Optimal Information**: Optimal algorithms use optimal information about problem instances. However, in many cases, we cannot obtain optimal information because we don't know how to select the most important measurements. 2. **Random Information**: It is assumed that information arrives in a random manner, which is a standard assumption in learning theory and uncertainty quantification. The researchers focused on: - What is the typical quality of random information? - In which cases is random information almost as good as optimal information? - In which cases is random information significantly inferior to optimal information? ### Research Methods To precisely formulate the problem, the researchers introduced the following concepts: - **Information Mapping**: It is in the form of \( N_n : F \to \mathbb{R}^n \), where \( N_n(f)=(L_1(f), \ldots, L_n(f)) \), and \( L_1, \ldots, L_n \in \Lambda \) are continuous linear functionals. - **Information Radius**: It is used to measure the quality of information mapping and is defined as the worst - case error: \[ r(N_n)=\inf_{\phi : \mathbb{R}^n \to G}\sup_{f \in F}\| S(f)-\phi(N_n(f)) \|_G \] - **Optimal Information**: If \( r(N_n^*) = \inf_{N_n}r(N_n) \), then \( N_n^* \) is called optimal information. ### Main Research Contents The paper mainly studied the comparison between random information and optimal information under two different natural choices of uniform distributions. Specifically, it includes: - **Integration and Approximation Problems in One - Dimensional Sobolev Space**: For the \( L_q \)-approximation problem, the effect of random information was studied, and it was proved that in the case of \( p > q \), random information is almost as good as optimal information; while in the case of \( p\leq q \), random information will lose a logarithmic factor. - **Approximation Problems of Multivariate Lipschitz Functions**: The \( L_q \)-approximation problem was studied, and it was proved that when \( q < \infty \), random information is almost as good as optimal information; while when \( q=\infty \), random information will lose a logarithmic factor. - **Approximation Problems in Classical Sobolev Space**: The \( L_q \)-approximation problem in high - dimensional Sobolev space was studied. The conjecture that random information is almost as good as optimal information when \( p > q \) was proposed, and it was proved that there is a loss of a logarithmic factor when \( p\leq q \). ### Conclusion Through these studies, the paper shows that in some problems, random information can be very close to the quality of optimal information, while in other problems, random information may be significantly inferior to optimal information. This conclusion is of great significance for understanding the application of random information in scientific computing.