Onyekachi Emenike,Fred J. Hickernell,Peter Kritzer
Abstract:A large literature specifies conditions under which the information complexity for a sequence of numerical problems defined for dimensions $1, 2, \ldots$ grows at a moderate rate, i.e., the sequence of problems is tractable. Here, we focus on the situation where the space of available information consists of all linear functionals and the problems are defined as linear operator mappings between Hilbert spaces. We unify the proofs of known tractability results and generalize a number of existing results. These generalizations are expressed as five theorems that provide equivalent conditions for (strong) tractability in terms of sums of functions of the singular values of the solution operators.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the growth rate problem of the information complexity of a series of approximation problems defined in Hilbert spaces. Specifically, the authors are concerned with whether the information complexity grows at a moderate rate, that is, whether the problem is "tractable" when the available information space consists of all linear functionals and the problem is defined as a linear operator mapping between Hilbert spaces. The goal of the paper is to unify the known tractability results and generalize the existing results. These generalizations are expressed through five theorems, which provide equivalent conditions for (strong) tractability, and these conditions involve the sum of the singular value functions of the solution operators.
### Background of the Paper
In the field of numerical analysis, much research has been devoted to determining how the information complexity required to solve a series of numerical problems changes as the problem dimension increases or the error threshold decreases. If the information complexity does not grow too rapidly as the problem dimension increases or the error threshold decreases, the problem is considered tractable. Since the 1990s, research on tractability has produced a large amount of literature, including three important volumes. The authors of this paper identify the common themes in the literature for proving necessary and sufficient conditions, and by abstracting these themes, aim to unify and generalize the tractability results of many existing approximation problems, especially when all possible linear functional data are available.
### Research Methods
The authors consider sequences of Hilbert spaces \(\{F_d\}_{d \in \mathbb{N}}\) and \(\{G_d\}_{d \in \mathbb{N}}\), as well as sequences of linear solution operators \(\{SOL_d: F_d \rightarrow G_d\}_{d \in \mathbb{N}}\) between these spaces. It is assumed that \(SOL_d\) is a compact operator, which means that its singular values \(\lambda_{i,d}\) converge to zero as \(i\) tends to infinity, thus ensuring that the problem can be solved by an appropriate algorithm. The goal is to find a sequence of approximate solution operators \(\{APP_d: B_d \times (0, \infty) \rightarrow G_d\}_{d \in \mathbb{N}}\), where \(B_d\) represents functions on the unit ball in \(F_d\), satisfying the absolute error criterion:
\[ \|SOL_d(f) - APP_d(f, \varepsilon)\|_{G_d} \leq \varepsilon \quad \forall f \in B_d, \varepsilon \in (0, \infty). \]
### Information Complexity
The information complexity \(comp(\varepsilon, d)\) is defined as the number of linear functionals required by the best - allowed algorithm that satisfies the above error criterion. The information complexity is non - decreasing as \(\varepsilon\) tends to zero, and usually also non - decreasing as \(d\) increases. For the case where any linear functional is allowed, the optimal approximate solution operator is known as:
\[ APP_d(f, \varepsilon) = \sum_{i = 1}^n SOL_d(u_{i,d}) \langle f, u_i \rangle_{F_d}, \]
where \(n\) satisfies \(\lambda_{n + 1,d} \leq \varepsilon\). Therefore, the information complexity of the linear problem is:
\[ comp(\varepsilon, d) = \min \{ n \in \mathbb{N}_0 : \lambda_{n + 1,d} \leq \varepsilon \}. \]
### Definition of Tractability
The tractability problem lies in determining the growth rate of the information complexity as \(\varepsilon\) tends to zero and/or \(d\) tends to infinity. The authors hope to represent the information complexity with a simple function \(T\) and find singular value conditions equivalent to the validity of this bound, which are easier to verify than directly proving this bound.
### Main Contributions
This paper provides a series through five theorems.