Abstract:We present new convergence estimates of generalized empirical interpolation methods in terms of the entropy numbers of the parametrized function class. Our analysis is transparent and leads to sharper convergence rates than the classical analysis via the Kolmogorov n-width. In addition, we also derive novel entropy-based convergence estimates of the Chebyshev greedy algorithm for sparse n-term nonlinear approximation of a target function. This also improves classical convergence analysis when corresponding entropy numbers decay fast enough.

What problem does this paper attempt to address?

The problems that this paper attempts to solve mainly focus on two aspects: 1. **Convergence analysis of the Empirical Interpolation Method (EIM)**: - The paper proposes a new convergence estimate of the generalized empirical interpolation method based on metric entropy numbers. This new analysis method is more transparent than the classical analysis via Kolmogorov n - width and can provide sharper convergence rates in many cases. - Specifically, the paper gives a convergence estimate in the following form: \[ \sup_{f \in K} \| f - \Pi_{n - 1}f \| \leq C(1 + \Lambda_{n - 1})\left(\prod_{k = 1}^{n - 1}(1 + \Lambda_k)\right)^{\frac{1}{n}}n\varepsilon_n(\text{co}(K)) \] where \(\Pi_n\) is the empirical interpolation at the \(n\) - th iteration, \(C\) is an absolute constant, \(\Lambda_n\) is the norm of \(\Pi_n\) (also known as the Lebesgue constant), and \(\varepsilon_n(\text{co}(K))\) is the metric entropy number of the symmetric convex hull \(\text{co}(K)\) of the function set \(K\). 2. **Convergence analysis of the Chebyshev Greedy Algorithm (CGA)**: - The paper also derives a new convergence estimate of the Chebyshev Greedy Algorithm based on metric entropy numbers. This estimate improves the classical results, especially in some popular dictionaries such as the ReLU dictionary. - Specifically, the paper gives a convergence estimate in the following form: \[ \| f - f_n \| \leq C_f n^{\frac{1}{s}-\frac{1}{2}}\delta_{X,n}\varepsilon_n(\text{co}(K)) \] where \(C_f\) is an explicit uniform constant depending on the target function \(f\), \(\delta_{X,n}\) is the supremum of the Banach - Mazur distance between \(\ell_n^2\) and the \(n\) - dimensional subspace of \(X\), and \(\varepsilon_n(\text{co}(K))\) is the metric entropy number of the symmetric convex hull \(\text{co}(K)\) of the function set \(K\). Overall, the main contribution of this paper lies in providing new and more accurate convergence estimation methods, which are applicable not only to the empirical interpolation method but also to the Chebyshev Greedy Algorithm. These results are of great significance for understanding and optimizing model reduction techniques for parameterized partial differential equations (PDEs).

A new analysis of empirical interpolation methods and Chebyshev greedy algorithms

Entropy-based convergence rates of greedy algorithms

Some New Convergence Analysis and Applications of POD-Greedy Algorithms

On the optimality of target-data-dependent kernel greedy interpolation in Sobolev Reproducing Kernel Hilbert Spaces

Lipschitz Interpolation: Non-parametric Convergence under Bounded Stochastic Noise

On the convergence of generalized kernel-based interpolation by greedy data selection algorithms

On Interpolation Approximation: Convergence Rates for Polynomial Interpolation for Functions of Limited Regularity.

Rational Empirical Interpolation Methods with Applications

Sparse-grid polynomial interpolation approximation and integration for parametric and stochastic elliptic PDEs with lognormal inputs

On the rate of convergence of greedy algorithms

On the Optimal Convergence Rates of Chebyshev Interpolations for Functions of Limited Regularity

Exploring Chebyshev Polynomial Approximations: Error Estimates for Functions of Bounded Variation

Linear Convergence of Stochastic Iterative Greedy Algorithms With Sparse Constraints

Convergence and rate of convergence of some greedy algorithms in convex optimization

A Generalized Entropy Criterion for Nevanlinna-Pick Interpolation with Degree Constraint.

On the entropy numbers of the mixed smoothness function classes

Improved error bound for multivariate Chebyshev polynomial interpolation

Faster Convergence of Stochastic Accelerated Gradient Descent under Interpolation