Abstract:In this work, we construct a stable and fairly fast estimator for solving multidimensional non-parametric regression problems. The proposed estimator is based on the use of a novel and special system of multivariate Jacobi polynomials that generate a basis for a reduced size of variate finite dimensional polynomials space. An ANOVA decomposition trick has been used for building this space. Also, by using some results from the theory of positive definite random matrices, we show that the proposed estimator is stable under the condition that the i.i.d. dimensional random sampling training points follow a dimensional Beta distribution. In addition, we provide the reader with an estimate for the risk error of the estimator. This risk error depends on the error of the orthogonal projection error of the regression function over the considered polynomials space. An involved study of this orthogonal projection error is done under the condition that the regression function belongs to a given weighted Sobolev space. Thanks to this novel estimate of the orthogonal projection error, we give the optimal convergence rate of our estimator. Furthermore, we give a regularized extension version of our estimator, that is capable of handling random sampling training vectors drawn according to an unknown multivariate pdf. Moreover, we derive an upper bound for the empirical risk error of this regularized estimator. Finally, we give some numerical simulations that illustrate the various theoretical results of this work. In particular, we provide simulations on a real data that compares the performance of our estimator with some existing and popular NP regression estimators.

Variable transformations in combination with wavelets and ANOVA for high-dimensional approximation

Variable Transformations in combination with Wavelets and ANOVA for high-dimensional approximation

ANOVA approximation with mixed tensor product basis on scattered points

ANOVA-boosting for Random Fourier Features

High-dimensional copula variational approximation through transformation

A Multivariate Fast Discrete Walsh Transform with an Application to Function Interpolation

Wavelet-based Hybrid Multilinear Models for Multidimensional Image Approximation.

Error Estimates for the ANOVA Method with Polynomial Chaos Interpolation: Tensor Product Functions

Operator learning based on sparse high-dimensional approximation

Approximation of Integral Operators Using Product-Convolution Expansions

On the approximation error in high dimensional model representation

Note for Alan ’ s Class

Polynomial Approximation of Anisotropic Analytic Functions of Several Variables

Tensor product approximations of high dimensional potentials

Partition Model Averaging of Bayesian Wavelet Regression for Multi-Dimensional Data

An adaptive ANOVA stochastic Galerkin method for partial differential equations with high-dimensional random inputs

Nonparametric Estimation via Partial Derivatives

Adaptive Wavelet Domain Principal Component Analysis for Nonstationary Time Series

A multivariate Jacobi polynomials regression estimator associated with an ANOVA decomposition model

Infinite-Variate $L^2$-Approximation with Nested Subspace Sampling

On Wavelet-Based Numerical Homogenization