Abstract:In this paper we discuss the estimation of a nonparametric component $f_1$ of a nonparametric additive model $Y=f_1(X_1) + ...+ f_q(X_q) + \epsilon$. We allow the number $q$ of additive components to grow to infinity and we make sparsity assumptions about the number of nonzero additive components. We compare this estimation problem with that of estimating $f_1$ in the oracle model $Z= f_1(X_1) + \epsilon$, for which the additive components $f_2,\dots,f_q$ are known. We construct a two-step presmoothing-and-resmoothing estimator of $f_1$ and state finite-sample bounds for the difference between our estimator and some smoothing estimators $\hat f_1^{\text{(oracle)}}$ in the oracle model. In an asymptotic setting these bounds can be used to show asymptotic equivalence of our estimator and the oracle estimators; the paper thus shows that, asymptotically, under strong enough sparsity conditions, knowledge of $f_2,\dots,f_q$ has no effect on estimation accuracy. Our first step is to estimate $f_1$ with an undersmoothed estimator based on near-orthogonal projections with a group Lasso bias correction. We then construct pseudo responses $\hat Y$ by evaluating a debiased modification of our undersmoothed estimator of $f_1$ at the design points. In the second step the smoothing method of the oracle estimator $\hat f_1^{\text{(oracle)}}$ is applied to a nonparametric regression problem with responses $\hat Y$ and covariates $X_1$. Our mathematical exposition centers primarily on establishing properties of the presmoothing estimator. We present simulation results demonstrating close-to-oracle performance of our estimator in practical applications.

Sparse Semiparametric Efficient Estimation in High-Dimensional Linear Regression Models

Semiparametric efficient estimation in high‐dimensional partial linear regression models

Semiparametric Expectile Regression for High-dimensional Heavy-tailed and Heterogeneous Data

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Estimation of Linear Functionals in High-Dimensional Linear Models: From Sparsity to Nonsparsity

On Sparse Estimation for Semiparametric Linear Transformation Models

Sparse and Efficient Estimation for Partial Spline Models with Increasing Dimension

Sparse Estimation Via ℓ_q Optimization Method in High-Dimensional Linear Regression

Semiparametric Estimation And Variable Selection For Sparse Single Index Models In Increasing Dimension

Sparse deep neural networks for nonparametric estimation in high-dimensional sparse regression

Efficient estimation of partially linear varying coefficient models

Efficient Inference on High-Dimensional Linear Models with Missing Outcomes

Adaptive posterior concentration rates for sparse high-dimensional linear regression with random design and unknown error variance

Variance estimation for sparse ultra-high dimensional varying coefficient models

An RKHS-based approach to double-penalized regression in high-dimensional partially linear models

A semi-parametric approach to feature selection in high-dimensional linear regression models

A Constructive Approach to High-dimensional Regression

Ultra high-dimensional semiparametric longitudinal data analysis

Sparse semiparametric regression when predictors are mixture of functional and high-dimensional variables

Confidence regions for high-dimensional generalized linear models under sparsity

Statistical inference in sparse high-dimensional additive models