Abstract:In this paper, utilizing recent theoretical results in high dimensional statistical modeling, we propose a model-free yet computationally simple approach to estimate the partially linear model $Y=X\beta+g(Z)+\varepsilon$. Motivated by the partial consistency phenomena, we propose to model $g(Z)$ via incidental parameters. Based on partitioning the support of $Z$, a simple local average is used to estimate the response surface. The proposed method seeks to strike a balance between computation burden and efficiency of the estimators while minimizing model bias. Computationally this approach only involves least squares. We show that given the inconsistent estimator of $g(Z)$, a root $n$ consistent estimator of parametric component $\beta$ of the partially linear model can be obtained with little cost in efficiency. Moreover, conditional on the $\beta$ estimates, an optimal estimator of $g(Z)$ can then be obtained using classic nonparametric methods. The statistical inference problem regarding $\beta$ and a two-population nonparametric testing problem regarding $g(Z)$ are considered. Our results show that the behavior of test statistics are satisfactory. To assess the performance of our method in comparison with other methods, three simulation studies are conducted and a real dataset about risk factors of birth weights is analyzed.

A Estimate Class of G-M Linear Model

Asymptotic Theory of Least Distances Estimate in Multivariate Linear Models

THE ASYMPTOTICALLY OPTIMAL EMPIRICAL BAYES ESTIMATION IN MULTIPLE LINEAR REGRESSION MODEL

On the maximum likelihood estimation in general log-linear models

Multivariable Fractional Polynomial Method for Regression Model.

M-estimation for linear models with exchangeable errors

Parameter Estimation For Multivariate Generalized Gaussian Distributions

STRONG CONSISTENCY OF QUASI-MAXIMUM LIKELIHOOD ESTIMATOR IN GENERALIZED LINEAR MODELS

Bayesian Grouping-Gibbs Sampling Estimation of High-dimensional Linear Model with Non-sparsity

A Note on the Backfitting Estimation of Additive Models

Efficient Estimation for Marginal Generalized Partially Linear Single-Index Models with Longitudinal Data

RATES OF CONVERGENCE OF M-ESTIMATORS FOR PARTLY LINEAR-MODELS INVOLVING TIME-SERIES

On Bayesian Generalized Additive Models

Asymptotic Properties of Estimation in Generalized Partial Linear Mixed Models

Best linear unbiased prediction for linear combinations in general mixed linear models

Estimation of Partially Linear Regression Model under Partial Consistency Property

Asymptotic properties on high-dimensional multivariate regression M-estimation

Weak consistency and asymptotic normality of quasi-maximum likelihood estimates in generalized linear models

Marginally Interpretable Generalized Linear Mixed Models

$L^1$ Estimation: On the Optimality of Linear Estimators

Estimation of Conditional Covariance Matrices for a Class of High-Dimensional Varying Coefficient Factor-Generalized Autoregressive Conditional Heteroscedasticity Model