Estimation for a Partial-Linear Single-Index Model

Tingting Li,Hu Yang,Jane-Ling Wang,Liugen Xue,Li Zhu

DOI: https://doi.org/10.1214/11-aos953

2011-01-01

The Annals of Statistics

Abstract:This note is to correct an error in Lemma A.7 of Wang et al. (2010).The original claim of asymptotically higher efficiency no longer holds.

What problem does this paper attempt to address?

Estimation for Biased Partial Linear Single Index Models

Jun Lu,Xuehu Zhu,Lu Lin,Lixing Zhu

DOI: https://doi.org/10.1016/j.csda.2019.03.006

IF: 2.035

2019-01-01

Computational Statistics & Data Analysis

Abstract:In this paper, we propose a novel method to consistently estimate, at the root-n rate, the coefficient parameters in a biased partial linear single-index model whose error term does not have zero conditional expectation. To achieve this purpose, we first transfer the model to a pro forma linear model and then introduce an artificial variable into a linear bias correction model. Based on the bias correction model, the parameters can then be consistently estimated by the linear least squares method. Both numerical studies and real data analyses are conducted to show the effectiveness of the proposed estimation procedure.
Empirical Likelihood for Single-Index Regression Models under Negatively Associated Errors

Zheng-Yan Lin,Ran Wang

DOI: https://doi.org/10.1080/03610926.2012.758746

2015-01-01

Abstract:In this article, we use bockwise empirical likelihood technique to construct confidence regions for the parameter of the single-index models under negatively associated errors. It is shown that the blockwise empirical likelihood ratio statistic for the parameter of interest is asymptotically chi(2)-type distributed. The result can be used to obtain confidence regions for the parameter of interest.
Estimation on functional partially linear single index measurement error model

Shuyu Meng,Zhensheng Huang,Jing Zhang,Zhiqiang Jiang

DOI: https://doi.org/10.1080/03610926.2021.1999979

2021-11-15

Abstract:In this article, we investigate the functional partially linear single index model when measurement error exists in covariates. The main purpose of this article is to correct the biased estimators caused by additive error and construct the asymptotic properties of unknown parameters and function in model. Asymptotic distribution of the parametric component and the convergence rates of the nonparametric part are obtained under some regularity conditions. Compared with existing literatures in this field, such as functional partially linear and semi-functional partial linear regression model with measurement error, good performance in Tecator data analysis illustrates the advantages of the model and the significance of the proposed methodology. In this process, functional slice inverse regression is applied to estimate the functional single index parameter to improve computational efficiency. Furthermore, a simulation study is also carried out for demonstration.
M-ESTIMATORS IN A PARTIAL LINEAR SINGLE-INDEX MODEL

Qingming ZOU,Zhongyi ZHU

2016-01-01

Abstract:The single-index model is an important tool in multivariate nonparametric regression.Not only it can reduce the dimension of data and avoid the so-called "curse of dimensionality" in multivariate nonparametric regression,but also can capture the main feature of high-dimensional data.This paper deals with M-estimator for the partial linear single-index model.An M-estimator procedure based on B-spline approximation is proposed in this paper.Under some mild regular conditions,the asymptotic properties of the proposed M-estimator of unknown function and the Mestimator of paramctcr are investigated.A finite sample simulation study indicates that the M-estimators proposed in this paper are robust.
Estimator of a Change Point in Single Index Models

BaiSuo Jin,CuiLing Dong,ChangChun Tan,BaiQi Miao

DOI: https://doi.org/10.1007/s11425-014-4820-4

2014-01-01

Science China Mathematics

Abstract:This paper considers the problem of change point in single index models. In order to obtain asymptotically valid confidence intervals for the estimation of the change point, the convergence rate and asymptotic distribution of the change point estimate is studied. Some simulation results are presented which show that the numerical performance of our estimator is satisfactory.
Estimating the Conditional Single-Index Error Distribution with A Partial Linear Mean Regression

Jun Zhang,Zhenghui Feng,Peirong Xu

DOI: https://doi.org/10.1007/s11749-014-0395-1

2014-01-01

Test

Abstract:In this paper, we present a method for estimating the conditional distribution function of the model error. Given the covariates, the conditional mean function is modeled as a partial linear model, and the conditional distribution function of model error is modeled as a single-index model. To estimate the single-index parameter, we propose a semi-parametric global weighted least-squares estimator coupled with an indicator function of the residuals. We derive a residual-based kernel estimator to estimate the unknown conditional distribution function. Asymptotic distributions of the proposed estimators are derived, and the residual-based kernel process constructed by the estimator of the conditional distribution function is shown to converge to a Gaussian process. Simulation studies are conducted and a real dataset is analyzed to demonstrate the performance of the proposed estimators.
Efficient Estimation for Marginal Generalized Partially Linear Single-Index Models with Longitudinal Data

Peirong Xu,Jun Zhang,Xingfang Huang,Tao Wang

DOI: https://doi.org/10.1007/s11749-015-0462-2

2015-01-01

Test

Abstract:We consider marginal generalized partially linear single-index models for longitudinal data. A profile generalized estimating equations (GEE)-based approach is proposed to estimate unknown regression parameters. Within a wide range of bandwidths for estimating the nonparametric function, our profile GEE estimator is consistent and asymptotically normal even if the covariance structure is misspecified. Moreover, if the covariance structure is correctly specified, the semiparametric efficiency can be achieved under heteroscedasticity and without distributional assumptions on the covariates. Simulation studies are conducted to evaluate the finite sample performance of the proposed procedure. The proposed methodology is further illustrated through a data analysis.
Estimation in Partially Linear Single-Index Panel Data Models With Fixed Effects

Jia Chen,Jiti Gao,Degui Li

DOI: https://doi.org/10.1080/07350015.2013.775093

2013-07-01

Journal of Business and Economic Statistics

Abstract:In this article, we consider semiparametric estimation in a partially linear single-index panel data model with fixed effects. Without taking the difference explicitly, we propose using a semiparametric minimum average variance estimation (SMAVE) based on a dummy variable method to remove the fixed effects and obtain consistent estimators for both the parameters and the unknown link function. As both the cross-section size and the time series length tend to infinity, we not only establish an asymptotically normal distribution for the estimators of the parameters in the single index and the linear component of the model, but also obtain an asymptotically normal distribution for the nonparametric local linear estimator of the unknown link function. The asymptotically normal distributions of the proposed estimators are similar to those obtained in the random effects case. In addition, we study several partially linear single-index dynamic panel data models. The methods and results are augmented by simulation studies and illustrated by application to two real data examples. This article has online supplementary materials.

statistics & probability,social sciences, mathematical methods,economics
Estimation of A Groupwise Additive Multiple-Index Model and Its Applications

Tao Wang,Jun Zhang,Hua Liang,Lixing Zhu

DOI: https://doi.org/10.5705/ss.2013.175

IF: 1.4

2015-01-01

Statistica Sinica

Abstract:In this paper, we propose a simple linear least squares framework to deal with estimation and selection for a groupwise additive multiple-index model, of which the partially linear single-index model is a special case, and in which each component function has a single-index structure. We show that, somewhat unexpectedly, all index vectors can be recovered through a single least squares coefficient vector. As a direct application, for partially linear single-index models we develop a new two-stage estimation procedure that is iterative-free and easily implemented. This estimation approach can also be applied to develop, for the semi-parametric model under study, a penalized least squares estimation and establish its asymptotic behavior in sparse and high-dimensional settings without any nonparametric treatment. A simulation study and a data analysis are presented.
Estimation and Variable Selection in Partial Linear Single Index Models with Error-Prone Linear Covariates

Jun Zhang,Xiaoguang Wang,Yao Yu,Yujie Gai

DOI: https://doi.org/10.1080/02331888.2013.800519

IF: 2.346

2014-01-01

Statistics

Abstract:We study the estimation and variable selection for a partial linear single index model (PLSIM) when some linear covariates are not observed, but their ancillary variables are available. We use the semiparametric profile least-square based estimation procedure to estimate the parameters in the PLSIM after the calibrated error-prone covariates are obtained. Asymptotic normality for the estimators are established. We also employ the smoothly clipped absolute deviation (SCAD) penalty to select the relevant variables in the PLSIM. The resulting SCAD estimators are shown to be asymptotically normal and have the oracle property. Performance of our estimation procedure is illustrated through numerous simulations. The approach is further applied to a real data example.
A Relative Error Estimation Approach for Multiplicative Single Index Model

Zhanfeng Wang,Zimu Chen,Yaohua Wu

DOI: https://doi.org/10.1007/s11424-017-5309-3

2017-01-01

Journal of Systems Science and Complexity

Abstract:As an alternative to absolute error methods, such as the least square and least absolute deviation estimations, a product relative error estimation is proposed for a multiplicative single index regression model. Regression coefficients in the model are estimated via a two-stage procedure and their statistical properties such as consistency and normality are studied. Numerical studies including simulation and a body fat example show that the proposed method performs well.
Estimation of single index model with missing response at random

Yanhua Wang,Junshan Shen,Shuyuan He,Qihua Wang

DOI: https://doi.org/10.1016/j.jspi.2009.11.017

IF: 1.095

2010-01-01

Journal of Statistical Planning and Inference

Abstract:Under missing at random, we estimate the unknown link function and the direction parameter in a single index model. The central limit theory and the convergence rate of the law of the iterated logarithm for the estimator of the direction parameter are derived, the optimal convergence rate for the estimator of the link function is obtained and simulation results support the theoretical results of the paper.
Penalized Spline Estimation for Partially Linear Single-Index Models

Yan Yu,David Ruppert

DOI: https://doi.org/10.1198/016214502388618861

IF: 4.369

2002-12-01

Journal of the American Statistical Association

Abstract:Single-index models are potentially important tools for multivariate nonparametric regression. They generalize linear regression by replacing the linear combination α0Tx with a nonparametric component, η0(α0Tx), where η0(·) is an unknown univariate link function. By reducing the dimensionality from that of a general covariate vector x to a univariate index α0Tx, single-index models avoid the so-called “curse of dimensionality.” We propose penalized spline (P-spline) estimation of η0(·) in partially linear single-index models, where the mean function has the form η0(α0Tx) + β 0Tz. The P-spline approach offers a number of advantages over other fitting methods for single-index models. All parameters in the P-spline single-index model can be estimated simultaneously by penalized nonlinear least squares. As a direct least squares fitting method, our approach is rapid and computationally stable. Standard nonlinear least squares software can be used. Moreover, joint inference for η0(·), α0, and β0 is possible by standard estimating equations theory such as the sandwich formula for the joint covariance matrix. Using asymptotics where the number of knots is fixed, though potentially large, we show √n consistency and asymptotic normality of the estimators of all parameters. These asymptotic results permit joint inference for the parameters. Several examples illustrate that the model and proposed estimation methodology can be effective in practice. We investigate inference based on the sandwich estimate through a Monte Carlo study. GeneralLq penalty functions can be readily implemented.

statistics & probability
Variable Selection for the Partial Linear Single-Index Model

Wu Wang,Zhong-yi Zhu

DOI: https://doi.org/10.1007/s10255-017-0666-1

2017-01-01

Acta Mathematicae Applicatae Sinica English Series

Abstract:In this paper, we consider the issue of variable selection in partial linear single-index models under the assumption that the vector of regression coefficients is sparse. We apply penalized spline to estimate the nonparametric function and SCAD penalty to achieve sparse estimates of regression parameters in both the linear and single-index parts of the model. Under some mild conditions, it is shown that the penalized estimators have oracle property, in the sense that it is asymptotically normal with the same mean and covariance that they would have if zero coefficients are known in advance. Our model owns a least square representation, therefore standard least square programming algorithms can be implemented without extra programming efforts. In the meantime, parametric estimation, variable selection and nonparametric estimation can be realized in one step, which incredibly increases computational stability. The finite sample performance of the penalized estimators is evaluated through Monte Carlo studies and illustrated with a real data set.
Partial index additive models with additive distortion measurement errors

Jun Zhang,Sanying Feng,Yujie Gai

DOI: https://doi.org/10.1080/03610918.2020.1757712

2020-05-05

Abstract:This paper considers the estimation for a partial index additive regression model, when the response variable and covariates in the index part are observed with additive distortion measurement errors. For the index parameter, the dimension-reduction based estimators with or without additive distortion measurement errors are proposed. This new estimation method is further adopted to the partial linear models for parameter estimation. We study the asymptotic properties of the proposed estimators. Simulation studies are conducted to compare the proposed estimation methods.
Estimation and Variable Selection for Single-Index Models with Non Ignorable Missing Data

Yue Wang,Xiaohui Yuan,Chunjie Wang

DOI: https://doi.org/10.1080/03610926.2023.2198625

2024-01-01

Abstract:This article investigates the estimation and variable selection procedures of single-index models when the data have non ignorable response. For estimation of the index coefficients, a new procedure based on martingale difference divergence is developed. Consistency and asymptotic normality of the proposed estimators are established. The finite sample performance of the proposed procedure is assessed through extensive simulation studies. Finally, we illustrate the proposed method through a real body fat data set.
Efficient penalized estimating method in the partially varying-coefficient single-index model

Zhensheng Huang,Bingqing Lin,Fan Feng,Zhen Pang

DOI: https://doi.org/10.1016/j.jmva.2012.07.011

IF: 1.387

2013-01-01

Journal of Multivariate Analysis

Abstract:In this paper, penalized estimating equations are proposed to estimate the index parametric components, which is of primary interest, in the partially varying-coefficient single-index models (PVCSIMs). Although some procedures have been developed to estimate the index parameter in PVCSIM, the problem of how to conduct variable selection for the index in such models has not been addressed to date. To solve this problem, we propose a class of efficient penalized estimating equations, which combine the smoothly clipped absolute deviation (SCAD) penalty and a stepwise estimation method. The proposed method can simultaneously select significant variables in the index and estimate the nonzero smooth coefficient parameters. Under suitable conditions, we establish the theoretical properties of our penalized estimating procedure, including the oracle properties and the asymptotic normality for the resulting penalized estimation. We evaluate the performance of the proposed method by using Monte Carlo simulations and the application to a real dataset.
Doubly robust and efficient estimators for heteroscedastic partially linear single-index models allowing high dimensional covariates

Yanyuan Ma,Liping Zhu

DOI: https://doi.org/10.1111/j.1467-9868.2012.01040.x

Abstract:We study the heteroscedastic partially linear single-index model with an unspecified error variance function, which allows for high dimensional covariates in both the linear and the single-index components of the mean function. We propose a class of consistent estimators of the parameters by using a proper weighting strategy. An interesting finding is that the linearity condition which is widely assumed in the dimension reduction literature is not necessary for methodological or theoretical development: it contributes only to the simplification of non-optimal consistent estimation. We also find that the performance of the usual weighted least square type of estimators deteriorates when the non-parametric component is badly estimated. However, estimators in our family automatically provide protection against such deterioration, in that the consistency can be achieved even if the baseline non-parametric function is completely misspecified. We further show that the most efficient estimator is a member of this family and can be easily obtained by using non-parametric estimation. Properties of the estimators proposed are presented through theoretical illustration and numerical simulations. An example on gender discrimination is used to demonstrate and to compare the practical performance of the estimators.
Single-index relative error regression models

Yujie Gai,Jun Zhang

DOI: https://doi.org/10.1080/03610918.2021.1982972

2021-09-30

Abstract:We consider the estimation and hypothesis test for single-index model by proposing a profile mean squares relative error estimation method, coupling with a leave-one-component-out method. The asymptotic normality for the PMSRE estimator is studied. For the hypothesis test of the single-index parameter, a restricted estimator under the null hypothesis and test statistics are proposed. The asymptotic properties for the restricted estimator and test statistic are established. Lastly, we make some comparisons between the proposed estimator and the profile least squares estimator and the profile least product relative estimator through the simulation. Our simulation studies indicate that the profile mean squares relative error estimator provides a better alternative under some settings, particularly for multimodal or asymmetric distributions of the error term.
Estimation and hypothesis test for varying coefficient single-index multiplicative models

Jun Zhang,Xuehu Zhu,Gaorong Li

DOI: https://doi.org/10.1080/00949655.2024.2359563

IF: 1.225

2024-05-31

Journal of Statistical Computation and Simulation

Abstract:Estimation and hypothesis test for varying coefficient single-index multiplicative models are considered in this paper. To estimate an unknown single-index parameter, a profile product relative error estimation is proposed for the single-index parameter with a leave-one-component-out estimation method. A Wald-type test statistic is proposed to test a linear hypothesis test of the single-index. We employ the smoothly clipped absolute deviation penalty to simultaneously select variables and estimate regression coefficients. To study the model checking problem, we propose a variant of the integrated conditional moment test statistic by using a linear projection weighting function, and we also suggest a bootstrap procedure for calculating critical values. Simulation studies are conducted to demonstrate the performance of the proposed procedure and a real example is analysed for illustration.

statistics & probability,computer science, interdisciplinary applications

Estimation for a Partial-Linear Single-Index Model

Estimation for Biased Partial Linear Single Index Models

Empirical Likelihood for Single-Index Regression Models under Negatively Associated Errors

Estimation on functional partially linear single index measurement error model

M-ESTIMATORS IN A PARTIAL LINEAR SINGLE-INDEX MODEL

Estimator of a Change Point in Single Index Models

Estimating the Conditional Single-Index Error Distribution with A Partial Linear Mean Regression

Efficient Estimation for Marginal Generalized Partially Linear Single-Index Models with Longitudinal Data

Estimation in Partially Linear Single-Index Panel Data Models With Fixed Effects

Estimation of A Groupwise Additive Multiple-Index Model and Its Applications

Estimation and Variable Selection in Partial Linear Single Index Models with Error-Prone Linear Covariates

A Relative Error Estimation Approach for Multiplicative Single Index Model

Estimation of single index model with missing response at random

Penalized Spline Estimation for Partially Linear Single-Index Models

Variable Selection for the Partial Linear Single-Index Model

Partial index additive models with additive distortion measurement errors

Estimation and Variable Selection for Single-Index Models with Non Ignorable Missing Data

Efficient penalized estimating method in the partially varying-coefficient single-index model

Doubly robust and efficient estimators for heteroscedastic partially linear single-index models allowing high dimensional covariates

Single-index relative error regression models

Estimation and hypothesis test for varying coefficient single-index multiplicative models