Estimation and inference of semi-varying coefficient models with heteroscedastic errors

ShenSi-Lian,CuiJian-Ling,MeiChang-Lin,WangChun-Wei

IF: 1.387

2014-01-01

Journal of Multivariate Analysis

Abstract:This article focuses on the estimation of the parametric component, which is of primary interest, in semi-varying coefficient models with heteroscedastic errors. Specifically, we first present a pr...

What problem does this paper attempt to address?

Expectile regression for analyzing heteroscedasticity in high dimension

Jun Zhao,Yingyu Chen,Yi Zhang

DOI: https://doi.org/10.1016/j.spl.2018.02.006

IF: 0.718

2018-01-01

Statistics & Probability Letters

Abstract:High-dimensional data often display heteroscedasticity and this feature has attracted a lot of attention and discussion. In this paper, we propose regularized expectile regression with SCAD penalty for analyzing heteroscedasticity in high dimension when the error has finite moments. Since the corresponding optimization problem is nonconvex due to the SCAD penalty, we adopt the CCCP (coupling of the concave and convex procedure) algorithm to solve this problem. Under some regular conditions, we can prove that with probability tending to one, the proposed algorithm converges to the oracle estimator after several iterations. We should address that the higher order moment the error has, the higher dimension cardinality our procedure can handle with. If the error follows gaussian or sub-gaussian distribution, our method can be extended to deal with ultra high-dimensional data. Furthermore, by taking different expectile weight level α, we are able to detect heteroscedasticity and explore the entire conditional distribution of the response variable given all the covariates. We investigate the performances of our proposed method through Monte Carlo simulation study and real application and the numerical results show that the resulting estimator by our algorithm enjoys good performance and demonstrate the usefulness of our proposed method to analyze heteroscedasticity.
Statistical inference in partially time-varying coefficient models

degui li,jia chen,zhengyan lin

DOI: https://doi.org/10.1016/j.jspi.2010.09.004

IF: 1.095

2011-01-01

Journal of Statistical Planning and Inference

Abstract:A partially time-varying coefficient time series model is introduced to characterize the nonlinearity and trending phenomenon. To estimate the regression parameter and the nonlinear coefficient function, the profile least squares approach is applied with the help of local linear approximation. The asymptotic distributions of the proposed estimators are established under mild conditions. Meanwhile, the generalized likelihood ratio test is studied and the test statistics are demonstrated to follow asymptotic χ2-distribution under the null hypothesis. Furthermore, some extensions of the proposed model are discussed and several numerical examples are provided to illustrate the finite sample behavior of the proposed methods.
Model Averaging Estimation for Nonparametric Varying-Coefficient Models with Multiplicative Heteroscedasticity

Xianwen Sun,Lixin Zhang

DOI: https://doi.org/10.1007/s00362-023-01447-8

2024-01-01

Statistical Papers

Abstract:In the last few years, frequentist model averaging has received more and more attention. However, the majority of related work focuses on the parametric model setup and devotes more energy to different mean structures but ignores the form of variance. In this paper, we consider a regression model with the mean being a varying-coefficient model and the variance being multiplicative heteroscedasticity and introduce a model averaging approach that uses the B-spline smoothing method to estimate unknown coefficient functions and obtains the estimators of unknown parameters in both the mean and variance functions of the model by the maximum likelihood method. The resulting model averaging estimator is proved to have asymptotic optimality under some regular conditions. Simulation experiments are conducted to compare the performance of our method with that of other common heteroscedasticity-robust model selection and model averaging methods under the finite-sample case. Our method is also verified in a real dataset.
Efficient estimation of partially linear varying coefficient models

wei long,min ouyang,ying shang

DOI: https://doi.org/10.1016/j.econlet.2013.07.010

IF: 1.469

2013-01-01

Economics Letters

Abstract:In this paper, we consider the problem of estimating a semiparametric partially linear varying coefficient model. We derive the semiparametric efficiency bound for the asymptotic variance of the finite-dimensional parameter estimator. We also propose an efficient estimator for estimating the finite-dimensional parameter of the model. Simulation results show substantial efficiency gain of our proposed estimator over a conventional estimator as considered in Ahmad et al. (2005).
ESTIMATION IN A SEMIPARAMETRIC MONOTONE VARYING COEFFICIENT PARTIALLY LINEAR MODEL WITH ERRORS IN VARIABLES

LIANG Baosheng,HU Tao,CUI Hengjian,TONG Xingwei

2013-01-01

Abstract:The estimators of both parameters and monotone regression function of a semiparametric monotone varying coefficient partially linear EV model are given via our monotone modified profile least square method.Some properties of the estimators are also given.Finally,simulations results show feasibility of the proposed method,and comparisons are made between the proposed method and profile least square method.
Doubly robust and efficient estimators for heteroscedastic partially linear single-index models allowing high dimensional covariates

Yanyuan Ma,Liping Zhu

DOI: https://doi.org/10.1111/j.1467-9868.2012.01040.x

Abstract:We study the heteroscedastic partially linear single-index model with an unspecified error variance function, which allows for high dimensional covariates in both the linear and the single-index components of the mean function. We propose a class of consistent estimators of the parameters by using a proper weighting strategy. An interesting finding is that the linearity condition which is widely assumed in the dimension reduction literature is not necessary for methodological or theoretical development: it contributes only to the simplification of non-optimal consistent estimation. We also find that the performance of the usual weighted least square type of estimators deteriorates when the non-parametric component is badly estimated. However, estimators in our family automatically provide protection against such deterioration, in that the consistency can be achieved even if the baseline non-parametric function is completely misspecified. We further show that the most efficient estimator is a member of this family and can be easily obtained by using non-parametric estimation. Properties of the estimators proposed are presented through theoretical illustration and numerical simulations. An example on gender discrimination is used to demonstrate and to compare the practical performance of the estimators.
Estimation of Semi-Parametric Additive Coefficient Model

Lan Xue,Lijian Yang

DOI: https://doi.org/10.1016/j.jspi.2004.11.003

IF: 1.095

2004-01-01

Journal of Statistical Planning and Inference

Abstract:In the multivariate regression setting, we propose a flexible varying coefficient model in which the regression coefficients of some predictors are additive functions of other predictors. Marginal integration estimators of the coefficients are developed and their asymptotic properties investigated. Under β-mixing, it is found that the estimators of the parameters in the regression coefficients have rate of convergence 1/n, and the nonparametric additive components are estimated at the same rate of convergence as in univariate smoothing. A data-driven bandwidth selection method is developed based on asymptotic considerations. Its effectiveness is confirmed in a Monte-Carlo study. The procedure is applied to the real German GNP and Wolf's Sunspot data, where the semi-parametric additive coefficient model demonstrates superior performance in terms of out-of-sample forecasts.
Efficient Estimation for Semivarying-Coefficient Models

Yingcun Xia,Wenyang Zhang,Howell Tong

DOI: https://doi.org/10.1093/biomet/91.3.661

IF: 3.0279

2004-01-01

Biometrika

Abstract:Motivated by two practical problems, we propose a new procedure for estimating a semivarying‐coefficient model. Asymptotic properties are established which show that the bias of the parameter estimator is of order h3 when a symmetric kernel is used, where h is the bandwidth, and the variance is of order n−1 and efficient in the semiparametric sense. Undersmoothing is unnecessary for the root‐n consistency of the estimators. Therefore, commonly used bandwidth selection methods can be employed. A model selection method is also developed. Simulations demonstrate how the proposed method works. Some insights are obtained into the two motivating problems by using the proposed models.
Semi-supervised estimation for the varying coefficient regression model

Peng Lai,Wenxin Tian,Yanqiu Zhou

DOI: https://doi.org/10.3934/math.2024004

2024-01-01

AIMS Mathematics

Abstract:In many cases, the 'labeled' outcome is difficult to observe and may require a complicated or expensive procedure, and the predictor information is easy to be obtained. We propose a semi-supervised estimator for the one-dimensional varying coefficient regression model which improves the conventional supervised estimator by using the unlabeled data efficiently. The semi-supervised estimator is proposed by introducing the intercept model and its asymptotic properties are proven. The Monte Carlo simulation studies and a real data example are conducted to examine the finite sample performance of the proposed procedure.

mathematics, applied
Efficient estimation in semivarying coefficient models for longitudinal/clustered data

Ming-Yen Cheng,Toshio Honda,Jialiang Li

DOI: https://doi.org/10.48550/arXiv.1501.00538

2015-09-13

Abstract:In semivarying coefficient models for longitudinal/clustered data, usually of primary interest is usually the parametric component which involves unknown constant coefficients. First, we study semiparametric efficiency bound for estimation of the constant coefficients in a general setup. It can be achieved by spline regression provided that the within-cluster covariance matrices are all known, which is an unrealistic assumption in reality. Thus, we propose an adaptive estimator of the constant coefficients when the covariance matrices are unknown and depend only on the index random variable, such as time, and when the link function is the identity function. After preliminary estimation, based on working independence and both spline and local linear regression, we estimate the covariance matrices by applying local linear regression to the resulting residuals. Then we employ the covariance matrix estimates and spline regression to obtain our final estimators of the constant coefficients. The proposed estimator achieves the semiparametric efficiency bound under normality assumption, and it has the smallest covariance matrix among a class of estimators even when normality is violated. We also present results of numerical studies. The simulation results demonstrate that our estimator is superior to the one based on working independence. When applied to the CD4 count data, our method identifies an interesting structure that was not found by previous analyses.

Methodology
Estimation of a Semiparametric Varying-Coefficient Mixed Regressive Spatial Autoregressive Model

Yanqing Sun,Yuanqing Zhang,Jianhua Z Huang

DOI: https://doi.org/10.1016/j.ecosta.2017.05.005

Abstract:A semiparametric varying-coefficient mixed regressive spatial autoregressive model is used to study covariate effects on spatially dependent responses, where the effects of some covariates are allowed to vary with other variables. A semiparametric series-based least squares estimating procedure is proposed with the introduction of instrumental variables and series approximations of the conditional expectations. The estimators for both the nonparametric and parametric components of the model are shown to be consistent and their asymptotic distributions are derived. The proposed estimators perform well in simulations. The proposed method is applied to analyze a data set on teen pregnancy to investigate effects of neighborhood as well as other social and economic factors on the teen pregnancy rate.
Empirical likelihood for single-index varying-coefficient models

Liugen Xue,Qihua Wang

DOI: https://doi.org/10.3150/11-BEJ365

2012-07-25

Abstract:In this paper, we develop statistical inference techniques for the unknown coefficient functions and single-index parameters in single-index varying-coefficient models. We first estimate the nonparametric component via the local linear fitting, then construct an estimated empirical likelihood ratio function and hence obtain a maximum empirical likelihood estimator for the parametric component. Our estimator for parametric component is asymptotically efficient, and the estimator of nonparametric component has an optimal convergence rate. Our results provide ways to construct the confidence region for the involved unknown parameter. We also develop an adjusted empirical likelihood ratio for constructing the confidence regions of parameters of interest. A simulation study is conducted to evaluate the finite sample behaviors of the proposed methods.

Statistics Theory
The rates of strong consistency for estimators in heteroscedastic partially linear errors-in-variables model for widely orthant dependent samples

Yi Wu,Xuejun Wang,Aiting Shen

DOI: https://doi.org/10.1080/15326349.2024.2353062

2024-06-03

Stochastic Models

Abstract:In this article, some general results on the rates of strong consistency for the least squares estimators and weighted least squares estimators in heteroscedastic partially linear errors-in-variables model based on widely orthant dependent random errors are presented. The results can deduce strong consistency and convergence rates under some mild conditions. Some numerical simulations are also provided to support the theoretical results.

statistics & probability
Quantile Regression in Partially Linear Varying Coefficient Models

Huixia Judy Wang,Zhongyi Zhu,Jianhui Zhou

DOI: https://doi.org/10.1214/09-aos695

2009-01-01

The Annals of Statistics

Abstract:Semiparametric models are often considered for analyzing longitudinal data for a good balance between flexibility and parsimony. In this paper, we study a class of marginal partially linear quantile models with possibly varying coefficients. The functional coefficients are estimated by basis function approximations. The estimation procedure is easy to implement, and it requires no specification of the error distributions. The asymptotic properties of the proposed estimators are established for the varying coefficients as well as for the constant coefficients. We develop rank score tests for hypotheses on the coefficients, including the hypotheses on the constancy of a subset of the varying coefficients. Hypothesis testing of this type is theoretically challenging, as the dimensions of the parameter spaces under both the null and the alternative hypotheses are growing with the sample size. We assess the finite sample performance of the proposed method by Monte Carlo simulation studies, and demonstrate its value by the analysis of an AIDS data set, where the modeling of quantiles provides more comprehensive information than the usual least squares approach.
Shrinkage Estimation of the Varying Coefficient Model

Hansheng Wang,Yingcun Xia

DOI: https://doi.org/10.1198/jasa.2009.0138

2008-01-01

Abstract:The varying coefficient model is a useful extension of the linear regression model. Nevertheless, how to conduct variable selection for the varying coefficient model in a computationally efficient manner is poorly understood. To solve the problem, we propose here a novel method, which combines the ideas of the local polynomial smoothing (Fan and Zhang, 1999) and the shrinkage estimation (Tibshirani, 1996, LASSO). The new method can do nonparametric estimation and variable selection simultaneously. With a local constant estimator and the adaptive LASSO penalty, the new method can identify the true model consistently, and that the resulting estimator can be as efficient as the oracle estimator (Fan and Li, 2001). Numerical studies clearly confirm our theories. Extension to other shrinkage methods (e.g., the SCAD) and other smoothing methods (Zhang and Lin, 2003) is straightforward.
Estimation in a class of nonlinear heteroscedastic time series models

Joseph Ngatchou-Wandji

DOI: https://doi.org/10.1214/07-EJS157

2008-02-01

Abstract:Parameter estimation in a class of heteroscedastic time series models is investigated. The existence of conditional least-squares and conditional likelihood estimators is proved. Their consistency and their asymptotic normality are established. Kernel estimators of the noise's density and its derivatives are defined and shown to be uniformly consistent. A simulation experiment conducted shows that the estimators perform well for large sample size.

Statistics Theory
On a Principal Varying Coefficient Model

Qian Jiang,Hansheng Wang,Yingcun Xia,Guohua Jiang

DOI: https://doi.org/10.1080/01621459.2012.736904

IF: 4.369

2012-01-01

Journal of the American Statistical Association

Abstract:We propose a novel varying coefficient model (VCM), called principal varying coefficient model (PVCM), by characterizing the varying coefficients through linear combinations of a few principal functions. Compared with the conventional VCM, PVCM reduces the actual number of nonparametric functions and thus has better estimation efficiency. Compared with the semivarying coefficient model (SVCM), PVCM is more flexible but with the same estimation efficiency when the number of principal functions in PVCM and the number of varying coefficients in SVCM are the same. Model estimation and identification are investigated, and the better estimation efficiency is justified theoretically. Incorporating the estimation with the L-1 penalty, variables in the linear combinations can be selected automatically, and hence, the estimation efficiency can be further improved. Numerical experiments suggest that the model together with the estimation method is useful even when the number of covariates is large. Supplementary materials for this article are available online.
Empirical likelihood and estimation in a partially linear varying coefficient model with right censored data

Liugen G. Xue,Liugen G. XueSchool of Mathematics and Statistics,Henan University,Kaifeng,People's Republic of China

DOI: https://doi.org/10.1080/02331888.2024.2317776

IF: 2.346

2024-02-27

Statistics

Abstract:In this paper, we study the empirical likelihood and estimation of parameters of interest in a partially linear varying coefficient model with right censored data. Two cases are considered: censoring is independent of the covariates, and censoring depends on the covariates. The bias-corrected empirical log-likelihood ratios for the regression parameters are presented, Wilks' theorem is proved, and thus the confidence regions of the regression parameters are constructed. The estimators of parametric and nonparametric components are constructed, their asymptotic distributions are obtained, and the consistent estimators of the asymptotic variances are also given. Furthermore, the partial profile empirical log-likelihood ratios for each component of the regression parameters and the coefficient functions are constructed, and show they are asymptotically chi-squared. The obtained results can be directly used to construct the confidence regions/intervals for the regression parameters and the pointwise confidence intervals for the coefficient functions. Our approach is to directly calibrate the empirical log-likelihood ratio so that the resulting ratio is asymptotically chi-squared, undersmoothing of the coefficient functions is avoided, and existing data-driven methods can be effectively used to select the optimal bandwidth. Simulation studies compare the empirical likelihood method with one based on normal approximation and perform real data analysis.

statistics & probability
Variable selection for semivarying coefficient models via local averaging

Xinyi Qi,Mengjie Liu,Chuanlong Xie,Heng Peng

DOI: https://doi.org/10.1002/sta4.703

2024-06-06

Stat

Abstract:This study aims to provide novel insights into variable selection in the semivarying coefficient model. We focus on the problem of variable selection and screening for the constant coefficient part. A common approach in the existing literature is to infer the constant coefficients by transforming the problem into a linear model scenario, utilizing a fine estimator of the varying coefficients. In this paper, we propose an approximation method for the varying coefficient functions using local averaging, which is characterized by its simplicity, rough and computational efficiency. Additionally, we introduce an adaptive lasso estimator and a forward regression algorithm specifically designed for semivarying coefficient models. Theoretical and experimental results highlight the effectiveness of the local averaging method in extending variable selection techniques from the linear model to the semivarying coefficient model. Our proposed approaches demonstrate a significant improvement in inference speed compared with baseline methods, with little loss of asymptotic efficiency.

statistics & probability
Varying-Coefficient Panel Data Models With Nonstationarity and Partially Observed Factor Structure

Chaohua Dong,Jiti Gao,Bin Peng

DOI: https://doi.org/10.1080/07350015.2020.1721294

2020-02-21

Journal of Business and Economic Statistics

Abstract:In this article, we study a varying-coefficient panel data model with both nonstationarity and partially observed factor structure. Two approaches are proposed. The first approach proposed in the main text considers a sieve based method to estimate the unknown coefficients as well as the factors and loading functions simultaneously, while the second approach proposed in the online supplementary document involving the principal component analysis provides an alternative estimation method. We establish asymptotic properties for them, compare the asymptotic efficiency of the two estimation methods and examine the theoretical findings through extensive Monte Carlo simulations. In an empirical study, we use our newly proposed model and the first method to study the returns to scale of large U.S. commercial banks, where some overlooked modeling issues in the literature of production econometrics are addressed. Supplementary materials for this article are available online.

statistics & probability,social sciences, mathematical methods,economics

Estimation and inference of semi-varying coefficient models with heteroscedastic errors

Expectile regression for analyzing heteroscedasticity in high dimension

Statistical inference in partially time-varying coefficient models

Model Averaging Estimation for Nonparametric Varying-Coefficient Models with Multiplicative Heteroscedasticity

Efficient estimation of partially linear varying coefficient models

ESTIMATION IN A SEMIPARAMETRIC MONOTONE VARYING COEFFICIENT PARTIALLY LINEAR MODEL WITH ERRORS IN VARIABLES

Doubly robust and efficient estimators for heteroscedastic partially linear single-index models allowing high dimensional covariates

Estimation of Semi-Parametric Additive Coefficient Model

Efficient Estimation for Semivarying-Coefficient Models

Semi-supervised estimation for the varying coefficient regression model

Efficient estimation in semivarying coefficient models for longitudinal/clustered data

Estimation of a Semiparametric Varying-Coefficient Mixed Regressive Spatial Autoregressive Model

Empirical likelihood for single-index varying-coefficient models

The rates of strong consistency for estimators in heteroscedastic partially linear errors-in-variables model for widely orthant dependent samples

Quantile Regression in Partially Linear Varying Coefficient Models

Shrinkage Estimation of the Varying Coefficient Model

Estimation in a class of nonlinear heteroscedastic time series models

On a Principal Varying Coefficient Model

Empirical likelihood and estimation in a partially linear varying coefficient model with right censored data

Variable selection for semivarying coefficient models via local averaging

Varying-Coefficient Panel Data Models With Nonstationarity and Partially Observed Factor Structure