The effects of olanzapine, risperidone, and haloperidol on plasma prolactin levels in patients with schizophrenia.

S. David,C. C. Taylor,B. Kinon,A. Breier

DOI: https://doi.org/10.1016/S0149-2918(00)80086-7

IF: 3.637

2000-09-01

Clinical Therapeutics

Abstract:

What problem does this paper attempt to address?

Variable selection in partially time-varying coefficient models

Degui Li,Jia Chen,Zhengyan Lin

DOI: https://doi.org/10.1080/10485250902912694

2009-01-01

Journal of Nonparametric Statistics

Abstract:A partially time-varying coefficient model is introduced to characterise the nonlinearity and trending phenomenon. To enhance predictability and to select significant variables in the parametric component of the model, the penalised least squares method with the help of the profile local linear technique is developed in this article. The convergence rate and the oracle property of the resulting estimator are established under mild conditions. A remarkable achievement of our results is that it does not require undersmoothing of the nonparametric component. Meanwhile, some extensions of the proposed model and method are also discussed. Furthermore, some numerical examples are provided to show that our theory and method work well in practice.
Variable selection for partially linear models via Bayesian subset modeling with diffusing prior

Jia Wang,Xizhen Cai,Runze Li

DOI: https://doi.org/10.1016/j.jmva.2021.104733

Abstract:Most existing methods of variable selection in partially linear models (PLM) with ultrahigh dimensional covariates are based on partial residuals, which involve a two-step estimation procedure. While the estimation error produced in the first step may have an impact on the second step, multicollinearity among predictors adds additional challenges in the model selection procedure. In this paper, we propose a new Bayesian variable selection approach for PLM. This new proposal addresses those two issues simultaneously as (1) it is a one-step method which selects variables in PLM, even when the dimension of covariates increases at an exponential rate with the sample size, and (2) the method retains model selection consistency, and outperforms existing ones in the setting of highly correlated predictors. Distinguished from existing ones, our proposed procedure employs the difference-based method to reduce the impact from the estimation of the nonparametric component, and incorporates Bayesian subset modeling with diffusing prior (BSM-DP) to shrink the corresponding estimator in the linear component. The estimation is implemented by Gibbs sampling, and we prove that the posterior probability of the true model being selected converges to one asymptotically. Simulation studies support the theory and the efficiency of our methods as compared to other existing ones, followed by an application in a study of supermarket data.
Maximum Likelihood Estimators in a Two Step Model for PLS

Ying Li,Dietrich von Rosen

DOI: https://doi.org/10.1080/03610926.2011.607531

2012-01-01

Abstract:Univariate partial least squares regression (PLS1) is a method of modeling relationships between a response variable and explanatory variables, especially when the explanatory variables are almost collinear. The purpose is to predict a future response observation, although in many applications there is an interest to understand the contributions of each explanatory variable. It is an algorithmic approach. In this article, we are going to use the algorithm presented by Helland (1988). The population PLS predictor is linked to a linear model including a Krylov design matrix and a two-step estimation procedure. For the first step, the maximum likelihood approach is applied to a specific multivariate linear model, generating tools for evaluating the information in the explanatory variables. It is shown that explicit maximum likelihood estimators of the dispersion matrix can be obtained where the dispersion matrix, besides representing the variation in the error, also includes the Krylov structured design matrix describing the mean.
Least squares support vector machine based partially linear model identification

You-Feng Li,Li-Juan Li,Hong-Ye Su,Jian Chu

DOI: https://doi.org/10.1007/11816157_94

2006-01-01

Abstract:A nonlinear identification method was proposed for a class of partially linear models (PLM) which consist of a linear component summed with a nonlinear component in nonlinear ARX form. The method extends the standard least squares support vector machine (LSSVM) by replacing the equality constraint in the standard LSSVM with a PLM model. To guarantee the uniqueness of the linear coefficients, we imposed an additional explicit constraint on the feature map instead of an implicit constraint on the regressor vectors. Therefore the resulting PLM is a generalized version of the original one. Two examples show the effectiveness of the presented method.
Variable Selection for Generalized Varying Coefficient Partially Linear Models with Diverging Number of Parameters

Zheng-yan Lin,Yu-ze Yuan

DOI: https://doi.org/10.1007/s10255-011-0071-0

2012-01-01

Abstract:Semiparametric models with diverging number of predictors arise in many contemporary scientific areas. Variable selection for these models consists of two components: model selection for non-parametric components and selection of significant variables for the parametric portion. In this paper, we consider a variable selection procedure by combining basis function approximation with SCAD penalty. The proposed procedure simultaneously selects significant variables in the parametric components and the nonparametric components. With appropriate selection of tuning parameters, we establish the consistency and sparseness of this procedure.
Estimation and Variable Selection in Partial Linear Single Index Models with Error-Prone Linear Covariates

Jun Zhang,Xiaoguang Wang,Yao Yu,Yujie Gai

DOI: https://doi.org/10.1080/02331888.2013.800519

IF: 2.346

2014-01-01

Statistics

Abstract:We study the estimation and variable selection for a partial linear single index model (PLSIM) when some linear covariates are not observed, but their ancillary variables are available. We use the semiparametric profile least-square based estimation procedure to estimate the parameters in the PLSIM after the calibrated error-prone covariates are obtained. Asymptotic normality for the estimators are established. We also employ the smoothly clipped absolute deviation (SCAD) penalty to select the relevant variables in the PLSIM. The resulting SCAD estimators are shown to be asymptotically normal and have the oracle property. Performance of our estimation procedure is illustrated through numerous simulations. The approach is further applied to a real data example.
Feature screening and variable selection for partially linear models with ultrahigh-dimensional longitudinal data

Jingyuan Liu

DOI: https://doi.org/10.1016/j.neucom.2015.09.122

IF: 6

2016-06-01

Neurocomputing

Abstract:This paper is concerned with longitudinal partially linear models (LPLM) with ultrahigh-dimensional covariates and predictors. As flexible extension of linear regression models by allowing nonparametric intercept function to capture the overall trend over time, the LPLM are expected to be highly potential statistical models for analyzing high-dimensional longitudinal data such as longitudinal genetic data and functional magnetic resonance image data. Feature screening and variable selection are indispensable for LPLM in the presence of ultrahigh-dimensional covariates such as genetic markers and all pixels in image data. This paper proposes a two-stage variable selection procedure that consists of a quick screening stage and a post-screening refining stage, for the ultrahigh dimensional longitudinal partially linear models. The proposed approach is based on the partial residual method for dealing with the nonparametric baseline function. We establish the sure screening property of the proposed screening procedure in the first stage. Simulation results demonstrate the validity of this two-stage method. We further demonstrate the proposed methodology by an empirical analysis of a real data set collected in a soybean plant longitudinal genetic study.

computer science, artificial intelligence
A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Hu Yang,Ning Li,Jing Yang

DOI: https://doi.org/10.1007/s00362-018-1013-1

2018-05-21

Statistical Papers

Abstract:In this paper, a new robust and efficient estimation approach based on local modal regression is proposed for partially linear models with large-dimensional covariates. We show that the resulting estimators for both parametric and nonparametric components are more efficient in the presence of outliers or heavy-tail error distribution, and as asymptotically efficient as the corresponding least squares estimators when there are no outliers and the error distribution is normal. We also establish the asymptotic properties of proposed estimators when the covariate dimension diverges at the rate of on\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$o\left( {\sqrt{n} } \right) \mathrm{{ }}$$\end{document}. To achieve sparsity and enhance interpretability, we develop a variable selection procedure based on SCAD penalty to select significant parametric covariates and show that the method enjoys the oracle property under mild regularity conditions. Moreover, we propose a practical modified MEM algorithm for the proposed procedures. Some Monte Carlo simulations and a real data are conducted to illustrate the finite sample performance of the proposed estimators. Finally, based on the idea of sure independence screening procedure proposed by Fan and Lv (J R Stat Soc 70:849–911, 2008), a robust two-step approach is introduced to deal with ultra-high dimensional data.

statistics & probability
Variable Selection for the Partial Linear Single-Index Model

Wu Wang,Zhong-yi Zhu

DOI: https://doi.org/10.1007/s10255-017-0666-1

2017-01-01

Acta Mathematicae Applicatae Sinica English Series

Abstract:In this paper, we consider the issue of variable selection in partial linear single-index models under the assumption that the vector of regression coefficients is sparse. We apply penalized spline to estimate the nonparametric function and SCAD penalty to achieve sparse estimates of regression parameters in both the linear and single-index parts of the model. Under some mild conditions, it is shown that the penalized estimators have oracle property, in the sense that it is asymptotically normal with the same mean and covariance that they would have if zero coefficients are known in advance. Our model owns a least square representation, therefore standard least square programming algorithms can be implemented without extra programming efforts. In the meantime, parametric estimation, variable selection and nonparametric estimation can be realized in one step, which incredibly increases computational stability. The finite sample performance of the penalized estimators is evaluated through Monte Carlo studies and illustrated with a real data set.
Quantile regression and variable selection of partial linear single-index model

Yazhao Lv,Riquan Zhang,Weihua Zhao,Jicai Liu

DOI: https://doi.org/10.1007/s10463-014-0457-x

2014-03-30

Annals of the Institute of Statistical Mathematics

Abstract:Partial linear single-index model (PLSIM) is a flexible and applicable model when investigating the underlying relationship between the response and the multivariate covariates. Most previous studies on PLSIM concentrated on mean regression, based on least square or likelihood approach. In contrast to this method, in this paper, we propose minimizing average check loss estimation (MACLE) procedure to conduct quantile regression of PLSIM. We construct an initial consistent quantile regression estimator of the parametric part base multi-dimensional kernels, and further promote the estimation efficiency to the optimal rate. We discuss the optimal bandwidth selection method and establish the asymptotic normality of the proposed MACLE estimators. Furthermore, we consider an adaptive lasso penalized variable selection method and establish its oracle property. Simulation studies with various distributed error and a real data analysis are conducted to show the promise of our proposed methods.

statistics & probability
Variable Selection for Generalized Linear Model with Highly Correlated Covariates

Yue, Li Li,Wang, Wei Tao

DOI: https://doi.org/10.1007/s10114-024-2198-y

2024-04-17

Acta Mathematica Sinica English Series

Abstract:The penalized variable selection methods are often used to select the relevant covariates and estimate the unknown regression coefficients simultaneously, but these existing methods may fail to be consistent for the setting with highly correlated covariates. In this paper, the semi-standard partial covariance (SPAC) method with Lasso penalty is proposed to study the generalized linear model with highly correlated covariates, and the consistencies of the estimation and variable selection are shown in high-dimensional settings under some regularity conditions. Some simulation studies and an analysis of colon tumor dataset are carried out to show that the proposed method performs better in addressing highly correlated problem than the traditional penalized variable selection methods.

mathematics, applied
Variable Selection Using Penalized Empirical Likelihood

YunWen Ren,XinSheng Zhang

DOI: https://doi.org/10.1007/s11425-011-4231-8

2011-01-01

Science China Mathematics

Abstract:This paper considers variable selection for moment restriction models. We propose a penalized empirical likelihood (PEL) approach that has desirable asymptotic properties comparable to the penalized likelihood approach, which relies on a correct parametric likelihood specification. In addition to being consistent and having the oracle property, PEL admits inference on parameter without having to estimate its estimator’s covariance. An approximate algorithm, along with a consistent BIC-type criterion for selecting the tuning parameters, is provided for PEL. The proposed algorithm enjoys considerable computational efficiency and overcomes the drawback of the local quadratic approximation of nonconcave penalties. Simulation studies to evaluate and compare the performances of our method with those of the existing ones show that PEL is competitive and robust. The proposed method is illustrated with two real examples.
Elastic Net Procedure for Partially Linear Models

Chunhong Li,Dengxiang Huang,Hongshuai Dai,Xinxing Wei

DOI: https://doi.org/10.48550/arXiv.1507.06032

2015-07-22

Abstract:Variable selection plays an important role in the high-dimensional data analysis. However the high-dimensional data often induces the strongly correlated variables problem. In this paper, we propose Elastic Net procedure for partially linear models and prove the group effect of its estimate. By a simulation study, we show that the strongly correlated variables problem can be better handled by the Elastic Net procedure than Lasso, ALasso and Ridge. Based on an empirical analysis, we can get that the Elastic Net procedure is particularly useful when the number of predictors $p$ is much bigger than the sample size $n$.

Methodology,Probability,Machine Learning
PENALIZED VARIABLE SELECTION PROCEDURE FOR COX MODELS WITH SEMIPARAMETRIC RELATIVE RISK

Pang Du,Shuangge Ma,Hua Liang

DOI: https://doi.org/10.1214/09-AOS780

2010-08-01

Abstract:We study the Cox models with semiparametric relative risk, which can be partially linear with one nonparametric component, or multiple additive or nonadditive nonparametric components. A penalized partial likelihood procedure is proposed to simultaneously estimate the parameters and select variables for both the parametric and the nonparametric parts. Two penalties are applied sequentially. The first penalty, governing the smoothness of the multivariate nonlinear covariate effect function, provides a smoothing spline ANOVA framework that is exploited to derive an empirical model selection tool for the nonparametric part. The second penalty, either the smoothly-clipped-absolute-deviation (SCAD) penalty or the adaptive LASSO penalty, achieves variable selection in the parametric part. We show that the resulting estimator of the parametric part possesses the oracle property, and that the estimator of the nonparametric part achieves the optimal rate of convergence. The proposed procedures are shown to work well in simulation experiments, and then applied to a real data example on sexually transmitted diseases.
Robust variable selection for partially linear additive models

Graciela Boente,Alejandra Martínez

2024-01-31

Abstract:Among semiparametric regression models, partially linear additive models provide a useful tool to include additive nonparametric components as well as a parametric component, when explaining the relationship between the response and a set of explanatory variables. This paper concerns such models under sparsity assumptions for the covariates included in the linear component. Sparse covariates are frequent in regression problems where the task of variable selection is usually of interest. As in other settings, outliers either in the residuals or in the covariates involved in the linear component have a harmful effect. To simultaneously achieve model selection for the parametric component of the model and resistance to outliers, we combine preliminary robust estimators of the additive component, robust linear $MM-$regression estimators with a penalty such as SCAD on the coefficients in the parametric part. Under mild assumptions, consistency results and rates of convergence for the proposed estimators are derived. A Monte Carlo study is carried out to compare, under different models and contamination schemes, the performance of the robust proposal with its classical counterpart. The obtained results show the advantage of using the robust approach. Through the analysis of a real data set, we also illustrate the benefits of the proposed procedure.

Methodology,Statistics Theory
Variable selection of partially linear varying coefficient spatial autoregressive model

Tizheng Li,Qingyan Yin,Jialong Peng

DOI: https://doi.org/10.1080/00949655.2020.1788560

IF: 1.225

2020-07-03

Journal of Statistical Computation and Simulation

Abstract:The partially linear varying coefficient spatial autoregressive model is a recently proposed semi-parametric spatial autoregressive model, in which some of the explanatory variables have varying coefficients while the remained explanatory variables possess constant ones. Although some estimation methods have been proposed for the partially linear varying coefficient spatial autoregressive model, the problem of selecting important explanatory variables in the parametric component of such model has not been addressed to date. In this paper, we propose a penalized profile least squares method to address this problem. Different from the existing estimation methods, the proposed method can simultaneously select the significant explanatory variables in the parametric component and estimate the corresponding nonzero regression coefficients. Furthermore, we provide a computationally feasible algorithm to obtain the penalized profile least squares estimator. The finite sample performance of the proposed variable selection method is evaluated through some simulation studies and illustrated by a real data example.

statistics & probability,computer science, interdisciplinary applications
Estimation and model selection in generalized additive partial linear models for correlated data with diverging number of covariates

Li Wang,Lan Xue,Annie Qu,Hua Liang

DOI: https://doi.org/10.1214/13-AOS1194

2014-05-23

Abstract:We propose generalized additive partial linear models for complex data which allow one to capture nonlinear patterns of some covariates, in the presence of linear components. The proposed method improves estimation efficiency and increases statistical power for correlated data through incorporating the correlation information. A unique feature of the proposed method is its capability of handling model selection in cases where it is difficult to specify the likelihood function. We derive the quadratic inference function-based estimators for the linear coefficients and the nonparametric functions when the dimension of covariates diverges, and establish asymptotic normality for the linear coefficient estimators and the rates of convergence for the nonparametric functions estimators for both finite and high-dimensional cases. The proposed method and theoretical development are quite challenging since the numbers of linear covariates and nonlinear components both increase as the sample size increases. We also propose a doubly penalized procedure for variable selection which can simultaneously identify nonzero linear and nonparametric components, and which has an asymptotic oracle property. Extensive Monte Carlo studies have been conducted and show that the proposed procedure works effectively even with moderate sample sizes. A pharmacokinetics study on renal cancer data is illustrated using the proposed method.

Statistics Theory
Estimation and variable selection for partial functional linear regression

Qingguo Tang,Peng Jin

DOI: https://doi.org/10.1007/s10182-018-00342-0

2018-12-14

AStA Advances in Statistical Analysis

Abstract:We propose a new estimation procedure for estimating the unknown parameters and function in partial functional linear regression. The asymptotic distribution of the estimator of the vector of slope parameters is derived, and the global convergence rate of the estimator of unknown slope function is established under suitable norm. The convergence rate of the mean squared prediction error for the proposed estimators is also established. Based on the proposed estimation procedure, we further construct the penalized regression estimators and establish their variable selection consistency and oracle properties. Finite sample properties of our procedures are studied through Monte Carlo simulations. A real data example about the real estate data is used to illustrate our proposed methodology.

statistics & probability
Partial Least Squares Methods: Partial Least Squares Correlation and Partial Least Square Regression

Hervé Abdi,Lynne J. Williams

DOI: https://doi.org/10.1007/978-1-62703-059-5_23

2012-08-18

Abstract:Partial least square (pls) methods (also sometimes called projection to latent structures) relate the information present in two data tables that collect measurements on the same set of observations. pls methods proceed by deriving latent variables which are (optimal) linear combinations of the variables of a data table. When the goal is to find the shared information between two tables, the approach is equivalent to a correlation problem and the technique is then called partial least square correlation (PLSC) (also sometimes called pls-SVD). In this case there are two sets of latent variables (one set per table), and these latent variables are required to have maximal covariance. When the goal is to predict one data table the other one, the technique is then called partial least square regression. In this case there is one set of latent variables (derived from the predictor table) and these latent variables are required to give the best possible prediction. In this paper we present and illustrate PLSC and PLSR and show how these descriptive multivariate analysis techniques can be extended to deal with inferential questions by using cross-validation techniques such as the bootstrap and permutation tests.

The effects of olanzapine, risperidone, and haloperidol on plasma prolactin levels in patients with schizophrenia.

Variable selection in partially time-varying coefficient models

Variable selection for partially linear models via Bayesian subset modeling with diffusing prior

Maximum Likelihood Estimators in a Two Step Model for PLS

Least squares support vector machine based partially linear model identification

Variable Selection for Generalized Varying Coefficient Partially Linear Models with Diverging Number of Parameters

Estimation and Variable Selection in Partial Linear Single Index Models with Error-Prone Linear Covariates

Feature screening and variable selection for partially linear models with ultrahigh-dimensional longitudinal data

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Variable Selection for the Partial Linear Single-Index Model

Quantile regression and variable selection of partial linear single-index model

Variable Selection for Generalized Linear Model with Highly Correlated Covariates

Variable Selection Using Penalized Empirical Likelihood

Elastic Net Procedure for Partially Linear Models

PENALIZED VARIABLE SELECTION PROCEDURE FOR COX MODELS WITH SEMIPARAMETRIC RELATIVE RISK

Robust variable selection for partially linear additive models

Variable selection of partially linear varying coefficient spatial autoregressive model

Estimation and model selection in generalized additive partial linear models for correlated data with diverging number of covariates

Estimation and variable selection for partial functional linear regression

Partial Least Squares Methods: Partial Least Squares Correlation and Partial Least Square Regression