A Review on Empirical Likelihood Methods for Regression

Song Xi Chen,Ingrid Van Keilegom

DOI: https://doi.org/10.1007/s11749-009-0159-5

2009-01-01

Test

Abstract:We provide a review on the empirical likelihood method for regression-type inference problems. The regression models considered in this review include parametric, semiparametric, and nonparametric models. Both missing data and censored data are accommodated.

What problem does this paper attempt to address?

Empirical Likelihood Inference for Nonparametric Regression Functions with Functional Stationary Ergodic Data

Xian-Zhu Xiong,Zheng-Yan Lin

DOI: https://doi.org/10.1080/03610926.2011.630766

2013-01-01

Abstract:In this article, we employ the empirical likelihood method to construct confidence intervals for nonparametric regression functions with functional stationary ergodic data. Under some wild conditions, it is proved that the empirical likelihood ratio statistic is asymptotically chi-squared distributed.
Empirical likelihood in some nonparametric and semiparametric models

Liugen Xue,Lixing Zhu

DOI: https://doi.org/10.4310/sii.2012.v5.n3.a9

2012-01-01

Statistics and Its Interface

Abstract:In this very selective overview, we summarise the recent developments by our own and other, on the empirical likelihood in some nonparametric and semiparametric regression models. The models include the partially linear model, the single-index model, the partially linear single-index model, the varying coefficient model, and so on. The focus of this overview is to expatiate the adjustment and "bias correction" methodologies when Wilks' phenomenon does not hold. The adjustment or bias correction can make the limiting distributions tractable such that they can be directly used to construct the confidence regions of parameters of interest without the assistance of Monte Carlo approximation.
Empirical Likelihood for Linear Models with Missing Responses

Yuping Hu,Liugen Xue,Sanying Feng

DOI: https://doi.org/10.1016/j.jmva.2008.12.009

IF: 1.387

2008-01-01

Journal of Multivariate Analysis

Abstract:The purpose of this article is to use an empirical likelihood method to study the construction of confidence intervals and regions for the parameters of interest in linear regression models with missing response data. A class of empirical likelihood ratios for the parameters of interest are defined such that any of our class of ratios is asymptotically chi-squared. Our approach is to directly calibrate the empirical log-likelihood ratio, and does not need multiplication by an adjustment factor for the original ratio. Also, a class of estimators for the parameters of interest is constructed, and the asymptotic distributions of the proposed estimators are obtained. Our results can be used directly to construct confidence intervals and regions for the parameters of interest. A simulation study indicates that the proposed methods are comparable in terms of coverage probabilities and average lengths/areas of confidence intervals/regions. An example of a real data set is used for illustrating our methods.
Empirical Likelihood Inference of Parameters in a Censored Nonlinear Semiparametric Regression Model

HOU Wen,SONG Li-xin,HUANG Yu-jie

2012-01-01

Abstract:In this paper,a censored nonlinear semiparametric regression model is investigated. Empirical log-likelihood ratio statistics and adjust empirical log-likelihood ratio statistics for the unknown parameters in the model are suggested.It is shown that the proposed statistics have asymptotically chi-squared distribution under some mild conditions,and hence it can be used to construct the confidence region of the unknown parameter.In addition the least squares estimator of unknown parameter is constructed,and its asymptotic behavior is proved.A simulation study is carried out to show the empirical likelihood methods appears to be better than the least-squares method in terms of the confidence regions and its coverage probabilities.
Empirical Likelihood for Semiparametric Regression Model with Missing Response Data.

Liugen Xue,Dong Xue

DOI: https://doi.org/10.1016/j.jmva.2010.11.001

IF: 1.387

2011-01-01

Journal of Multivariate Analysis

Abstract:A bias-corrected technique for constructing the empirical likelihood ratio is used to study a semiparametric regression model with missing response data. We are interested in inference for the regression coefficients, the baseline function and the response mean. A class of empirical likelihood ratio functions for the parameters of interest is defined so that undersmoothing for estimating the baseline function is avoided. The existing data-driven algorithm is also valid for selecting an optimal bandwidth. Our approach is to directly calibrate the empirical log-likelihood ratio so that the resulting ratio is asymptotically chi-squared. Also, a class of estimators for the parameters of interest is constructed, their asymptotic distributions are obtained, and consistent estimators of asymptotic bias and variance are provided. Our results can be used to construct confidence intervals and bands for the parameters of interest. A simulation study is undertaken to compare the empirical likelihood with the normal approximation-based method in terms of coverage accuracies and average lengths of confidence intervals. An example for an AIDS clinical trial data set is used for illustrating our methods.
An easy-to-use empirical likelihood ABC method

Sanjay Chaudhuri,Subhro Ghosh,David J. Nott,Kim Cuc Pham

DOI: https://doi.org/10.48550/arXiv.1810.01675

2018-10-08

Abstract:Many scientifically well-motivated statistical models in natural, engineering and environmental sciences are specified through a generative process, but in some cases it may not be possible to write down a likelihood for these models analytically. Approximate Bayesian computation (ABC) methods, which allow Bayesian inference in these situations, are typically computationally intensive. Recently, computationally attractive empirical likelihood based ABC methods have been suggested in the literature. These methods heavily rely on the availability of a set of suitable analytically tractable estimating equations. We propose an easy-to-use empirical likelihood ABC method, where the only inputs required are a choice of summary statistic, it's observed value, and the ability to simulate summary statistics for any parameter value under the model. It is shown that the posterior obtained using the proposed method is consistent, and its performance is explored using various examples.

Computation,Applications,Methodology,Machine Learning
An Empirical Likelihood Method for Semiparametric Linear Regression with Right Censored Data.

Kai-Tai Fang,Gang Li,Xuyang Lu,Hong Qin

DOI: https://doi.org/10.1155/2013/469373

IF: 2.809

2013-01-01

Computational and Mathematical Methods in Medicine

Abstract:This paper develops a new empirical likelihood method for semiparametric linear regression with a completely unknown error distribution and right censored survival data. The method is based on the Buckley-James (1979) estimating equation. It inherits some appealing properties of the complete data empirical likelihood method. For example, it does not require variance estimation which is problematic for the Buckley-James estimator. We also extend our method to incorporate auxiliary information. We compare our method with the synthetic data empirical likelihood of Li and Wang (2003) using simulations. We also illustrate our method using Stanford heart transplantation data.
Empirical Likelihood Inference in Censored Linear Errors-in-Variables Models with Validation Data

LI Gao-rong,FENG San-ying,XUE Liu-gen

DOI: https://doi.org/10.3969/j.issn.1002-1566.2007.05.006

2007-01-01

Abstract:This paper considers censored linear errors-in-covariables regression models.We construct two empirical log-likelihood ratio statistics for the unknown regression coefficients with the help of validation data.The estimated empirical log-likelihood is proved to be asymp-totically distributed as weighted sums of independent chi-square r.v.'s with I degree of freedom and the adjusted empirical log-likelihood is shown to be asymptotically distributed as standard chi-square,and hence they can be used to construct the confidence region of the parameter.A simulation study is conducted to compare the proposed methods in terms of coverage accuracies and average lengths of the confidence intervals.
An Empirical Likelihood Method In Mixture Models With Incomplete Classifications

Song Xi Chen,Jing Qin

IF: 1.4

2006-01-01

Statistica Sinica

Abstract:In studying the relationship between a binary variable and a covariate, it is very common that the value of the binary variable is missing for some observations, and subsequently those observations are uncategorised. In this paper we show that the uncategorised data can be treated as auxiliary information, as in survey sampling literature. We establish a framework of parametric and nonparametric estimation by the empirical likelihood. The proposed empirical likelihood estimators improve the efficiency of estimators based on the categorised samples in the leading order. In a comparative study with the ratio estimator, we show the reveal robust performance of the empirical likelihood estimators. Applications to tax-auditing and to genetic studies are discussed.
Empirical Likelihood Inferences for Semiparametric Instrumental Variable Models

Peixin Zhao,Liugen Xue

DOI: https://doi.org/10.1007/s12190-013-0652-6

2013-01-01

Abstract:This paper studies the empirical likelihood inferences for a class of semi-parametric instrumental variable models. We focus on the case that some covariates are endogenous variables, and some auxiliary instrumental variables are available. An instrumental variable based empirical likelihood method is proposed, and it is shown that the proposed empirical log-likelihood ratio is asymptotically chi-squared. Then, the confidence intervals for the regression coefficients are constructed. Some simulation studies are undertaken to assess the finite sample performance of the proposed empirical likelihood procedure.
Empirical Likelihood Inference for A Semiparametric Hazards Regression Model

Wei Chen,Dehui Wang

DOI: https://doi.org/10.1080/03610926.2014.901368

2015-01-01

Abstract:We investigated the empirical likelihood inference approach under a general class of semiparametric hazards regression models with survival data subject to right-censoring. An empirical likelihood ratio for the full 2p regression parameters involved in the model is obtained. We showed that it converged weakly to a random variable which could be written as a weighted sum of 2p independent chi-squared variables with one degree of freedom. Using this, we could construct a confidence region for parameters. We also suggested an adjusted version for the preceding statistic, whose limit followed a standard chi-squared distribution with 2p degrees of freedom.
Empirical Likelihood Inferences for Covariate Adjusted Regression

Zhao Peixin,Xue Liugen

2011-01-01

Acta Mathematica Scientia

Abstract:In this paper,an empirical likelihood inference for the covariate adjusted regression is investigated.Based on the empirical likelihood method,a corrected empirical likelihood ratio method is proposed and the Wilks' phenomenon is derived.Then,the confidence intervals for the regression coefficients are constructed.A simulation study and a real data application are undertaken to assess the finite sample performance of the proposed method.
Diagnostic Measures for Nonlinear Regression Models Based on Empirical Likelihood Method

DING XIANWEN,XU LIANG,LIN JINGUAN

DOI: https://doi.org/10.3969/j.issn.0254-3079.2012.04.011

2012-01-01

Acta Mathematicae Applicatae Sinica

Abstract:The empirical likelihood method has been extensively applied to linear regression and generalized linear regression models.In this paper,the diagnostic measures for nonlinear regression models are studied based on the empirical likelihood method.First, the maximum empirical likelihood estimate of the parameters are obtained.Then,three different measures of influence curvatures are studied.Last,real data analysis are given to illustrate the validity of statistical diagnostic measures.
Empirical Likelihood for Estimating Equations with Missing Values

Dong Wang,Song Xi Chen

DOI: https://doi.org/10.1214/07-aos585

2009-01-01

Abstract:We consider an empirical likelihood inference for parameters defined by general estimating equations when some components of the random observations are subject to missingness.As the nature of the estimating equations is wide-ranging, we propose a nonparametric imputation of the missing values from a kernel estimator of the conditional distribution of the missing variable given the always observable variable.The empirical likelihood is used to construct a profile likelihood for the parameter of interest.We demonstrate that the proposed nonparametric imputation can remove the selection bias in the missingness and the empirical likelihood leads to more efficient parameter estimation.The proposed method is further evaluated by simulation and an empirical study on a genetic dataset on recombinant inbred mice.
Empirical Likelihood for Nonlinear Regression Models with Nonignorable Missing Responses

Zhihuang Yang,Niansheng Tang

DOI: https://doi.org/10.1002/cjs.11540

2020-01-01

Canadian Journal of Statistics

Abstract:This article develops three empirical likelihood (EL) approaches to estimate parameters in nonlinear regression models in the presence of nonignorable missing responses. These are based on the inverse probability weighted (IPW) method, the augmented IPW (AIPW) method and the imputation technique. A logistic regression model is adopted to specify the propensity score. Maximum likelihood estimation is used to estimate parameters in the propensity score by combining the idea of importance sampling and imputing estimating equations. Under some regularity conditions, we obtain the asymptotic properties of the maximum EL estimators of these unknown parameters. Simulation studies are conducted to investigate the finite sample performance of our proposed estimation procedures. Empirical results provide evidence that the AIPW procedure exhibits better performance than the other two procedures. Data from a survey conducted in 2002 are used to illustrate the proposed estimation procedure. The Canadian Journal of Statistics 00: 000-000; 2020 (c) 2020 Statistical Society of Canada
Empirical Likelihood in a Semi-Parametric Model for Missing Response Data

Lichun Wang,Noel Veraverbeke

DOI: https://doi.org/10.1080/03610920500498873

2006-01-01

Abstract:Let Y be a response and, given covariate X,Y has a conditional density f(y | x, θ), where θ is a unknown p-dimensional vector of parameters and the marginal distribution of X is unknown. When responses are missing at random, with auxiliary information and imputation, we define an adjusted empirical log-likelihood ratio for the mean of Y and obtain its asymptotic distribution. A simulation study is conducted to compare the adjusted empirical log-likelihood and the normal approximation method in terms of coverage accuracies.
Empirical likelihood for the analysis of experimental designs

Eunseop Kim,Steven N. MacEachern,Mario Peruggia

DOI: https://doi.org/10.1080/10485252.2023.2206919

2023-05-03

Abstract:Empirical likelihood enables a nonparametric, likelihood-driven style of inference without restrictive assumptions routinely made in parametric models. We develop a framework for applying empirical likelihood to the analysis of experimental designs, addressing issues that arise from blocking and multiple hypothesis testing. In addition to popular designs such as balanced incomplete block designs, our approach allows for highly unbalanced, incomplete block designs. We derive an asymptotic multivariate chi-square distribution for a set of empirical likelihood test statistics and propose two single-step multiple testing procedures: asymptotic Monte Carlo and nonparametric bootstrap. Both procedures asymptotically control the generalised family-wise error rate and efficiently construct simultaneous confidence intervals for comparisons of interest without explicitly considering the underlying covariance structure. A simulation study demonstrates that the performance of the procedures is robust to violations of standard assumptions of linear mixed models. We also present an application to experiments on a pesticide.

Methodology
Empirical likelihood for an autoregressive model with explanatory variables

Zhiwen Zhao,Dehui Wang

DOI: https://doi.org/10.1080/03610920903411267

2011-01-01

Abstract:In this article, we use the empirical likelihood method to construct the confidence region for parameters in autoregressive model with martingale difference error. It is shown that the empirical log-likelihood ratio at the true parameter converges to the standard chi-square distribution. The simulation results suggest that the empirical likelihood method outperforms the normal approximation based method in terms of coverage probability.
Empirical Likelihood Inference in Nonlinear Errors-in-Covariables Models With Validation Data

Winfried Stute,Liugen Xue,Lixing Zhu

DOI: https://doi.org/10.1198/016214506000000816

IF: 4.369

2012-01-01

Journal of the American Statistical Association

Abstract:In this article we study inference in parametric-nonparametric errors-in-covariables regression models using an empirical likelihood approach based on validation data. It is shown that the asymptotic behavior of the proposed estimator depends on the ratio of the sizes of the primary sample and the validation sample, respectively. Unlike cases without measurement errors, the limit distribution of the estimator is no longer tractable and cannot be used for constructing confidence regions. Monte Carlo approximations are employed to simulate the limit distribution. To increase the coverage accuracy of confidence regions, two adjusted empirical likelihood estimators are recommended, which in the limit have a standard chi-squared distribution. A simulation study is carried out to compare the proposed methods with other existing methods. The new methods outperform the least squares method, and one of them works better than simulation-extrapolation (SIMEX) estimation, even when the restrictive model assumptions needed for SIMEX are satisfied. An application to a real dataset illustrates our new approach.
Empirical Likelihood for Linear Regression Analysis with Censored Data

李四化,郑明

DOI: https://doi.org/10.3969/j.issn.0427-7104.2004.03.029

2004-01-01

Abstract:The empirical likelihood method is applied in the regression analysis with right censored data,a generally adjusted empirical likelihood ratio is defined and showed that it follows a chi-square distribution .Some simulation studies are given about the contindence intervals of the regression coefficient.

A Review on Empirical Likelihood Methods for Regression

Empirical Likelihood Inference for Nonparametric Regression Functions with Functional Stationary Ergodic Data

Empirical likelihood in some nonparametric and semiparametric models

Empirical Likelihood for Linear Models with Missing Responses

Empirical Likelihood Inference of Parameters in a Censored Nonlinear Semiparametric Regression Model

Empirical Likelihood for Semiparametric Regression Model with Missing Response Data.

An easy-to-use empirical likelihood ABC method

An Empirical Likelihood Method for Semiparametric Linear Regression with Right Censored Data.

Empirical Likelihood Inference in Censored Linear Errors-in-Variables Models with Validation Data

An Empirical Likelihood Method In Mixture Models With Incomplete Classifications

Empirical Likelihood Inferences for Semiparametric Instrumental Variable Models

Empirical Likelihood Inference for A Semiparametric Hazards Regression Model

Empirical Likelihood Inferences for Covariate Adjusted Regression

Diagnostic Measures for Nonlinear Regression Models Based on Empirical Likelihood Method

Empirical Likelihood for Estimating Equations with Missing Values

Empirical Likelihood for Nonlinear Regression Models with Nonignorable Missing Responses

Empirical Likelihood in a Semi-Parametric Model for Missing Response Data

Empirical likelihood for the analysis of experimental designs

Empirical likelihood for an autoregressive model with explanatory variables

Empirical Likelihood Inference in Nonlinear Errors-in-Covariables Models With Validation Data

Empirical Likelihood for Linear Regression Analysis with Censored Data