Abstract:Linear regression models are useful statistical tools to analyze data sets in several different fields. There are several methods to estimate the parameters of a linear regression model. These methods usually perform under normally distributed and uncorrelated errors with zero mean and constant variance. However, for some data sets error terms may not satisfy these or some of these assumptions. If error terms are correlated, such as the regression models with autoregressive (AR(p)) error terms, the Conditional Maximum Likelihood (CML) under normality assumption or the Least Square (LS) methods are often used to estimate the parameters of interest. For CML estimation a distributional assumption on error terms is needed to carry on estimation, but, in practice, such distributional assumptions on error terms may not be plausible. Therefore, in such cases some alternative distribution free methods are needed to conduct the parameter estimation. In this paper, we propose to estimate the parameters of a linear regression model with AR(p) error term using the Empirical Likelihood (EL) method, which is one of the distribution free estimation methods. A small simulation study and a numerical example are provided to evaluate the performance of the proposed estimation method over the CML method. The results of simulation study show that the proposed estimators based on EL method are remarkably better than the estimators obtained from the CML method in terms of mean squared errors (MSE) and bias in almost all the simulation configurations. These findings are also confirmed by the results of the numerical and real data examples.

On a Principal Component Two-Parameter Estimator in Linear Model with Autocorrelated Errors

Robust Principal Component Analysis Based on Maximum Correntropy Criterion

Expectile regression for analyzing heteroscedasticity in high dimension

Generalized probabilistic principal component analysis of correlated data

Nonparametric Regression Estimation with General Parametric Error Covariance: a More Efficient Two-Step Estimator

Structured Principal Component Analysis Model With Variable Correlation Constraint

Efficient Estimation for Error Component Seemingly Unrelated Nonparametric Regression Models

On the number of variables to use in principal component regression

Robust Covariance Estimation for Distributed Principal Component Analysis

Targeted principal components regression

Estimation for partially linear single-index spatial autoregressive model with covariate measurement errors

MORE EFFICIENT ESTIMATION IN NONPARAMETRIC REGRESSION WITH NONPARAMETRIC AUTOCORRELATED ERRORS

Smooth Adjustment for Correlated Effects

Common Correlated Effects Estimation of Nonlinear Panel Data Models

Predictive Regressions: Method of Least Autocorrelation

Statistical inference of partially linear time-varying coefficients spatial autoregressive panel data model

Efficiency of the principal component Liu-type estimator in logistic regression model

Empirical Likelihood Estimation for Linear Regression Models with AR(p) Error Terms

A Simulation Study of the Effects of Additive, Multiplicative, Correlated, and Uncorrelated Errors on Principal Component Analysis

Variable selection for partially linear models via partial correlation