Abstract:This paper focuses on the estimation of parameters in linear models with fixed regressors and exchangeable errors, especially, these errors are assumed to be a subset of an infinite exchangeable sequence. We propose a modified M-estimation to estimate the slope parameter, which outperforms the traditional M-estimation when the random errors are exchangeable. The modified M-estimation utilizes a design point centralization technique, leading to a more suitable estimator with improved theoretical properties. To establish the asymptotic properties of the modified M-estimator, we also develop a weighted central limit theorem for exchangeable sequences, which is of independent interest. Regarding the intercept, we prove that there is no consistent estimator for the intercept when the exchangeable errors have non-zero covariance, and we propose an unbiased estimator for the intercept as a viable compromise. Based on our theoretical findings, we develop a simulation-based approach to approximate the confidence set of the slope, and we establish a prediction model specifically designed for linear models with exchangeable errors. Additionally, we illustrate the finite sample performance of the proposed method through various numerical simulations and a real data application.

General linear estimators under the prediction error sum of squares criterion in a linear regression model

A New Liu-type Estimator in Linear Regression Model

Quasi-minimax Estimation in the General Linear Regression Model

Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

On a Biased Prediction Based on Optimal Mean Square Error Criterion

Small-sample Properties for Generalized Ridge Estimator of Regression Coefficients in Linear Regression Model

On the Restricted Almost Unbiased Estimators in Linear Regression

Generalized Resubstitution for Regression Error Estimation

Linearized Ridge Regression Estimator under the Mean Squared Error Criterion in a Linear Regression Model

On the Mean Square Error of Parameter Estimates for Some Biased Estimators

A Further Study of Predictions in Linear Mixed Models

On the Equivalent Characterization of the Best Linear Unbiased Estimation under the Singular Linear Model

Nonparametric Regression Estimation with General Parametric Error Covariance: a More Efficient Two-Step Estimator

Prediction Risk and Estimation Risk of the Ridgeless Least Squares Estimator under General Assumptions on Regression Errors

Linearization Estimates of the Backward Errors for Least Squares Problems.

ASYMPTOTIC THEORY OF A BIAS-CORRECTED LEAST-SQUARES ESTIMATOR IN TRUNCATED REGRESSION

Estimation for Biased Partial Linear Single Index Models

Further Study on the Error Estimates for Least Squares Problems

Positive-rule Stein-Type Almost Unbiased Ridge Estimator in Linear Regression Model

M-estimation for linear models with exchangeable errors

An Alternative Stochastic Restricted Liu Estimator in Linear Regression