Parameter Estimation of Linear Structural EV Model about Errors for AR(1) Model

LIANG Fei-bao,YAN Hui-ping

2009-01-01

Abstract:A linear structural EV model is given and its error is AR(1) model.When x and y are normal distribution,the estimates of parameters are construc-ted through the orthogonal regression method and the least square approaches.It is proved that the estimators have the property of strong consistency.

What problem does this paper attempt to address?

A Method of ARX Model Estimation of Errors-in-Variables Systems

xin liu,yucai zhu

DOI: https://doi.org/10.1016/j.ifacol.2015.12.143

2015-01-01

IFAC-PapersOnLine

Abstract:This work proposes an estimation method of ARX (autoregressive with external input) models of errors-in-variables (EIV) systems. In ARX model estimation, the input noise variance needs to be estimated in order to obtain a consistent estimate. In this method, an error criterion is proposed and the input noise variance is obtained by minimizing the loss function. The global minimum can be obtained because the optimization procedure is a one-parameter optimization problem. Consistency of the proposed parameter estimation is proved. Simulations are used to illustrate its performance.
Arx Model Estimation Of Multivariable Errors-In-Variables Systems

Xin Liu,Yucai Zhu

DOI: https://doi.org/10.1016/j.ifacol.2018.09.111

2018-01-01

Abstract:This paper proposes a method for the estimation of ARX (Autoregressive with external input) model of multivariable errors-in-variables (EIV) systems. In parameter estimation, the input noise variances need to be estimated in order to obtain a consistent estimate. Two methods are developed to estimate the input noises variances. One way is to minimize a correlated output error criterion. The other way is to extract the input noises variances from the power spectrum of measured inputs. When the input noise variances are known, a modified least-squares method will give consistent estimate for the EIV system. Numerical simulations are used to illustrate the performance of the method. This work lays down a basis for extending the asymptotic method of Liu and Zhu (2017) to multivariable EIV systems which starts from a high order ARX model estimation. (C) 2018, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.
ROBUST ESTIMATION IN PARAMETRIC TIME SERIES MODELS UNDER LONG‐ AND SHORT‐RANGE‐DEPENDENT STRUCTURES

Jiti Gao,Degui Li,Zhengyan Lin

DOI: https://doi.org/10.1111/j.1467-842x.2009.00537.x

2009-01-01

Australian & New Zealand Journal of Statistics

Abstract:SummaryThis paper studies the asymptotic behaviour of an M‐estimator of regression parameters in the linear model when the design variables are either stationary short‐range dependent (SRD), α‐mixing or long‐range dependent (LRD), and the errors are LRD. The weak consistency and the asymptotic distributions of the M‐estimator are established. We present some simulated examples to illustrate the efficiency of the proposed M‐estimation method.
A Estimate Class of G-M Linear Model

Cheng Z

DOI: https://doi.org/10.3969/j.issn.1001-4268.2003.04.014

2003-01-01

Abstract:This paper discusses the estimate class of parameter β such as β = AX'y: the necessary and sufficient condition that β is the linear admissible estimate of β; when the error is normal, the linear admissible subclass is equivalent to the class of the Bayes estimate; the principal component estimate βk of k has properties of T-min max and A, Φ1-max min in the estimate class Γk
Asymptotic Behavior for S-estimators in Random Design Linear Model with Long-Range-dependent Errors

Lin Zhengyan,Li Degui,Chen Jia

DOI: https://doi.org/10.1007/s00184-006-0111-6

IF: 0.96

2006-01-01

Metrika

Abstract:The asymptotic behavior of S-estimators in a random design linear model with long-range-dependent Gaussian errors is considered. It turns out that the S-estimators of regression parameter and error variance are strongly consistent under mild conditions. Furthermore, the asymptotic distribution of the S-estimator of regression parameter is normal if the design vectors are i.i.d. and is non-normal if the design vectors are long-range dependent Gaussian vectors. We also show that the asymptotic distribution of S-estimator of the error variance is non-normal since the errors are long-range dependent.
The Asymptotic Method for the Identification of Errors-In-Variables Systems

Xin Liu,Yucai Zhu

DOI: https://doi.org/10.1002/acs.2751

IF: 3.369

2017-01-01

International Journal of Adaptive Control and Signal Processing

Abstract:This work studies the identification of errors-in-variables (EIV) systems. An asymptotic method (ASYM) is developed for the EIV system. The ASYM is to start with a high order model estimation and then to perform a frequency domain weighted model reduction. Firstly when applying the high order ARX (autoregressive with external input) model estimation procedure, a consistent ARX model estimation method of EIV systems is applied. The asymptotic variance expression of the estimated high order ARX model is derivated which forms the basis of the ASYM. Simulations are used to illustrate the performance of the ASYM for EIV systems.
Empirical Likelihood Estimation for Linear Regression Models with AR(p) Error Terms

Şenay Özdemir,Yeşim Güney,Yetkin Tuaç,Olcay Arslan

DOI: https://doi.org/10.48550/arXiv.2008.03282

2020-07-27

Abstract:Linear regression models are useful statistical tools to analyze data sets in several different fields. There are several methods to estimate the parameters of a linear regression model. These methods usually perform under normally distributed and uncorrelated errors with zero mean and constant variance. However, for some data sets error terms may not satisfy these or some of these assumptions. If error terms are correlated, such as the regression models with autoregressive (AR(p)) error terms, the Conditional Maximum Likelihood (CML) under normality assumption or the Least Square (LS) methods are often used to estimate the parameters of interest. For CML estimation a distributional assumption on error terms is needed to carry on estimation, but, in practice, such distributional assumptions on error terms may not be plausible. Therefore, in such cases some alternative distribution free methods are needed to conduct the parameter estimation. In this paper, we propose to estimate the parameters of a linear regression model with AR(p) error term using the Empirical Likelihood (EL) method, which is one of the distribution free estimation methods. A small simulation study and a numerical example are provided to evaluate the performance of the proposed estimation method over the CML method. The results of simulation study show that the proposed estimators based on EL method are remarkably better than the estimators obtained from the CML method in terms of mean squared errors (MSE) and bias in almost all the simulation configurations. These findings are also confirmed by the results of the numerical and real data examples.

Methodology
Modeling for a Class of Nonstationary ARMA Series 1

Cao Xin,Sheng Zhaohan,Xu Nanrong

DOI: https://doi.org/10.1016/s1474-6670(17)51991-6

1990-01-01

IFAC Proceedings Volumes

Abstract:This paper is devoted to the parameter estimation problem for a class of nor-stationary ARMA series. From the viewpoint of instrumental variable method. the modified Yule-Walker estimator is extended to nonstationary situation. The strong consistence of the estimator is proved by means of martingale convergence theory
Parameter estimation of regression model with AR(p) error terms based on skew distributions with EM algorithm

Y. Tuaç,Y. Güney,O. Arslan

DOI: https://doi.org/10.1007/s00500-019-04089-x

IF: 3.732

2019-06-03

Soft Computing

Abstract:In the linear regression model, the errors are usually assumed to be uncorrelated. However, in real-life data, this assumption is not often plausible. In this study, first, we will assume that the errors of the regression model have autoregressive structure. This type of regression models has been considered before. However, in those papers under this assumption usually, the symmetric distributions are used as error distribution. The main contribution of this work is to use skew distributions instead of symmetric distributions as error distribution in regression models with autoregressive errors. We provide expectation maximization algorithm to compute the maximum likelihood estimates for the parameters. The performances of the proposed estimators are demonstrated with a simulation study and a real data example. We also provide the confidence intervals using the observed Fisher information matrix for the corresponding estimators.

computer science, artificial intelligence, interdisciplinary applications
Identification of Linear Structural Dynamic Systems

M SHINOZUKA,CB YUN,H IMAI

DOI: https://doi.org/10.1061/jmcea3.0002909

1982-01-01

Journal of the Engineering Mechanics Division

Abstract:This paper studies methods of parameter estimation for linear multi-degree-of-freedom structural dynamic systems, based on observed records of the external forces and the structural responses. The auto-regressive and moving-average (ARMA) model is used for this purpose. It is found that the ARMA model is a convenient model representing linear multi-degree-of-freedom structural dynamic systems and that the model is highly compatible with the instrumental variable method and the maximum likelihood method of identification. In order to check the accuracy of the estimation methods, analytical simulation studies are performed on the basis of simulated data dealing with the aerodynamic coefficient matrices that appear in the equations of motion of a two-dimensional model of a suspension bridge. Then, these methods are applied to the same equations to identify the coefficient matrices using the field measurement data yielding good estimates of the system parameters even under large output noise conditions.
Estimation of Semivarying Coefficient Time Series Models with Arma Errors

Huang Lei,Yingcun Xia,Xu Qin

DOI: https://doi.org/10.1214/15-aos1430

2016-01-01

Abstract:Serial correlation in the residuals of time series models can cause bias in both model estimation and prediction. However, models with such serially correlated residuals are difficult to estimate, especially when the regression function is nonlinear. Existing estimation methods require strong assumption for the relation between the residuals and the regressors, which excludes the commonly used autoregressive models in time series analysis. By extending the Whittle likelihood estimation, this paper investigates in details a semi-parametric autoregressive model with ARMA sequence of residuals. Asymptotic normality of the estimators is established, and a model selection procedure is proposed. Numerical examples are employed to illustrate the performance of the proposed estimation method and the necessity of incorporating the serial correlation in the residuals.
ESTIMATION IN A SEMIPARAMETRIC MONOTONE VARYING COEFFICIENT PARTIALLY LINEAR MODEL WITH ERRORS IN VARIABLES

LIANG Baosheng,HU Tao,CUI Hengjian,TONG Xingwei

2013-01-01

Abstract:The estimators of both parameters and monotone regression function of a semiparametric monotone varying coefficient partially linear EV model are given via our monotone modified profile least square method.Some properties of the estimators are also given.Finally,simulations results show feasibility of the proposed method,and comparisons are made between the proposed method and profile least square method.
Local linear M-estimation for spatial processes in fixed-design models

Jia Chen,Li-Xin Zhang

DOI: https://doi.org/10.1007/s00184-009-0233-8

IF: 0.96

2009-01-01

Metrika

Abstract:We investigate the local linear M-estimation for regression in a fixed-design model when the errors are from a strongly mixing random field. We establish the weak and strong consistency as well as the asymptotic normality of the local linear M-estimator. The conditions on ρ (·) used in this paper are mild and allow many important special cases such as the least square estimator and the least absolute distance estimator.
M-estimation for linear models with exchangeable errors

Li Wang,Weidong Ma,Ying Yang

DOI: https://doi.org/10.1080/02331888.2024.2432558

IF: 2.346

2024-12-01

Statistics

Abstract:This paper focuses on the estimation of parameters in linear models with fixed regressors and exchangeable errors, especially, these errors are assumed to be a subset of an infinite exchangeable sequence. We propose a modified M-estimation to estimate the slope parameter, which outperforms the traditional M-estimation when the random errors are exchangeable. The modified M-estimation utilizes a design point centralization technique, leading to a more suitable estimator with improved theoretical properties. To establish the asymptotic properties of the modified M-estimator, we also develop a weighted central limit theorem for exchangeable sequences, which is of independent interest. Regarding the intercept, we prove that there is no consistent estimator for the intercept when the exchangeable errors have non-zero covariance, and we propose an unbiased estimator for the intercept as a viable compromise. Based on our theoretical findings, we develop a simulation-based approach to approximate the confidence set of the slope, and we establish a prediction model specifically designed for linear models with exchangeable errors. Additionally, we illustrate the finite sample performance of the proposed method through various numerical simulations and a real data application.

statistics & probability
Estimating and Testing for Smooth Structural Changes in Moment Condition Models

Haiqi Li,Jin Zhou,Yongmiao Hong

DOI: https://doi.org/10.2139/ssrn.3792747

IF: 3.363

2024-01-01

Journal of Econometrics

Abstract:Numerous studies have been devoted to estimating and testing for moment condition models.Most of the existing studies assume that structural parameters are either fixed or changed abruptlyover time. This study considers estimation of and testing for smooth structural changes in momentcondition models where the data generating process is assumed to be locally stationary. A novellocal generalized method of moment estimator and its boundary-corrected counterpart are proposed to estimate the smoothly changing structural parameters. Consistency and asymptotic normality are established, and an optimal weighting matrix and its consistent estimator are obtained. In particular, a consistent nonparametric test is proposed to check both smooth changes and abrupt breaks in structural parameters. The test is asymptotically pivotal and does not require prior information about the alternative. A Monte Carlo study is performed to illustrate the merits ofthe proposed test. In an empirical application, we document the time-varying features of the riskaversion parameter in an asset pricing model, which are consistent with business cycles and financial crisis.
Strong consistency rates for the estimators in a heteroscedastic EV model with missing responses

Jing-Jing Zhang,Yun-Peng Xiao

DOI: https://doi.org/10.1186/s13660-020-02411-y

2020-05-24

Journal of Inequalities and Applications

Abstract:Abstract This article is concerned with the semi-parametric error-in-variables (EV) model with missing responses: $y_{i}= \xi _{i}\beta +g(t_{i})+\epsilon _{i}$ y i = ξ i β + g ( t i ) + ε i , $x_{i}= \xi _{i}+\mu _{i}$ x i = ξ i + μ i , where $\epsilon _{i}=\sigma _{i}e_{i}$ ε i = σ i e i is heteroscedastic, $f(u_{i})=\sigma ^{2}_{i}$ f ( u i ) = σ i 2 , $y_{i}$ y i are the response variables missing at random, the design points $(\xi _{i},t_{i},u_{i})$ ( ξ i , t i , u i ) are known and non-random, β is an unknown parameter, $g(\cdot )$ g ( ⋅ ) and $f(\cdot )$ f ( ⋅ ) are functions defined on closed interval $[0,1]$ [ 0 , 1 ] , and the $\xi _{i}$ ξ i are the potential variables observed with measurement errors $\mu _{i}$ μ i , $e_{i}$ e i are random errors. Under appropriate conditions, we study the strong consistent rates for the estimators of β , $g(\cdot )$ g ( ⋅ ) and $f(\cdot )$ f ( ⋅ ) . Finite sample behavior of the estimators is investigated via simulations.

mathematics, applied
Robust Estimation Algorithm for Multiple-Structural Data

Zhiling Wang,Zonghai Chen

DOI: https://doi.org/10.3969/j.issn.1004-4132.2010.05.026

2010-01-01

Abstract:This paper proposes a robust method of parameter estimation and data classification for multiple-structural data based on the linear error in variable (EIV) model. The traditional EIV model fitting problem is analyzed and a robust growing algorithm is developed to extract the underlying linear structure of the observed data. Under the structural density assumption, the C-step technique borrowed from the Rousseeuw's robust MCD estimator is used to keep the algorithm robust and the mean-shift algorithm is adopted to ensure a good initialization. To eliminate the model ambiguities of the multiple-structural data, statistical hypotheses tests are used to refine the data classification and improve the accuracy of the model parameter estimation. Experiments show that the efficiency and robustness of the proposed algorithm.
Structural Parameter Estimation Using Generalized Estimating Equations for Regression Credibility Models

Chi Ho Lo,Wing Kam Fung,Zhong Yi Zhu

DOI: https://doi.org/10.2143/ast.37.2.2024070

2007-01-01

Astin Bulletin

Abstract:A generalized estimating equations (GEE) approach is developed to estimate structural parameters of a regression credibility model with independent or moving average errors. A comprehensive account is given to illustrate how GEE estimators are worked out within an extended Hachemeister (1975) framework. Evidenced by results of simulation studies, the proposed GEE estimators appear to outperform those given by Hachemeister, and have led to a remarkable improvement in accuracy of the credibility estimators so constructed.
NON‐STATIONARITY AND QUASI‐MAXIMUM LIKELIHOOD ESTIMATION ON A DOUBLE AUTOREGRESSIVE MODEL

Min Chen,Dong Li,Shiqing Ling

DOI: https://doi.org/10.1111/jtsa.12058

2013-01-01

Journal of Time Series Analysis

Abstract:This article first studies the non-stationarity of the first-order double AR model, which is defined by the random recurrence equation yt=phi 0yt-1+eta t gamma 0+alpha 0yt-12, where gamma(0) > 0, alpha(0) >= 0, and {eta(t)}is a sequence of i.i.d. symmetric random variables. It is shown that the double AR(1) model is explosive under the condition Elog|phi 0+eta t alpha 0|>0. Based on this, it is shown that the quasi-maximum likelihood estimator of (phi(0),alpha(0)) is consistent and asymptotically normal so that the unit root problem does not exist in the double AR(1) model. Simulation studies are carried out to assess the performance of the quasi-maximum likelihood estimator in finite samples.
Orthogonality-based bias-corrected empirical likelihood inference for partial linear varying coefficient EV models with longitudinal data

Yan Zhou,Ruoxi Mei,Yichuan Zhao,Zongliang Hu,Mingtao Zhao

DOI: https://doi.org/10.1016/j.cam.2023.115751

IF: 2.872

2024-01-07

Journal of Computational and Applied Mathematics

Abstract:In this paper, we study the model estimation for the partial linear varying coefficient errors-in-variables (EV) models with longitudinal data. Based on the empirical likelihood and quadratic inference functions (QIF), we propose an orthogonality-based bias-corrected empirical likelihood estimation method using the orthogonal decomposition (QR) method of matrix. The proposed method can handle the measurement errors of covariates and unknown within-subject correlation simultaneously, estimate the parametric and nonparametric components separately. Under some regularity conditions, the resulting estimator of the parametric component is asymptotic normal and the estimators of the nonparametric varying coefficients achieve the optimal convergence rate. Furthermore, we conduct simulation studies and a real data analysis to compare the performance of the proposed method and existing methods in finite samples. The results show that the feasibility of the proposed method is obvious.

mathematics, applied

Parameter Estimation of Linear Structural EV Model about Errors for AR(1) Model

A Method of ARX Model Estimation of Errors-in-Variables Systems

Arx Model Estimation Of Multivariable Errors-In-Variables Systems

ROBUST ESTIMATION IN PARAMETRIC TIME SERIES MODELS UNDER LONG‐ AND SHORT‐RANGE‐DEPENDENT STRUCTURES

A Estimate Class of G-M Linear Model

Asymptotic Behavior for S-estimators in Random Design Linear Model with Long-Range-dependent Errors

The Asymptotic Method for the Identification of Errors-In-Variables Systems

Empirical Likelihood Estimation for Linear Regression Models with AR(p) Error Terms

Modeling for a Class of Nonstationary ARMA Series 1

Parameter estimation of regression model with AR(p) error terms based on skew distributions with EM algorithm

Identification of Linear Structural Dynamic Systems

Estimation of Semivarying Coefficient Time Series Models with Arma Errors

ESTIMATION IN A SEMIPARAMETRIC MONOTONE VARYING COEFFICIENT PARTIALLY LINEAR MODEL WITH ERRORS IN VARIABLES

Local linear M-estimation for spatial processes in fixed-design models

M-estimation for linear models with exchangeable errors

Estimating and Testing for Smooth Structural Changes in Moment Condition Models

Strong consistency rates for the estimators in a heteroscedastic EV model with missing responses

Robust Estimation Algorithm for Multiple-Structural Data

Structural Parameter Estimation Using Generalized Estimating Equations for Regression Credibility Models

NON‐STATIONARITY AND QUASI‐MAXIMUM LIKELIHOOD ESTIMATION ON A DOUBLE AUTOREGRESSIVE MODEL

Orthogonality-based bias-corrected empirical likelihood inference for partial linear varying coefficient EV models with longitudinal data