Formula to evaluate a limit related to AR(k) model of Statistics

Yuhao Liu,Jan Vrbik

DOI: https://doi.org/10.48550/arXiv.1506.03131

2015-06-10

Abstract:Computing moments of various parameter estimators related to an autoregressive model of Statistics, one needs to evaluate several expressions of the type mentioned in the title of this article. We proceed to derive the corresponding formulas.

Statistics Theory

What problem does this paper attempt to address?

General proof of a limit related to AR(k) model of Statistics

Jan Vrbik

DOI: https://doi.org/10.48550/arXiv.1908.00428

2019-08-01

Abstract:Computing moments of various parameter estimators related to an autoregressive model of Statistics, one needs to evaluate several non-trivial limits. This was done by <a class="link-https" data-arxiv-id="1506.03131" href="https://arxiv.org/abs/1506.03131">arXiv:1506.03131</a> for the case of two, three and four dimensions; in this article, we present a proof of a fully general formula, based on an ingenious solution of <a class="link-external link-https" href="https://mathoverflow.net/users/4312/fedor-petrov" rel="external noopener nofollow">this https URL</a>.

Statistics Theory
The Law of Iterated Logarithm of Rescaled Range Statistics for AR（1） Model

Zheng Yan Lin,Sung Chul Lee

DOI: https://doi.org/10.1007/s10114-005-0553-1

2005-01-01

Acta Mathematica Sinica English Series

Abstract:Let {X n , n ≥ 0} be an AR(1) process. Let Q(n) be the rescaled range statistic, orthe R/S statistic for {X n } which is given by $(\max _{{1 \leqslant k \leqslant n}} ({\sum\nolimits_{j = 1}^k {(X_{j} - \bar{X}_{n} )) - \min _{{1 \leqslant k \leqslant n}} ({\sum\nolimits_{j = 1}^k {(X_{j} - \bar{X}_{n} )))/(n^{{ - 1}} {\sum\nolimits_{j = 1}^n {(X_{j} - \bar{X}_{n} )^{2} )^{{1/2}} } }} }} }$where $\bar{X}_{n} = n^{{ - 1}} {\sum\nolimits_{j = 1}^n {X_{j} .} }$In this paper we show a law of iteratedlogarithm for rescaled range statistics Q(n) for AR(1) model.
Limit Theory for Random Coefficient Autoregressive Process under Possibly Infinite Variance Error Sequence

Zhiyong Zhou,Zhengyan Lin

DOI: https://doi.org/10.1080/03610926.2014.904354

2016-01-01

Abstract:An asymptotic theory was given by Zhang and Yang (2010) for first-order random coefficient autoregressive time series y(t) = ((n) + phi(n))y(t - 1) + u(t), t = 1, ..., n, with {u(t)} is a sequence of independent and identically distributed random variables with mean 0 and a finite second moment, (n) is a sequence of real numbers, and phi(n) is a sequence of random variables. Conditional least squares estimator was shown to be asymptotically normality distributed. This model extended the moderate deviations from a unit root model proposed by Phillips and Magdalinos (2007), which just considered the case that (n) = 1 + c/k(n) and phi(n) 0. In this paper, we show that the asymptotic theory in Zhang and Yang (2010) still holds when the truncated second moment of the errors l(x) = E[u(1)(2)1{|u(1)| x}] is slowly varying function at . Moreover, we propose a pivot for , the limit distribution of which is proved to be standard normal.
Limit Theory for A General Class of Garch Models with Just Barely Infinite Variance

Rong-Mao Zhang,Zheng-Yan Lin

DOI: https://doi.org/10.1111/j.1467-9892.2011.00749.x

2011-01-01

Journal of Time Series Analysis

Abstract:In this article, limit theory is established for a general class of generalized autoregressive conditional heteroskedasticity models given by ɛt = σtηt and σt = f (σt−1, σt−2,…, σt−p, ɛt−1, ɛt−2,…, ɛt−q), when {ɛt} is a process with just barely infinite variance, that is, {ɛt} is a process with infinite variance but in the domain of normal attraction. In particular, we show that under some regular conditions, converges weakly to a Gaussian process. Applications of the asymptotic results to statistical inference, such as unit root test and sample autocorrelation, are also investigated. The obtained result fills in a gap between the classical infinite variance and finite variance in the literature. Further, when applying our limiting result to Dickey–Fuller (DF) test in a unit root model with integrated generalized autoregressive conditional heteroskedasticity (IGARCH) errors, it just confirms the simulation result of Kourogenis and Pittis (2008) that the DF statistics with IGARCH errors converges in law to the standard DF distribution.
Arx Model Estimation Of Multivariable Errors-In-Variables Systems

Xin Liu,Yucai Zhu

DOI: https://doi.org/10.1016/j.ifacol.2018.09.111

2018-01-01

Abstract:This paper proposes a method for the estimation of ARX (Autoregressive with external input) model of multivariable errors-in-variables (EIV) systems. In parameter estimation, the input noise variances need to be estimated in order to obtain a consistent estimate. Two methods are developed to estimate the input noises variances. One way is to minimize a correlated output error criterion. The other way is to extract the input noises variances from the power spectrum of measured inputs. When the input noise variances are known, a modified least-squares method will give consistent estimate for the EIV system. Numerical simulations are used to illustrate the performance of the method. This work lays down a basis for extending the asymptotic method of Liu and Zhu (2017) to multivariable EIV systems which starts from a high order ARX model estimation. (C) 2018, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.
Mildly Explosive Autoregression with Anti-persistent Errors

Yiu Lim Lui,Weilin Xiao,Jun Yu

DOI: https://doi.org/10.1111/obes.12395

2021-01-01

Oxford Bulletin of Economics and Statistics

Abstract:An asymptotic distribution is derived for the least squares (LS) estimate of a first-order autoregression with a mildly explosive root and anti-persistent errors. While the sample moments depend on the Hurst parameter asymptotically, the Cauchy limiting distribution theory remains valid for the LS estimates in the model without intercept and a model with an asymptotically negligible intercept. Monte Carlo studies are designed to check the precision of the Cauchy distribution in finite samples. An empirical study based on the monthly NASDAQ index highlights the usefulness of the model and the new limiting distribution.
A Method of ARX Model Estimation of Errors-in-Variables Systems

xin liu,yucai zhu

DOI: https://doi.org/10.1016/j.ifacol.2015.12.143

2015-01-01

IFAC-PapersOnLine

Abstract:This work proposes an estimation method of ARX (autoregressive with external input) models of errors-in-variables (EIV) systems. In ARX model estimation, the input noise variance needs to be estimated in order to obtain a consistent estimate. In this method, an error criterion is proposed and the input noise variance is obtained by minimizing the loss function. The global minimum can be obtained because the optimization procedure is a one-parameter optimization problem. Consistency of the proposed parameter estimation is proved. Simulations are used to illustrate its performance.
A Least Squares Estimator for Lévy-driven Moving Averages Based on Discrete Time Observations

Shibin Zhang,Zhengyan Lin,Xinsheng Zhang

DOI: https://doi.org/10.1080/03610926.2012.763093

2013-01-01

Abstract:This article is concerned with a least squares estimator (LSE) of the kernel function parameter theta for a Levy-driven moving average of the form X(t) = integral(t)(-infinity) K(theta(t - s)) dL(s), where L = {L(t), t is an element of R} is a Levy process without the Brownian motion part, K is a kernel function and theta > 0 is a parameter. Let h be the time span between two consecutive observations and let n be the size of sample. As h -> 0 and nh -> infinity, consistency and asymptotic normality of the LSE are studied. The small-sample performance of the LSE is evaluated by means of a simulation experiment. Finally, two real-data applications show that the Levy-driven moving average gives a good approximation to the autocorrelation of the process.
Asymptotic Inferences for an AR(1) Model with a Change Point and Possibly Infinite Variance

Tianxiao Pang,Danna Zhang

DOI: https://doi.org/10.1080/03610926.2013.802349

2015-01-01

Communication in Statistics- Theory and Methods

Abstract:The basic model in this paper is an AR(1) model with a structural break in the AR parameter at an unknown time k(0). That is, y(t) = (1)y(t - 1)I{t k(0)} + (2)y(t - 1)I{t > k(0)} + E-t, t = 1, 2, , T, where I{ } denotes the indicator function. Suppose |(1)| < 1, |(2)| < 1, and {E-t, t 1} is a sequence of i.i.d. random variables which are in the domain of attraction of the normal law with zero mean and possibly infinite variance, then the limiting distributions for the least squares estimators of (1) and (2) are studied in the present paper, which extend some results in Chong (2001).
A Note on the Consistency of a Robust Estimator for Threshold Autoregressive Processes

Li-Xin Zhang,Wai-Sum Chan,Siu-Hung Cheung,King-Chi Hung

DOI: https://doi.org/10.1016/j.spl.2008.10.036

IF: 0.718

2008-01-01

Statistics & Probability Letters

Abstract:The method of conditional least squares is commonly used for estimating threshold autoregressive parameters, and its consistency was derived by Chan [Chan, K.S., 1993. Consistency and limiting distribution of the least squares estimator of a threshold autoregressive model. Annals of Statistics 21, 520–533]. In this note we consider a general class of robust estimators for threshold autoregressive models, and under some regularity conditions and a proper choice of the weight function, the consistency is demonstrated.
Iterated scaling limits for aggregation of random coefficient AR(1) and INAR(1) processes

Fanni Nedényi,Gyula Pap

DOI: https://doi.org/10.48550/arXiv.1601.04679

2016-01-19

Abstract:We discuss joint temporal and contemporaneous aggregation of $N$ independent copies of strictly stationary AR(1) and INteger-valued AutoRegressive processes of order 1 (INAR(1)) with random coefficient $\alpha \in (0, 1)$ and idiosyncratic innovations. Assuming that $\alpha$ has a density function of the form $\psi(x) (1 - x)^\beta$, $x \in (0, 1)$, with $\lim_{x\uparrow 1} \psi(x) = \psi_1 \in (0, \infty)$, different Brownian limit processes of appropriately centered and scaled aggregated partial sums are shown to exist in case $\beta=1$ when taking first the limit as $N \to \infty$ and then the time scale $n \to \infty$, or vice versa. This paper completes the one of Pilipauskaitė and Surgailis (2014), and Barczy, Nedényi and Pap (2015), where the iterated limits are given for every other possible value of the parameter $\beta$ for the two types of models.

Probability
Moment conditions for random coefficient AR($\infty$) under non-negativity assumptions

Pascal Maillard,Olivier Wintenberger

2023-12-06

Abstract:We consider random coefficient autoregressive models of infinite order (AR($\infty$)) under the assumption of non-negativity of the coefficients. We develop novel methods yielding sufficient or necessary conditions for finiteness of moments, based on combinatorial expressions of first and second moments. The methods based on first moments recover previous sufficient conditions by Doukhan and Wintenberger in our setting. The second moment method provides in particular a necessary and sufficient condition for finiteness of second moments which is different, but shown to be equivalent to the classical criterion of Nicholls and Quinn in the case of finite order. We further illustrate our results through two examples.

Probability
Asymptotic Inferences for an Ar(1) Model with A Change Point: Stationary and Nearly Non-Stationary Cases

Tianxiao Pang,Danna Zhang,Terence Tai-Leung Chong

DOI: https://doi.org/10.1111/jtsa.12055

2013-01-01

Abstract:This article examines the asymptotic inference for AR(1) models with a possible structural break in the AR parameter β near the unity at an unknown time k0. Consider the model yt = β1yt − 1I{t ≤ k0} + β2yt − 1I{t > k0} + ϵt, t = 1,2, … ,T, where I{ ⋅ } denotes the indicator function. We examine two cases: case I | β1 | < 1,β2 = β2T = 1 − c ∕ T; and case II β1 = β1T = 1 − c ∕ T, | β2 | < 1, where c is a fixed constant, and {ϵt,t ≥ 1} is a sequence of i.i.d. random variables, which are in the domain of attraction of the normal law with zero means and possibly infinite variances. We derive the limiting distributions of the least squares estimators of β1 and β2 and that of the break‐point estimator for shrinking break for the aforementioned cases. Monte Carlo simulations are conducted to demonstrate the finite‐sample properties of the estimators. Our theoretical results are supported by Monte Carlo simulations.
Linear parametric model checks for functional time series

W. González-Manteiga,M.D. Ruiz-Medina,M. Febrero-Bande

2024-06-30

Abstract:The presented methodology for testing the goodness-of-fit of an Autoregressive Hilbertian model (ARH(1) model) provides an infinite-dimensional formulation of the approach proposed in Koul and Stute (1999), based on empirical process marked by residuals. Applying a central and functional central limit result for Hilbert-valued martingale difference sequences, the asymptotic behavior of the formulated H-valued empirical process, also indexed by H, is obtained under the null hypothesis. The limiting process is H-valued generalized (i.e., indexed by H) Wiener process, leading to an asymptotically distribution free test. Consistency of the test is also proved. The case of misspecified autocorrelation operator of the ARH(1) process is addressed. The asymptotic equivalence in probability, uniformly in the norm of H, of the empirical processes formulated under known and unknown autocorrelation operator is obtained. Beyond the Euclidean setting, this approach allows to implement goodness of fit testing in the context of manifold and spherical functional autoregressive processes.

Statistics Theory
STRUCTURAL CHANGE IN NONSTATIONARY AR(1) MODELS

Tianxiao Pang,Terence Tai-Leung Chong,Danna Zhang

DOI: https://doi.org/10.1017/s0266466617000317

IF: 1.968

2017-01-01

Econometric Theory

Abstract:This article revisits the asymptotic inference for nonstationary AR(1) models of Phillips and Magdalinos (2007a) by incorporating a structural change in the AR parameter at an unknown time k0. Consider the model ${y_t} = {\beta _1}{y_{t - 1}}I\{ t \le {k_0}\} + {\beta _2}{y_{t - 1}}I\{ t > {k_0}\} + {\varepsilon _t},t = 1,2, \ldots ,T$, where I{·} denotes the indicator function, one of ${\beta _1}$ and ${\beta _2}$ depends on the sample size T, and the other is equal to one. We examine four cases: Case (I): ${\beta _1} = {\beta _{1T}} = 1 - c/{k_T}$, ${\beta _2} = 1$; (II): ${\beta _1} = 1$, ${\beta _2} = {\beta _{2T}} = 1 - c/{k_T}$; (III): ${\beta _1} = 1$, ${\beta _2} = {\beta _{2T}} = 1 + c/{k_T}$; and case (IV): ${\beta _1} = {\beta _{1T}} = 1 + c/{k_T}$, ${\beta _2} = 1$, where c is a fixed positive constant, and kT is a sequence of positive constants increasing to ∞ such that kT = o(T). We derive the limiting distributions of the t-ratios of ${\beta _1}$ and ${\beta _2}$ and the least squares estimator of the change point for the cases above under some mild conditions. Monte Carlo simulations are conducted to examine the finite-sample properties of the estimators. Our theoretical findings are supported by the Monte Carlo simulations.
Asymptotic of the Lr-norm of density estimators in the autoregressive time series

Xiaorong Yang,Ke-Ang Fu,Li-Xin Zhang

DOI: https://doi.org/10.1080/02331880903445162

IF: 2.346

2011-01-01

Statistics

Abstract:In this article, we consider autoregressive models with independent identically distributed innovations. We compare the kernel density estimator of fitted residuals with the theoretical kernel density estimator based on unobserved innovations. We show that the Lr-norm of the difference is asymptotically negligible.
Second Moment Estimator for An AR(1) Model Driven by A Long Memory Gaussian Noise

Yong Chen,Li Tian,Ying Li

DOI: https://doi.org/10.48550/arXiv.2008.12443

2020-12-02

Abstract:In this paper, we consider an inference problem for the first order autoregressive process driven by a long memory stationary Gaussian process. Suppose that the covariance function of the noise can be expressed as $\abs{k}^{2H-2}$ times a function slowly varying at infinity. The fractional Gaussian noise and the fractional ARIMA model and some others Gaussian noise are special examples that satisfy this assumption. We propose a second moment estimator and prove the strong consistency and give the asymptotic distribution. Moreover, when the limit distribution is Gaussian, we give the upper Berry-Esséen bound by means of Fourth moment theorem.

Statistics Theory
On the Limiting Distribution of Sieve VAR($\infty$) Estimators in Small Samples

Giovanni Ballarin

DOI: https://doi.org/10.48550/arXiv.2104.13693

2021-04-28

Abstract:When a finite order vector autoregressive model is fitted to VAR($\infty$) data the asymptotic distribution of statistics obtained via smooth functions of least-squares estimates requires care. Lütkepohl and Poskitt (1991) provide a closed-form expression for the limiting distribution of (structural) impulse responses for sieve VAR models based on the Delta method. Yet, numerical simulations have shown that confidence intervals built in such way appear overly conservative. In this note I argue that these results stem naturally from the limit arguments used in Lütkepohl and Poskitt (1991), that they manifest when sieve inference is improperly applied, and that they can be "remedied" by either using bootstrap resampling or, simply, by using standard (non-sieve) asymptotics.

Methodology
Navigating the Financial Landscape: The Power and Limitations of the ARIMA Model

Jin Liu

DOI: https://doi.org/10.54097/9zf6kd91

2024-03-29

Abstract:In today's dynamic world, accurately predicting future trends is crucial. This is the reason why the Auto-Regressive Integrated Moving Average (ARIMA) model has become so important. ARIMA is a statistical tool that helps analyze time series data and make predictions. ARIMA has proven to be incredibly valuable in the finance industry in applications. It greatly improves stock price forecasting with accuracy rates exceeding 70%, which empowers traders and investors alike. By integrating with GARCH models, ARIMA can even reduce portfolio volatility by up to 20%, which is great for risk management purposes. It also plays a role in credit risk assessment, economic forecasting, and option pricing. However, it's worth noting that ARIMA does have some limitations to be aware of. For example, its linear assumptions can lead to errors during events like market crashes. The process of selecting parameters can also introduce subjectivity and uncertainty into the analysis. Additionally, while ARIMA performs well for short-term forecasting it tends to have more significant errors when it comes to long-term predictions. Furthermore, since ARIMA relies on historical data it may not fully account for external factors naturally occurring in the real world. To overcome these limitations and ensure financial analysis and forecasting it's crucial to complement ARIMA with other models.
Limit theorems for functionals of long memory linear processes with infinite variance

Hui Liu,Yudan Xiong,Fangjun Xu

2023-09-21

Abstract:Let $X=\{X_n: n\in\mathbb{N}\}$ be a long memory linear process in which the coefficients are regularly varying and innovations are independent and identically distributed and belong to the domain of attraction of an $\alpha$-stable law with $\alpha\in (0, 2)$. Then, for any integrable and square integrable function $K$ on $\mathbb{R}$, under certain mild conditions, we establish the asymptotic behavior of the partial sum process \[ \left\{\sum\limits_{n=1}^{[Nt]}\big[K(X_n)-\E K(X_n)\big]:\; t\geq 0\right\} \] as $N$ tends to infinity, where $[Nt]$ is the integer part of $Nt$ for $t\geq 0$.

Probability

Formula to evaluate a limit related to AR(k) model of Statistics

General proof of a limit related to AR(k) model of Statistics

The Law of Iterated Logarithm of Rescaled Range Statistics for AR（1） Model

Limit Theory for Random Coefficient Autoregressive Process under Possibly Infinite Variance Error Sequence

Limit Theory for A General Class of Garch Models with Just Barely Infinite Variance

Arx Model Estimation Of Multivariable Errors-In-Variables Systems

Mildly Explosive Autoregression with Anti-persistent Errors

A Method of ARX Model Estimation of Errors-in-Variables Systems

A Least Squares Estimator for Lévy-driven Moving Averages Based on Discrete Time Observations

Asymptotic Inferences for an AR(1) Model with a Change Point and Possibly Infinite Variance

A Note on the Consistency of a Robust Estimator for Threshold Autoregressive Processes

Iterated scaling limits for aggregation of random coefficient AR(1) and INAR(1) processes

Moment conditions for random coefficient AR($\infty$) under non-negativity assumptions

Asymptotic Inferences for an Ar(1) Model with A Change Point: Stationary and Nearly Non-Stationary Cases

Linear parametric model checks for functional time series

STRUCTURAL CHANGE IN NONSTATIONARY AR(1) MODELS

Asymptotic of the Lr-norm of density estimators in the autoregressive time series

Second Moment Estimator for An AR(1) Model Driven by A Long Memory Gaussian Noise

On the Limiting Distribution of Sieve VAR($\infty$) Estimators in Small Samples

Navigating the Financial Landscape: The Power and Limitations of the ARIMA Model

Limit theorems for functionals of long memory linear processes with infinite variance