Abstract:As a special infinite-order vector autoregressive (VAR) model, the vector autoregressive moving average (VARMA) model can capture much richer temporal patterns than the widely used finite-order VAR model. However, its practicality has long been hindered by its non-identifiability, computational intractability, and difficulty of interpretation, especially for high-dimensional time series. This article proposes a novel sparse infinite-order VAR model for high-dimensional time series, which avoids all above drawbacks while inheriting essential temporal patterns of the VARMA model. As another attractive feature, the temporal and cross-sectional structures of the VARMA-type dynamics captured by this model can be interpreted separately, since they are characterized by different sets of parameters. This separation naturally motivates the sparsity assumption on the parameters determining the cross-sectional dependence. As a result, greater statistical efficiency and interpretability can be achieved with little loss of temporal information. We introduce two l1 -regularized estimation methods for the proposed model, which can be efficiently implemented via block coordinate descent algorithms, and derive the corresponding nonasymptotic error bounds. A consistent model order selection method based on the Bayesian information criteria is also developed. The merit of the proposed approach is supported by simulation studies and a real-world macroeconomic data analysis. Supplementary materials for this article are available online including a standardized description of the materials available for reproducing the work.

Estimation of Semivarying Coefficient Time Series Models with Arma Errors

Arx Model Estimation Of Multivariable Errors-In-Variables Systems

Regularization and variable selection for infinite variance autoregressive models

A Method of ARX Model Estimation of Errors-in-Variables Systems

Asymptotic inference of the ARMA model with time‐functional variance noises

Whittle Likelihood Estimation of Nonlinear Autoregressive Models with Moving Average Residuals

Modeling for a Class of Nonstationary ARMA Series 1

Simultaneous sparse model selection and coefficient estimation for heavy-tailed autoregressive processes

A Note on Self-Weighted Quantile Estimation for Infinite Variance Quantile Autoregression Models

Statistical inference on seemingly unrelated non-parametric regression models with serially correlated errors

Oracally Efficient Estimation and Consistent Model Selection for Auto-Regressive Moving Average Time Series with Trend

Online learning of ARIMA for time series prediction.(2016)

Efficient Estimation for Semivarying-Coefficient Models

An Interpretable and Efficient Infinite-Order Vector Autoregressive Model for High-Dimensional Time Series

Oracle-efficient estimation and trend inference in non-stationary time series with trend and heteroscedastic ARMA error

Parameter Estimation of Heavy-Tailed AR Model with Missing Data via Stochastic EM

Asymptotics of Estimators for Nonparametric Multivariate Regression Models with Long Memory

Autoregressive Coefficient Estimation in Nonparametric Analysis

Estimation of fixed effects partially linear varying coefficient spatial autoregressive model with disturbances correlated in space and time

On an asymmetric functional-coefficient ARCH-M model

Penalised inference for autoregressive moving average models with time-dependent predictors