Abstract:As a special infinite-order vector autoregressive (VAR) model, the vector autoregressive moving average (VARMA) model can capture much richer temporal patterns than the widely used finite-order VAR model. However, its practicality has long been hindered by its non-identifiability, computational intractability, and difficulty of interpretation, especially for high-dimensional time series. This article proposes a novel sparse infinite-order VAR model for high-dimensional time series, which avoids all above drawbacks while inheriting essential temporal patterns of the VARMA model. As another attractive feature, the temporal and cross-sectional structures of the VARMA-type dynamics captured by this model can be interpreted separately, since they are characterized by different sets of parameters. This separation naturally motivates the sparsity assumption on the parameters determining the cross-sectional dependence. As a result, greater statistical efficiency and interpretability can be achieved with little loss of temporal information. We introduce two l1 -regularized estimation methods for the proposed model, which can be efficiently implemented via block coordinate descent algorithms, and derive the corresponding nonasymptotic error bounds. A consistent model order selection method based on the Bayesian information criteria is also developed. The merit of the proposed approach is supported by simulation studies and a real-world macroeconomic data analysis. Supplementary materials for this article are available online including a standardized description of the materials available for reproducing the work.

ARMA model order determination based on the eigenvalues of the overdetermined instrumental variable product moment

A New Method for AR Order Determination of an ARMA Process

A nonlinear recursive instrumental variables identification method of Hammerstein ARMAX system

Blind indentification algorithm of AR model using autocorrelation

Recursive Maximum Likelihood Method for the Identification of Hammerstein ARMAX System

Two-stage Method for System Identification Based on Asymptotic Theory

Model Order Reduction for High Dimensional Linear Systems Based on Rank-1 Incremental Proper Orthogonal Decomposition.

Hierarchical Least-Squares Based Iterative Identification for Multivariable Systems with Moving Average Noises

Combining eigenvalues and variation of eigenvectors for order determination

Identification of High-Dimensional ARMA Models with Binary-Valued Observations

Modeling for a Class of Nonstationary ARMA Series 1

Identification of ARMA models with binary-valued observations

Fitting ARMA Time Series Models without Identification: A Proximal Approach

Auxiliary model maximum likelihood least squares-based iterative algorithm for multivariable autoregressive output-error autoregressive moving average systems

Exact Maximum Likelihood Estimation of an ARMA(1, 1) Model with Incomplete Data

On scalable ARMA models

An Interpretable and Efficient Infinite-Order Vector Autoregressive Model for High-Dimensional Time Series

Identifiability and Estimation of Possibly Non-Invertible SVARMA Models: A New Parametrisation

Identification of ARMA Models Using Intermittent and Quantized Output Observations

Parameter-Covariance Maximum Likelihood Estimation

An Augmented Ud Identification Algorithm