Abstract:As a special infinite-order vector autoregressive (VAR) model, the vector autoregressive moving average (VARMA) model can capture much richer temporal patterns than the widely used finite-order VAR model. However, its practicality has long been hindered by its non-identifiability, computational intractability, and difficulty of interpretation, especially for high-dimensional time series. This article proposes a novel sparse infinite-order VAR model for high-dimensional time series, which avoids all above drawbacks while inheriting essential temporal patterns of the VARMA model. As another attractive feature, the temporal and cross-sectional structures of the VARMA-type dynamics captured by this model can be interpreted separately, since they are characterized by different sets of parameters. This separation naturally motivates the sparsity assumption on the parameters determining the cross-sectional dependence. As a result, greater statistical efficiency and interpretability can be achieved with little loss of temporal information. We introduce two l1 -regularized estimation methods for the proposed model, which can be efficiently implemented via block coordinate descent algorithms, and derive the corresponding nonasymptotic error bounds. A consistent model order selection method based on the Bayesian information criteria is also developed. The merit of the proposed approach is supported by simulation studies and a real-world macroeconomic data analysis. Supplementary materials for this article are available online including a standardized description of the materials available for reproducing the work.

A New Method for AR Order Determination of an ARMA Process

ARMA model order determination based on the eigenvalues of the overdetermined instrumental variable product moment

Blind indentification algorithm of AR model using autocorrelation

A nonlinear recursive instrumental variables identification method of Hammerstein ARMAX system

Recursive Maximum Likelihood Method for the Identification of Hammerstein ARMAX System

A Method of ARX Model Estimation of Errors-in-Variables Systems

Two-stage Method for System Identification Based on Asymptotic Theory

Multivariable Process Identification Method Based on Asymptotic Theory

Modeling for a Class of Nonstationary ARMA Series 1

Identification of High-Dimensional ARMA Models with Binary-Valued Observations

Identification of deterministic switched ARX systems via identification of algebraic varieties

Identification of ARMA models with binary-valued observations

On scalable ARMA models

Auxiliary model maximum likelihood least squares-based iterative algorithm for multivariable autoregressive output-error autoregressive moving average systems

A Two-Directional Arnoldi Process and Its Application to Parametric Model Order Reduction

An Interpretable and Efficient Infinite-Order Vector Autoregressive Model for High-Dimensional Time Series

SIMULATION OF BLIND IDENTIFICATION WITH ARMA MODEL AND ITS APPLICATION TO MACHINE FAULT DIAGNOSIS

Identification of Deterministic Hybrid ARX Systems via the Identification of Algebraic Varieties ?

A Structured Quasi-Arnoldi Procedure for Model Order Reduction of Second-Order Systems

Two-step Adaptive Model Selection for Vector Autoregressive Processes

Statistical Inference for ARMA Time Series with Moving Average Trend