Abstract:The vector autoregressive (VAR) model is a powerful tool in modeling complex time series and has been exploited in many fields. However, fitting high dimensional VAR model poses some unique challenges: On one hand, the dimensionality, caused by modeling a large number of time series and higher order autoregressive processes, is usually much higher than the time series length; On the other hand, the temporal dependence structure in the VAR model gives rise to extra theoretical challenges. In high dimensions, one popular approach is to assume the transition matrix is sparse and fit the VAR model using the "least squares" method with a lasso-type penalty. In this manuscript, we propose an alternative way in estimating the VAR model. The main idea is, via exploiting the temporal dependence structure, to formulate the estimating problem into a linear program. There is instant advantage for the proposed approach over the lasso-type estimators: The estimation equation can be decomposed into multiple sub-equations and accordingly can be efficiently solved in a parallel fashion. In addition, our method brings new theoretical insights into the VAR model analysis. So far the theoretical results developed in high dimensions (e.g., Song and Bickel (2011) and Kock and Callot (2012)) mainly pose assumptions on the design matrix of the formulated regression problems. Such conditions are indirect about the transition matrices and not transparent. In contrast, our results show that the operator norm of the transition matrices plays an important role in estimation accuracy. We provide explicit rates of convergence for both estimation and prediction. In addition, we provide thorough experiments on both synthetic and real-world equity data to show that there are empirical advantages of our method over the lasso-type estimators in both parameter estimation and forecasting.

Efficient Bayesian Model Class Selection of Vector Autoregressive Models for System Identification

Model Order Selection In Errors-In-Variables System Identification

Two-stage Method for System Identification Based on Asymptotic Theory

Two-step Adaptive Model Selection for Vector Autoregressive Processes

Bayesian system identification for structures considering spatial and temporal correlation

System Identification Of Mechanical Structures By A High-Order Multivariate Autoregressive Model

Dynamical System Identification, Model Selection and Model Uncertainty Quantification by Bayesian Inference

Simultaneous Structure and Parameter Identification of Multivariate Systems by Matrix Decomposition

A Direct Estimation of High Dimensional Stationary Vector Autoregressions

Hierarchical Bayesian Operational Modal Analysis: Theory and Computations

Bayesian model selection for complex dynamic systems

Subset Selection for Vector Autoregressive Processes Via Adaptive Lasso

Output-only Modal Parameter Estimator of Linear Time-Varying Structural Systems Based on Vector TAR Model and Least Squares Support Vector Machine

Auxiliary model maximum likelihood least squares-based iterative algorithm for multivariable autoregressive output-error autoregressive moving average systems

Multivariate recursive Bayesian linear regression and its applications to output-only identification of time-varying mechanical systems

A robust and efficient estimation and variable selection method for partially linear single-index models.

Bayesian Subset Selection for Two-Threshold Variable Autoregressive Models

Diagnostic analystics in the Bayesian vector autoregressive model

Two-stage Bayesian system identification using Gaussian discrepancy model

Moving Kriging Shape Function Modeling of Vector TARMA Models for Modal Identification of Linear Time-Varying Structural Systems

Robust Variable Selection and Estimation Based on Kernel Modal Regression