Abstract:The vector autoregressive (VAR) model is a powerful tool in modeling complex time series and has been exploited in many fields. However, fitting high dimensional VAR model poses some unique challenges: On one hand, the dimensionality, caused by modeling a large number of time series and higher order autoregressive processes, is usually much higher than the time series length; On the other hand, the temporal dependence structure in the VAR model gives rise to extra theoretical challenges. In high dimensions, one popular approach is to assume the transition matrix is sparse and fit the VAR model using the "least squares" method with a lasso-type penalty. In this manuscript, we propose an alternative way in estimating the VAR model. The main idea is, via exploiting the temporal dependence structure, to formulate the estimating problem into a linear program. There is instant advantage for the proposed approach over the lasso-type estimators: The estimation equation can be decomposed into multiple sub-equations and accordingly can be efficiently solved in a parallel fashion. In addition, our method brings new theoretical insights into the VAR model analysis. So far the theoretical results developed in high dimensions (e.g., Song and Bickel (2011) and Kock and Callot (2012)) mainly pose assumptions on the design matrix of the formulated regression problems. Such conditions are indirect about the transition matrices and not transparent. In contrast, our results show that the operator norm of the transition matrices plays an important role in estimation accuracy. We provide explicit rates of convergence for both estimation and prediction. In addition, we provide thorough experiments on both synthetic and real-world equity data to show that there are empirical advantages of our method over the lasso-type estimators in both parameter estimation and forecasting.

Fast Two-Stage Variational Bayesian Approach to Estimating Panel Spatial Autoregressive Models with Unrestricted Spatial Weights Matrices

Identifying spatial interdependence in panel data with large N and small T

Variational Inference for Large Bayesian Vector Autoregressions

A Bayesian approach for the estimation of weight matrices in spatial autoregressive models

Fast Bayesian estimation of spatial count data models

A Variational Approach for Modeling High-dimensional Spatial Generalized Linear Mixed Models

Sparse Vector Autoregressive Modeling

Vector Autoregressive Models with Spatially Structured Coefficients for Time Series on a Spatial Grid

Sparse, Low-bias, and Scalable Estimation of High Dimensional Vector Autoregressive Models via Union of Intersections

Generalized Spatial and Spatiotemporal Autoregressive Conditional Heteroscedasticity

Forecasting macroeconomic data with Bayesian VARs: Sparse or dense? It depends!

A Direct Estimation of High Dimensional Stationary Vector Autoregressions

Spatial Panel VAR and Application to Forecast Influenza Incidence Rates of US States

Bayesian Nonstationary Spatial Modeling for Very Large Datasets

Banded Spatio-Temporal Autoregressions

Dynamic Spatial Panel Models: Networks, Common Shocks, and Sequential Exogeneity

Regularized Estimation in High-Dimensional Vector Auto-Regressive Models using Spatio-Temporal Information

Instrumental Variable Estimation of A Spatial Dynamic Panel Model with Endogenous Spatial Weights when T is Small

Estimation and testing of higher-order spatial autoregressive panel data error component models

Bayesian estimation for heterogeneous spatial autoregressive models with variance modelling

Bayesian vector heterogeneous autoregressive modelling