Abstract:The vector autoregressive (VAR) model is a powerful tool in modeling complex time series and has been exploited in many fields. However, fitting high dimensional VAR model poses some unique challenges: On one hand, the dimensionality, caused by modeling a large number of time series and higher order autoregressive processes, is usually much higher than the time series length; On the other hand, the temporal dependence structure in the VAR model gives rise to extra theoretical challenges. In high dimensions, one popular approach is to assume the transition matrix is sparse and fit the VAR model using the "least squares" method with a lasso-type penalty. In this manuscript, we propose an alternative way in estimating the VAR model. The main idea is, via exploiting the temporal dependence structure, to formulate the estimating problem into a linear program. There is instant advantage for the proposed approach over the lasso-type estimators: The estimation equation can be decomposed into multiple sub-equations and accordingly can be efficiently solved in a parallel fashion. In addition, our method brings new theoretical insights into the VAR model analysis. So far the theoretical results developed in high dimensions (e.g., Song and Bickel (2011) and Kock and Callot (2012)) mainly pose assumptions on the design matrix of the formulated regression problems. Such conditions are indirect about the transition matrices and not transparent. In contrast, our results show that the operator norm of the transition matrices plays an important role in estimation accuracy. We provide explicit rates of convergence for both estimation and prediction. In addition, we provide thorough experiments on both synthetic and real-world equity data to show that there are empirical advantages of our method over the lasso-type estimators in both parameter estimation and forecasting.

Variable Selection for an Improved INAR(1) Model with Explanatory Variables Using 2SPCLS

Regularization and variable selection for infinite variance autoregressive models

Variable selection for first‐order Poisson integer‐valued autoregressive model with covariables

Bayesian variable selection in linear regression models with instrumental variables

spINAR: An R Package for Semiparametric and Parametric Estimation and Bootstrapping of Integer-Valued Autoregressive (INAR) Models

Consistent Model Selection Procedure for Random Coefficient INAR Models

Simultaneous sparse model selection and coefficient estimation for heavy-tailed autoregressive processes

Variable Selection of Spatial Logistic Autoregressive Model with Linear Constraints

Two-step conditional least squares estimation for the bivariate Z-valued INAR(1) model with bivariate Skellam innovations

A Two-Step Estimation Method for a Time-Varying INAR Model

Sparse Vector Autoregressive Modeling

Variable selection of partially linear varying coefficient spatial autoregressive model

Deep neural networks for variable selection of higher-order nonparametric spatial autoregressive model

Variable Selection for the Partial Linear Single-Index Model

Huber Loss Meets Spatial Autoregressive Model: A Robust Variable Selection Method with Prior Information

Adaptive lasso variable selection method for semiparametric spatial autoregressive panel data model with random effects

Subset Selection for Vector Autoregressive Processes Via Adaptive Lasso

Variable Selection in Robust Joint Mean and Covariance Model for Longitudinal Data Analysis

A Direct Estimation of High Dimensional Stationary Vector Autoregressions

An efficient optimization approach for best subset selection in linear regression, with application to model selection and fitting in autoregressive time-series

Robust exponential squared loss-based variable selection for high-dimensional single-index varying-coefficient model