Abstract:The vector autoregressive (VAR) model is a powerful tool in modeling complex time series and has been exploited in many fields. However, fitting high dimensional VAR model poses some unique challenges: On one hand, the dimensionality, caused by modeling a large number of time series and higher order autoregressive processes, is usually much higher than the time series length; On the other hand, the temporal dependence structure in the VAR model gives rise to extra theoretical challenges. In high dimensions, one popular approach is to assume the transition matrix is sparse and fit the VAR model using the "least squares" method with a lasso-type penalty. In this manuscript, we propose an alternative way in estimating the VAR model. The main idea is, via exploiting the temporal dependence structure, to formulate the estimating problem into a linear program. There is instant advantage for the proposed approach over the lasso-type estimators: The estimation equation can be decomposed into multiple sub-equations and accordingly can be efficiently solved in a parallel fashion. In addition, our method brings new theoretical insights into the VAR model analysis. So far the theoretical results developed in high dimensions (e.g., Song and Bickel (2011) and Kock and Callot (2012)) mainly pose assumptions on the design matrix of the formulated regression problems. Such conditions are indirect about the transition matrices and not transparent. In contrast, our results show that the operator norm of the transition matrices plays an important role in estimation accuracy. We provide explicit rates of convergence for both estimation and prediction. In addition, we provide thorough experiments on both synthetic and real-world equity data to show that there are empirical advantages of our method over the lasso-type estimators in both parameter estimation and forecasting.

Penalised inference for autoregressive moving average models with time-dependent predictors

Penalized Time-Varying Model Averaging

Regularization and variable selection for infinite variance autoregressive models

SCAD-penalized Regression for Varying-Coefficient Models with Autoregressive Errors

Simultaneous sparse model selection and coefficient estimation for heavy-tailed autoregressive processes

A Vector Autoregressive Moving Average Model for Interval-Valued Time Series Data

Online learning of ARIMA for time series prediction.(2016)

Network-adaptive Robust Penalized Estimation of Time-Varying Coefficient Models with Longitudinal Data

Partial Linear Model Averaging Prediction for Longitudinal Data

Regularized Estimation in High-Dimensional Vector Auto-Regressive Models using Spatio-Temporal Information

An Interpretable and Efficient Infinite-Order Vector Autoregressive Model for High-Dimensional Time Series

Autoregressive moving average modeling in the financial sector

Penalized Multiply Robust Estimation in High-Order Autoregressive Processes with Missing Explanatory Variables

A Direct Estimation of High Dimensional Stationary Vector Autoregressions

A Bayesian Time-Varying Autoregressive Model for Improved Short- and Long-Term Prediction

Poisson Autoregressive Process Modeling Via the Penalized Conditional Maximum Likelihood Procedure

Oracally Efficient Estimation and Consistent Model Selection for Auto-Regressive Moving Average Time Series with Trend

Model averaging prediction for time series models with a diverging number of parameters

A Tutorial on Estimating Time-Varying Vector Autoregressive Models

Data-Driven Tuning Parameter Selection for High-Dimensional Vector Autoregressions

A Class of Time-Varying Vector Moving Average Models: Nonparametric Kernel Estimation and Application