Abstract:Vector autoregressive (VAR) models are widely used for causal discovery and forecasting in multivariate time series analyses in fields as diverse as neuroscience, environmental science, and econometrics. In the high-dimensional setting, model parameters are typically estimated by L1-regularized maximum likelihood; yet, when applied to VAR models, this technique produces a sizable trade-off between sparsity and bias with the choice of the regularization hyperparameter, and thus between causal discovery and prediction. That is, low-bias estimation entails dense parameter selection, and sparse selection entails increased bias; the former is useful in forecasting but less likely to yield scientific insight leading to discovery of causal influences, and conversely for the latter. This paper presents a scalable algorithm for simultaneous low-bias and low-variance estimation (hence good prediction) with sparse selection for high-dimensional VAR models. The method leverages the recently developed Union of Intersections (UoI) algorithmic framework for flexible, modular, and scalable feature selection and estimation that allows control of false discovery and false omission in feature selection while maintaining low bias and low variance. This paper demonstrates the superior performance of the UoI-VAR algorithm compared with other methods in simulation studies, exhibits its application in data analysis, and illustrates its good algorithmic scalability in multi-node distributed memory implementations.

Ridge estimation of uncertain vector autoregressive model with imprecise data

Ridge estimation for uncertain autoregressive moving average model with imprecise observations

Noise model based ν-support vector regression with its application to short-term wind speed forecasting

Ridge regularized estimation of VAR models for inference

Arx Model Estimation Of Multivariable Errors-In-Variables Systems

A Method of ARX Model Estimation of Errors-in-Variables Systems

Uncertain vector moving average model based on Welsch loss function

Uncertain least square support vector regression with imprecise observations

Uncertain quantile autoregressive model

A Vector Autoregressive Moving Average Model for Interval-Valued Time Series Data

Uncertain Regression Analysis: an Approach for Imprecise Observations

Variable selection in uncertain regression analysis with imprecise observations

Sparse, Low-bias, and Scalable Estimation of High Dimensional Vector Autoregressive Models via Union of Intersections

Least absolute deviations estimation for uncertain autoregressive moving average model with application to CO2 emissions

Multivariate uncertain regression model with imprecise observations

Confidence intervals for parameters in high-dimensional sparse vector autoregression

Residual and Confidence Interval for Uncertain Regression Model with Imprecise Observations.

Least absolute deviations for uncertain multivariate regression model

Cross validation for uncertain autoregressive model

Ridge-Type Pretest and Shrinkage Estimation Strategies in Spatial Error Models with an Application to a Real Data Example

Prediction Risk and Estimation Risk of the Ridgeless Least Squares Estimator under General Assumptions on Regression Errors