Abstract:Bayesian cross-validation (CV) is a popular method for predictive model assessment that is simple to implement and broadly applicable. A wide range of CV schemes is available for time series applications, including generic leave-one-out (LOO) and K-fold methods, as well as specialized approaches intended to deal with serial dependence such as leave-future-out (LFO), h-block, and hv-block. Existing large-sample results show that both specialized and generic methods are applicable to models of serially-dependent data. However, large sample consistency results overlook the impact of sampling variability on accuracy in finite samples. Moreover, the accuracy of a CV scheme depends on many aspects of the procedure. We show that poor design choices can lead to elevated rates of adverse selection. In this paper, we consider the problem of identifying the regression component of an important class of models of data with serial dependence, autoregressions of order p with q exogenous regressors (ARX(p,q)), under the logarithmic scoring rule. We show that when serial dependence is present, scores computed using the joint (multivariate) density have lower variance and better model selection accuracy than the popular pointwise estimator. In addition, we present a detailed case study of the special case of ARX models with fixed autoregressive structure and variance. For this class, we derive the finite-sample distribution of the CV estimators and the model selection statistic. We conclude with recommendations for practitioners.

Strong consistent model selection for general causal time series

Some asymptotic results for time series model selection

STATISTICAL INFERENCE FOR MEASUREMENT EQUATION SELECTION IN THE LOG-REALGARCH MODEL

Regularization and variable selection for infinite variance autoregressive models

Consistent model selection procedure for general integer-valued time series

Variable selection in partially time-varying coefficient models

ROBUST ESTIMATION IN PARAMETRIC TIME SERIES MODELS UNDER LONG‐ AND SHORT‐RANGE‐DEPENDENT STRUCTURES

Model selection for weakly dependent time series forecasting

Consistent Model Selection Procedure for Random Coefficient INAR Models

Simultaneous sparse model selection and coefficient estimation for heavy-tailed autoregressive processes

A Model-Free Consistent Test for Structural Change in Regression Possibly with Endogeneity

Adaptive Covariance Estimation with model selection

Advances in Bayesian model selection consistency for high-dimensional generalized linear models

Model selection for generalized linear models with weak factors

Strong Consistency of Maximum Quasi-Likelihood Estimators in Generalized Linear Models with Fixed and Adaptive Designs

Cross-validatory model selection for Bayesian autoregressions with exogenous regressors

Variable Selection in Robust Joint Mean and Covariance Model for Longitudinal Data Analysis

Simultaneous inference for time-varying models

Data-Driven Tuning Parameter Selection for High-Dimensional Vector Autoregressions

Graphical LASSO Based Model Selection for Time Series

Two-step Adaptive Model Selection for Vector Autoregressive Processes