Abstract:We consider forecasting a single time series when there is a large number of predictors and a possible nonlinear effect. The dimensionality was first reduced via a high-dimensional (approximate) factor model implemented by the principal component analysis. Using the extracted factors, we develop a novel forecasting method called the sufficient forecasting, which provides a set of sufficient predictive indices, inferred from high-dimensional predictors, to deliver additional predictive power. The projected principal component analysis will be employed to enhance the accuracy of inferred factors when a semi-parametric (approximate) factor model is assumed. Our method is also applicable to cross-sectional sufficient regression using extracted factors. The connection between the sufficient forecasting and the deep learning architecture is explicitly stated. The sufficient forecasting correctly estimates projection indices of the underlying factors even in the presence of a nonparametric forecasting function. The proposed method extends the sufficient dimension reduction to high-dimensional regimes by condensing the cross-sectional information through factor models. We derive asymptotic properties for the estimate of the central subspace spanned by these projection directions as well as the estimates of the sufficient predictive indices. We further show that the natural method of running multiple regression of target on estimated factors yields a linear estimate that actually falls into this central subspace. Our method and theory allow the number of predictors to be larger than the number of observations. We finally demonstrate that the sufficient forecasting improves upon the linear forecasting in both simulation studies and an empirical study of forecasting macroeconomic variables.

Are Latent Factor Regression and Sparse Regression Adequate?

Factor Augmented Sparse Throughput Deep ReLU Neural Networks for High Dimensional Regression

Factor-Adjusted Regularized Model Selection

Strongly Hierarchical Factorization Machines and ANOVA Kernel Regression

Extending the Fama-French Five-Facor Model with the Long Memory Factor Compared with Machine Learning

Testing for sparse idiosyncratic components in factor-augmented regression models

Bayesian factor-adjusted sparse regression

Model selection for generalized linear models with weak factors

Inference in Sparsity-Induced Weak Factor Models

Selection Inconsistency for Factor-Augmented Regressions

Optimal Estimation of Large-Dimensional Nonlinear Factor Models

Sparse factor models of high dimension

Sparse Bayesian factor analysis when the number of factors is unknown

The sparse dynamic factor model: a regularised quasi-maximum likelihood approach

Sufficient Forecasting Using Factor Models

Does Principal Component Analysis Preserve the Sparsity in Sparse Weak Factor Models?

Non-Negativity Constrained Missing Data Estimation For High-Dimensional And Sparse Matrices

Sparse Asymptotic PCA: Identifying Sparse Latent Factors Across Time Horizon

Efficient Estimation of Approximate Factor Models via Regularized Maximum Likelihood

Regularized Estimation of High-dimensional Factor-Augmented Vector Autoregressive (FAVAR) Models