Abstract:A number of recent studies in the economics literature have focused on the usefulness of factor models in the context of prediction using "big data". We add to this literature by analyzing whether "big data" are useful for modelling low frequency macroeconomic variables such as unemployment, inflation and GDP. In particular, we analyze the predictive benefits associated with the use of principal component analysis (PCA), independent component analysis (ICA), and sparse principal component analysis (SPCA). We also evaluate machine learning, variable selection and shrinkage methods, including bagging, boosting, ridge regression, least angle regression, the elastic net, and the non-negative garotte. Our approach is to carry out a forecasting "horse-race" using prediction models constructed using a variety of model specification approaches, factor estimation methods, and data windowing methods, in the context of the prediction of 11 macroeconomic variables relevant for monetary policy assessment. In many instances, we find that various of our benchmark models, including autoregressive (AR) models, AR models with exogenous variables, and (Bayesian) model averaging, do not dominate specifications based on factor-type dimension reduction combined with various machine learning, variable selection, and shrinkage methods (called "combination" models). We find that forecast combination methods are mean square forecast error (MSFE) "best" for only 3 of 11 variables when the forecast horizon, h=1, and for 4 variables when h=3 or 12. Additionally, non-PCA type factor estimation methods yield MSFE-best predictions for 9 of 11 variables when h=1, although PCA dominates at longer horizons. Interestingly, we also find evidence of the usefulness of combination models for approximately 1/2 of our variables, when h>1. Most importantly, we present strong new evidence of the usefulness of factor based dimension reduction, when utilizing "big data" for macroeconometric forecasting.

Dynamic Factor Models & Bayesian Averaging of Classical Estimates in Forecasting Macroeconomic Indicators with Application of Survey Data

Forecasting in Data-Rich Environments: An Application to Inflation Rates

Dynamic Model Averaging in Large Model Spaces Using Dynamic Occam's Window

AN OVERVIEW OF DYNAMIC MODEL AVERAGING TECHNIQUES IN TIME‐SERIES ECONOMETRICS

Forecasting Macroeconomic Dynamics using a Calibrated Data-Driven Agent-based Model

Forecasting house prices using dynamic model averaging approach: Evidence from China

Multivariate Bayesian Predictive Synthesis in Macroeconomic Forecasting

Adaptive Dynamic Model Averaging with an Application to House Price Forecasting

Forecasting spot oil price in a dynamic model averaging framework — Have the determinants changed over time?

Dynamic Model Averaging in Economics and Finance with fDMA: A Package for R

Dynamic Sparse Factor Analysis

Forecasting with Dynamic Panel Data Models

Mining Big Data Using Parsimonious Factor, Machine Learning, Variable Selection and Shrinkage Methods

Dynamic partial (co)variance forecasting model

Forecasting carbon prices under diversified attention: A dynamic model averaging approach with common factors

Forecasting the price of gold using dynamic model averaging

Forecasting realized volatility in a changing world: A dynamic model averaging approach

Forecasting Carbon Emissions with Dynamic Model Averaging Approach: Time-Varying Evidence from China

Density forecast combinations: The real‐time dimension