Abstract:Abstract This work belongs to the strand of literature that combines machine learning, optimization, and econometrics. The aim is to optimize the data collection process in a specific statistical model, commonly used in econometrics, employing an optimization criterion inspired by machine learning, namely, the generalization error conditioned on the training input data. More specifically, the paper is focused on the analysis of the conditional generalization error of the Fixed Effects Generalized Least Squares (FEGLS) panel data model, i.e., a linear regression model with applications in several fields, able to represent unobserved heterogeneity in the data associated with different units, for which distinct observations related to the same unit are corrupted by correlated measurement errors. The framework considered in this work differs from the classical FEGLS model for the additional possibility of controlling the conditional variance of the output variable given the associated unit and input variables, by changing the cost per supervision of each training example. Assuming an upper bound on the total supervision cost, i.e., the cost associated with the whole training set, the trade-off between the training set size and the precision of supervision (i.e., the reciprocal of the conditional variance of the output variable) is analyzed and optimized. This is achieved by formulating and solving in closed form suitable optimization problems, based on large-sample approximations of the generalization error associated with the FEGLS estimates of the model parameters, conditioned on the training input data. The results of the analysis extend to the FEGLS case and to various large-sample approximations of its conditional generalization error the ones obtained by the authors in recent works for simpler linear regression models. They highlight the importance of how the precision of supervision scales with respect to the cost per training example in determining the optimal trade-off between training set size and precision. Numerical results confirm the validity of the theoretical findings.

Choosing among Regularized Estimators in Empirical Economics: The Risk of Machine Learning

The Risk of Machine Learning

On Learning the Optimal Regularization Parameter in Inverse Problems

Modelling dataset bias in machine-learned theories of economic decision-making

Beyond Least-Squares: Fast Rates for Regularized Empirical Risk Minimization through Self-Concordance

Regularized EM Algorithms: A Unified Framework and Statistical Guarantees

Optimal data collection design in machine learning: the case of the fixed effects generalized least squares panel data model

Empirical Risk Minimization with Relative Entropy Regularization

Causal Regularization: On the trade-off between in-sample risk and out-of-sample risk guarantees

Statistical Robustness of Empirical Risks in Machine Learning

Optimal worst-risk minimization in structural equation models with random coefficients

Distributionally Robust Groupwise Regularization Estimator

Huber Loss Meets Spatial Autoregressive Model: A Robust Variable Selection Method with Prior Information

Mostly Harmless Simulations? Using Monte Carlo Studies for Estimator Selection

Robust decision-making under risk and ambiguity

Selection of Regression Models under Linear Restrictions for Fixed and Random Designs

Robust Design and Evaluation of Predictive Algorithms under Unobserved Confounding

Optimal Excess Risk Bounds for Empirical Risk Minimization on $p$-Norm Linear Regression

A Unified Dynamic Approach to Sparse Model Selection

Learning Merton's Strategies in an Incomplete Market: Recursive Entropy Regularization and Biased Gaussian Exploration