Abstract:Abstract This work belongs to the strand of literature that combines machine learning, optimization, and econometrics. The aim is to optimize the data collection process in a specific statistical model, commonly used in econometrics, employing an optimization criterion inspired by machine learning, namely, the generalization error conditioned on the training input data. More specifically, the paper is focused on the analysis of the conditional generalization error of the Fixed Effects Generalized Least Squares (FEGLS) panel data model, i.e., a linear regression model with applications in several fields, able to represent unobserved heterogeneity in the data associated with different units, for which distinct observations related to the same unit are corrupted by correlated measurement errors. The framework considered in this work differs from the classical FEGLS model for the additional possibility of controlling the conditional variance of the output variable given the associated unit and input variables, by changing the cost per supervision of each training example. Assuming an upper bound on the total supervision cost, i.e., the cost associated with the whole training set, the trade-off between the training set size and the precision of supervision (i.e., the reciprocal of the conditional variance of the output variable) is analyzed and optimized. This is achieved by formulating and solving in closed form suitable optimization problems, based on large-sample approximations of the generalization error associated with the FEGLS estimates of the model parameters, conditioned on the training input data. The results of the analysis extend to the FEGLS case and to various large-sample approximations of its conditional generalization error the ones obtained by the authors in recent works for simpler linear regression models. They highlight the importance of how the precision of supervision scales with respect to the cost per training example in determining the optimal trade-off between training set size and precision. Numerical results confirm the validity of the theoretical findings.

Feasible Generalized Least Squares for Panel Data with Cross-sectional and Serial Correlations

Decorrelated Empirical Likelihood for Generalized Linear Models with High-Dimensional Longitudinal Data

GMM and 2SLS Estimation of Panel Data Models with Spatially Lagged Dependent Variables and Spatially Correlated Error Components

Uniform Inference in Linear Panel Data Models with Two-Dimensional Heterogeneity?

Robust Nearly-Efficient Estimation of Large Panels with Factor Structures

Efficient Estimation for Marginal Generalized Partially Linear Single-Index Models with Longitudinal Data

Simultaneous Confidence Band for Partially Linear Panel Data Models with Fixed Effects

Weighted Profile Least Squares Estimation for a Panel Data Varying-Coefficient Partially Linear Model

Nonstationary Panel Models with Latent Group Structures and Cross-Section Dependence

Sieve estimation of panel data models with cross section dependence

Optimal data collection design in machine learning: the case of the fixed effects generalized least squares panel data model

Estimation of Conditional Covariance Matrices for a Class of High-Dimensional Varying Coefficient Factor-Generalized Autoregressive Conditional Heteroscedasticity Model

Robust estimation of covariance parameters in partial linear model for longitudinal data☆

Two-Way Cluster-Robust Standard Errors—A Methodological Note on What Has Been Done and What Has Not Been Done in Accounting and Finance Research

Estimation and Simultaneous Confidence Bands for Fixed-Effects Panel Data Partially Linear Models

Sequential and Efficient GMM Estimation of Dynamic Short Panel Data Models

Common Correlated Effects Estimation of Nonlinear Panel Data Models

Robust estimation of panel data regression models and applications

Bayesian estimation in generalized linear models for longitudinal data with hyperspherical coordinates

Efficient Estimation in Varying Coefficient Panel Data Model with Different Smoothing Variables and Fixed Effects

Shrinkage Estimation of Common Breaks in Panel Data Models Via Adaptive Group Fused Lasso