Abstract:Abstract Statistical meteorological impact models are intended to represent the impact of weather on socioeconomic activities, using a statistical approach. The calibration of such models is difficult because relationships are complex and historical records are limited. Often, such models succeed in reproducing past data but perform poorly on unseen new data (a problem known as overfitting). This difficulty emphasizes the need for regularization techniques and reliable assessment of the model quality. This study illustrates, in a general way, how to extract pertinent information from weather data and exploit it in impact models that are designed to help decision-making. For a given socioeconomic activity, this type of impact model can be used to 1) study its sensitivity to weather anomalies (e.g., corn sensitivity to water stress), 2) perform seasonal forecasting (yield forecasting) for it, and 3) quantify the longer-term (several decades) impact of weather on it. The size of the training database can be increased by pooling data from various locations, but this requires statistical models that are able to use the localization information—for example, mixed-effect (ME) models. Linear, neural-network, and ME models are compared, using a real-world application: corn-yield forecasting over the United States. Many challenges faced in this paper may be encountered in many weather-impact analyses: these results show that much care is required when using space–time data because they are often highly spatially correlated. In addition, the forecast quality is strongly influenced by the training spatial scale. For the application that is described herein, learning at the state scale is a good trade-off: it is specific to local conditions while keeping enough data for the calibration.

Semiparametric panel data models using neural networks

Deep Neural Network Estimation in Panel Data Models

Nonparametric and Semiparametric Panel Econometric Models: Estimation and Testing

Efficient Estimation for Error Component Seemingly Unrelated Nonparametric Regression Models

Machine learning methods for crop yield prediction and climate change impact assessment in agriculture

Density Forecasts in Panel Data Models: A Semiparametric Bayesian Perspective

High-Dimensional Dynamic Panel with Correlated Random Effects: A Semiparametric Hierarchical Empirical Bayes Approach

Forecasting with Dynamic Panel Data Models

Panel data models with nonadditive unobserved heterogeneity: Estimation and inference

A user-friendly method for estimating discrete choice land-use model in a panel data setting

Robust estimation of panel data regression models and applications

Deep Neural Networks for Estimation and Inference

Semiparametric modeling of autonomous nonlinear dynamical systems with applications

Simultaneous variable selection and estimation in semiparametric regression of mixed panel count data

Nonparametric dynamic panel data models: Kernel estimation and specification testing

Estimating Continuous Treatment Effects in Panel Data using Machine Learning with a Climate Application

Interpretable Neural Networks for Panel Data Analysis in Economics

Real-time semiparametric regression

Statistical Weather-Impact Models: An Application of Neural Networks and Mixed Effects for Corn Production over the United States

A Free Lunch with Influence Functions? Improving Neural Network Estimates with Concepts from Semiparametric Statistics

Neural Networks for Parameter Estimation in Intractable Models