Abstract:The emergence of new technologies to synthesize and analyze big data with high-performance computing has increased our capacity to more accurately predict crop yields. Recent research has shown that machine learning (ML) can provide reasonable predictions faster and with higher flexibility compared to simulation crop modeling. However, a single machine learning model can be outperformed by a "committee" of models (machine learning ensembles) that can reduce prediction bias, variance, or both and is able to better capture the underlying distribution of the data. Yet, there are many aspects to be investigated with regard to prediction accuracy, time of the prediction, and scale. The earlier the prediction during the growing season the better, but this has not been thoroughly investigated as previous studies considered all data available to predict yields. This paper provides a machine leaning based framework to forecast corn yields in three US Corn Belt states (Illinois, Indiana, and Iowa) considering complete and partial in-season weather knowledge. Several ensemble models are designed using blocked sequential procedure to generate out-of-bag predictions. The forecasts are made in county-level scale and aggregated for agricultural district and state level scales. Results show that the proposed optimized weighted ensemble and the average ensemble are the most precise models with RRMSE of 9.5%. Stacked LASSO makes the least biased predictions (MBE of 53 kg/ha), while other ensemble models also outperformed the base learners in terms of bias. On the contrary, although random k-fold cross-validation is replaced by blocked sequential procedure, it is shown that stacked ensembles perform not as good as weighted ensemble models for time series data sets as they require the data to be non-IID to perform favorably. Comparing our proposed model forecasts with the literature demonstrates the acceptable performance of forecasts made by our proposed ensemble model. Results from the scenario of having partial in-season weather knowledge reveals that decent yield forecasts with RRMSE of 9.2% can be made as early as June 1st. Moreover, it was shown that the proposed model performed better than individual models and benchmark ensembles at agricultural district and state-level scales as well as county-level scale. To find the marginal effect of each input feature on the forecasts made by the proposed ensemble model, a methodology is suggested that is the basis for finding feature importance for the ensemble model. The findings suggest that weather features corresponding to weather in weeks 18–24 (May 1st to June 1st) are the most important input features.

Ensemble Feature Selection Framework for Paddy Yield Prediction in Cauvery Basin using Machine Learning Classifiers

Machine Learning- and Feature Selection-Enabled Framework for Accurate Crop Yield Prediction

Prediction of Crop Yield Using Machine Learning Algorithm

Performance Evaluation of Best Feature Subsets for Crop Yield Prediction Using Machine Learning Algorithms

Survey on Novel Approach for Crop Yield Prediction Using Machine Learning

A Hybrid CFS Filter and RF-RFE Wrapper-Based Feature Extraction for Enhanced Agricultural Crop Yield Prediction Modeling

Prediction of Land Suitability for Crop Cultivation Based on Soil and Environmental Characteristics Using Modified Recursive Feature Elimination Technique With Various Classifiers

Deep ensemble model with hybrid intelligence technique for crop yield prediction

Mining of soil data for predicting the paddy productivity by machine learning techniques

Crop yield prediction with environmental and chemical variables using optimized ensemble predictive model in machine learning

A proposed framework for crop yield prediction using hybrid feature selection approach and optimized machine learning

Agriculture Crop Selection and Yield Prediction using Machine Learning Algorithms

Evaluation of machine learning approaches for prediction of pigeon pea yield based on weather parameters in India

Artificial Bee Colony Algorithm-based Feature Selection and Hybrid ML Framework for Efficient Rice Yield Prediction

Crop Yield Prediction Using Machine Learning Approaches on a Wide Spectrum

Forecasting Corn Yield With Machine Learning Ensembles

Crop yield prediction using machine learning techniques

Machine learning ensembles, neural network, hybrid and sparse regression approaches for weather based rainfed cotton yield forecast

Improved feature ranking fusion process with Hybrid model for crop yield prediction

Crop Recommendation and Yield Estimation Using Machine Learning

Hybrid heuristic-based optimal weighted fused feature for convolutional long short-term memory-based intelligent crop yield prediction model