Abstract:Accurate large-scale crop yield estimation under climate variability is essential to understanding the dynamics of global food security. The deep learning method has shown well performance for crop yield estimation because of its high capacity for temporal pattern recognition. However, most existing deep learning models were usually based on multi-source time series with weekly or coarse temporal resolutions, which simplified the dynamics of crop growth progress. How to effectively learn the long-term and short-term crop response from the remotely sensed and agro-meteorological time series at daily intervals remains challenging. In this study, a hierarchical deep learning model, named Daily DeepCropNet (DDCN), has been developed to process daily time series of satellite-derived vegetation indices and climatic variables for corn yield estimation. The DDCN model was a three-level pyramid structure that incorporated the corn phenology durations to extract crop growth patterns from the daily inputs. The Transformer and Long Short-Term Memory (LSTM) were implemented as a temporal filter in each level to capture the short-term crop growth patterns. The temporal patterns were hierarchically transferred from weekly to growing season aggregation to learn long-term dependency. The experiment was conducted at county level over the US Corn Belt from 2006 to 2020. LSTM, Transformer, and Random Forest (RF) models were built for comparison. The input analysis showed that the daily time series of climatic variables provided more temporal fluctuations than weekly aggregated inputs. The DDCN model provided the highest accuracy for end-of-season yield estimation under normal climate conditions in 2018-2020 (RMSE = 0.86 Mg ha-1) and extreme heat and drought conditions in 2012 (RMSE = 1.17 Mg ha-1). Further analyses indicated that the DDCN model had the potential for capturing the short-duration stresses. We also found that the DDCN model identified the silking phase as the key growth stage and achieved higher accuracy than other models for in-season yield estimation. The results showed that features extracted by the DDCN model had higher correlation coefficients with corn yield for the upper levels. By evaluating the contributions of different variables, we found that vegetation indices yield higher impact than climatic variables for yield estimation under both normal and stressful climate conditions. This study provided a promising approach to extracting the temporal pattern of crop growth at daily time steps. The DDCN model could be further integrated with the process-based model to achieve the fusion of knowledge and data for explainable AI in agricultural system modeling.

Deep Hierarchical Temporal Data Fusion Improves Yield Estimation under Extreme Climate Stress

TFSF: Topological and Feature Space Fusion with Spatio-Temporal Modeling for Crop Yield Prediction.

A Deep Learning Approach to Conflating Heterogeneous Geospatial Data for Corn Yield Estimation: A Case Study of the US Corn Belt at the County Level.

Detect and attribute the extreme maize yield losses based on spatio-temporal deep learning

Daily DeepCropNet: A Hierarchical Deep Learning Approach with Daily Time Series of Vegetation Indices and Climatic Variables for Corn Yield Estimation

Developing a Dual-Stream Deep-Learning Neural Network Model for Improving County-Level Winter Wheat Yield Estimates in China

Adaptability Evaluation of the Spatiotemporal Fusion Model in the Summer Maize Planting Area of the Southeast Loess Plateau

DeepCropNet: a Deep Spatial-Temporal Learning Framework for County-Level Corn Yield Estimation

A Temporal–Geospatial Deep Learning Framework for Crop Yield Prediction

A Novel Fusion-Based Methodology for Drought Forecasting

A Multimodal and Temporal Network-Based Yield Assessment Method for Different Heat-Tolerant Genotypes of Wheat

Spatiotemporal Data Fusion of Index-Based VTCI Using Sentinel-2 and -3 Satellite Data for Field-Scale Drought Monitoring

Comparison of Attention Mechanism-Based Deep Learning and Transfer Strategies for Wheat Yield Estimation Using Multisource Temporal Drone Imagery

A Robust Hybrid Deep Learning Model for Spatiotemporal Image Fusion

Adaptive Fusion of Multi-view Remote Sensing data for Optimal Sub-field Crop Yield Prediction

A Method for Spatiotemporally Merging Multi-Source Precipitation Based on Deep Learning

Reconstruction of Fine-Spatial-Resolution FY-3D-Based Vegetation Indices to Achieve Farmland-Scale Winter Wheat Yield Estimation via Fusion with Sentinel-2 Data

Drought prediction: Insights from the fusion of LSTM and multi-source factors

Early Season Forecasting of Corn Yield at Field Level from Multi-Source Satellite Time Series Data

Improving Yield Prediction Based on Spatio-Temporal Deep Learning Approaches for Winter Wheat: A Case Study in Jiangsu Province, China

Improving grain yield prediction through fusion of multi-temporal spectral features and agronomic trait parameters derived from UAV imagery