Abstract:Accurate large-scale crop yield estimation under climate variability is essential to understanding the dynamics of global food security. The deep learning method has shown well performance for crop yield estimation because of its high capacity for temporal pattern recognition. However, most existing deep learning models were usually based on multi-source time series with weekly or coarse temporal resolutions, which simplified the dynamics of crop growth progress. How to effectively learn the long-term and short-term crop response from the remotely sensed and agro-meteorological time series at daily intervals remains challenging. In this study, a hierarchical deep learning model, named Daily DeepCropNet (DDCN), has been developed to process daily time series of satellite-derived vegetation indices and climatic variables for corn yield estimation. The DDCN model was a three-level pyramid structure that incorporated the corn phenology durations to extract crop growth patterns from the daily inputs. The Transformer and Long Short-Term Memory (LSTM) were implemented as a temporal filter in each level to capture the short-term crop growth patterns. The temporal patterns were hierarchically transferred from weekly to growing season aggregation to learn long-term dependency. The experiment was conducted at county level over the US Corn Belt from 2006 to 2020. LSTM, Transformer, and Random Forest (RF) models were built for comparison. The input analysis showed that the daily time series of climatic variables provided more temporal fluctuations than weekly aggregated inputs. The DDCN model provided the highest accuracy for end-of-season yield estimation under normal climate conditions in 2018-2020 (RMSE = 0.86 Mg ha-1) and extreme heat and drought conditions in 2012 (RMSE = 1.17 Mg ha-1). Further analyses indicated that the DDCN model had the potential for capturing the short-duration stresses. We also found that the DDCN model identified the silking phase as the key growth stage and achieved higher accuracy than other models for in-season yield estimation. The results showed that features extracted by the DDCN model had higher correlation coefficients with corn yield for the upper levels. By evaluating the contributions of different variables, we found that vegetation indices yield higher impact than climatic variables for yield estimation under both normal and stressful climate conditions. This study provided a promising approach to extracting the temporal pattern of crop growth at daily time steps. The DDCN model could be further integrated with the process-based model to achieve the fusion of knowledge and data for explainable AI in agricultural system modeling.

TCNT: a temporal convolutional network-transformer framework for advanced crop yield prediction

TFSF: Topological and Feature Space Fusion with Spatio-Temporal Modeling for Crop Yield Prediction.

Cropnet: Deep Spatial-Temporal-Spectral Feature Learning Network for Crop Classification from Time-Series Multi-Spectral Images

Daily DeepCropNet: A Hierarchical Deep Learning Approach with Daily Time Series of Vegetation Indices and Climatic Variables for Corn Yield Estimation

A Temporal–Geospatial Deep Learning Framework for Crop Yield Prediction

A CNN-Transformer Hybrid Approach for Crop Classification Using Multitemporal Multisensor Images

DeepCropNet: a Deep Spatial-Temporal Learning Framework for County-Level Corn Yield Estimation

Temporally transferable crop mapping with temporal encoding and deep learning augmentations

A transformer-based approach for early prediction of soybean yield using time-series images

In-Season Cotton Yield Prediction with Scale-Aware Convolutional Neural Network Models and Unmanned Aerial Vehicle RGB Imagery

Temporal Convolution-Network-based Models for Modeling Maize Evapotranspiration under Mulched Drip Irrigation

The self-supervised spectral-spatial attention-based transformer network for automated, accurate prediction of crop nitrogen status from UAV imagery

A CNN-RNN Framework for Crop Yield Prediction

A Neural Network Framework for Fine-Grained Tropical Cyclone Intensity Prediction

DeepCropMapping: A multi-temporal deep learning approach with improved spatial generalizability for dynamic corn and soybean mapping

Temporal convolutional neural (TCN) network for an effective weather forecasting using time-series data from the local weather station

On Convolutional Vision Transformers for Yield Prediction

A Prediction Model of Maize Field Yield Based on the Fusion of Multitemporal and Multimodal UAV Data: A Case Study in Northeast China

Deep learning with multi-scale temporal hybrid structure for robust crop mapping

Continuous Growth Monitoring and Prediction with 1D Convolutional Neural Network Using Generated Data with Vision Transformer

Deep Learning Based Prediction on Greenhouse Crop Yield Combined TCN and RNN