Abstract:Accurate crop mapping provides important information for government decision-making and agricultural management. Recent advancements in deep learning have significantly enhanced the capabilities of remote sensing-based crop mapping. In this study, we developed a new deep learning approach, DSH, which comprises three modules, DeepLabV3+ (D), channel self-attention (S), and histogram matching (H). The DeepLabV3+ module learns the spatial distribution of crops in the spatial and spectral dimensions. The channel self-attention module was used to enhance the weights of the important features. The histogram-matching module addresses the domain gap between the training and testing images and enhances the transferability of the DSH. In addition, the input data of the DSH are monthly synthesized Sentinel-2 data, thus relaxing the data collection requirements. The performance of the DSH was evaluated and benchmarked against HRNetV2, DeepLabV3+, and random forest (RF) at eight sites in the U.S. China, and France with different farming structures, climate conditions, and landscape complexities. Temporal transfer revealed that the classification performance of DSH improved as the growth season progressed, peaked in the peak growth season (August), and then declined at each study site. The DSH model trained during the peak growth season demonstrated superior temporal transferability. Spatial transfer experiments demonstrated that transferring DSH to sites with similar planting structures achieved higher precision than full spatial transfers. Spatiotemporal transfer experiments conducted at eight sites over three years (2020–2022) demonstrated an average overall accuracy (OA) of 88.1% for DSH, highlighting the importance of similar planting structures for effective spatiotemporal transfer. DSH outperformed HRNetV2, DeepLabV3+, and RF in OA, producer's accuracy, and user's accuracy at all eight study sites. Notably, DSH exhibited comparable performance during both the peak and full growth seasons, with an average OA of 93.9%. The classification accuracy of test images after histogram matching remained stable from 2020 to 2022, whereas the accuracy of raw test images fluctuated annually. This indicates that histogram matching is effective in improving the transferability of DSH. Embedding the channel self-attention module into the position of the high-level features had a more significant impact on improving DSH's performance than other configurations. Visualizing features from the channel self-attention and high-level layers revealed that integrating the channel self-attention module with DeepLabV3+'s high-level features significantly improved crop mapping by enhancing relevant semantic information. Overall, DSH exhibits robust spatiotemporal generalizability and requires minimal input data, making it suitable for large-scale crop mapping.

Comparison of Attention Mechanism-Based Deep Learning and Transfer Strategies for Wheat Yield Estimation Using Multisource Temporal Drone Imagery

Using Multi-Sensor Data Fusion Techniques and Machine Learning Algorithms for Improving UAV-Based Yield Prediction of Oilseed Rape

A deep learning framework under attention mechanism for wheat yield estimation using remotely sensed indices in the Guanzhong Plain, PR China

Attention Mechanism-Based Deep Learning Approach for Wheat Yield Estimation and Uncertainty Analysis from Remotely Sensed Variables

Attention Mechanism-Combined LSTM for Grain Yield Prediction in China Using Multi-Source Satellite Imagery

Wheat Yield Prediction Using Machine Learning Method Based on UAV Remote Sensing Data

Wheat yield estimation using remote sensing data based on machine learning approaches

Integration of a Crop Growth Model and Deep Learning Methods to Improve Satellite-Based Yield Estimation of Winter Wheat in Henan Province, China

An LSTM neural network for improving wheat yield estimates by integrating remote sensing data and meteorological data in the Guanzhong Plain, PR China

A Prediction Model of Maize Field Yield Based on the Fusion of Multitemporal and Multimodal UAV Data: A Case Study in Northeast China

A Multimodal and Temporal Network-Based Yield Assessment Method for Different Heat-Tolerant Genotypes of Wheat

Improving Yield Prediction Based on Spatio-Temporal Deep Learning Approaches for Winter Wheat: A Case Study in Jiangsu Province, China

Improving Wheat Yield Prediction Accuracy Using LSTM-RF Framework Based on UAV Thermal Infrared and Multispectral Imagery

Transferability of Models for Predicting Rice Grain Yield from Unmanned Aerial Vehicle (UAV) Multispectral Imagery Across Years, Cultivars and Sensors

Simultaneous Prediction of Wheat Yield and Grain Protein Content Using Multitask Deep Learning from Time-Series Proximal Sensing

Combining Optical, Fluorescence, Thermal Satellite, and Environmental Data to Predict County-Level Maize Yield in China Using Machine Learning Approaches.

Grain Yield Prediction Using Multi-Temporal UAV-based Multispectral Vegetation Indices and Endmember Abundance in Rice

UAV-based multi-sensor data fusion and machine learning algorithm for yield prediction in wheat

A new transferable deep learning approach for crop mapping

Improving Soybean Yield Prediction by Integrating Uav Nadir and Cross-Circling Oblique Imaging

Grain yield prediction of rice using multi-temporal UAV-based RGB and multispectral images and model transfer – a case study of small farmlands in the South of China