Abstract:Accurate crop mapping provides important information for government decision-making and agricultural management. Recent advancements in deep learning have significantly enhanced the capabilities of remote sensing-based crop mapping. In this study, we developed a new deep learning approach, DSH, which comprises three modules, DeepLabV3+ (D), channel self-attention (S), and histogram matching (H). The DeepLabV3+ module learns the spatial distribution of crops in the spatial and spectral dimensions. The channel self-attention module was used to enhance the weights of the important features. The histogram-matching module addresses the domain gap between the training and testing images and enhances the transferability of the DSH. In addition, the input data of the DSH are monthly synthesized Sentinel-2 data, thus relaxing the data collection requirements. The performance of the DSH was evaluated and benchmarked against HRNetV2, DeepLabV3+, and random forest (RF) at eight sites in the U.S. China, and France with different farming structures, climate conditions, and landscape complexities. Temporal transfer revealed that the classification performance of DSH improved as the growth season progressed, peaked in the peak growth season (August), and then declined at each study site. The DSH model trained during the peak growth season demonstrated superior temporal transferability. Spatial transfer experiments demonstrated that transferring DSH to sites with similar planting structures achieved higher precision than full spatial transfers. Spatiotemporal transfer experiments conducted at eight sites over three years (2020–2022) demonstrated an average overall accuracy (OA) of 88.1% for DSH, highlighting the importance of similar planting structures for effective spatiotemporal transfer. DSH outperformed HRNetV2, DeepLabV3+, and RF in OA, producer's accuracy, and user's accuracy at all eight study sites. Notably, DSH exhibited comparable performance during both the peak and full growth seasons, with an average OA of 93.9%. The classification accuracy of test images after histogram matching remained stable from 2020 to 2022, whereas the accuracy of raw test images fluctuated annually. This indicates that histogram matching is effective in improving the transferability of DSH. Embedding the channel self-attention module into the position of the high-level features had a more significant impact on improving DSH's performance than other configurations. Visualizing features from the channel self-attention and high-level layers revealed that integrating the channel self-attention module with DeepLabV3+'s high-level features significantly improved crop mapping by enhancing relevant semantic information. Overall, DSH exhibits robust spatiotemporal generalizability and requires minimal input data, making it suitable for large-scale crop mapping.

Time-Scale Transferring Deep Convolutional Neural Network for Mapping Early Rice.

Deep Learning-Based Crop Mapping in the Cloudy Season Using One-Shot Hyperspectral Satellite Imagery.

Method for Mapping Rice Fields in Complex Landscape Areas Based on Pre-Trained Convolutional Neural Network from HJ-1 A/B Data

Cropnet: Deep Spatial-Temporal-Spectral Feature Learning Network for Crop Classification from Time-Series Multi-Spectral Images

Inter-Continental Transfer of Pre-Trained Deep Learning Rice Mapping Model and Its Generalization Ability

Temporally transferable crop mapping with temporal encoding and deep learning augmentations

Rice Mapping Based on Sentinel-1 Images Using the Coupling of Prior Knowledge and Deep Semantic Segmentation Network: A Case Study in Northeast China from 2019 to 2021

Mapping Rice Paddy Based on Machine Learning with Sentinel-2 Multi-Temporal Data: Model Comparison and Transferability.

Fully Convolutional Neural Networks for Large Scale Cropland Mapping with Historical Label Dataset

Large-Scale Rice Mapping Using Multi-Task Spatiotemporal Deep Learning and Sentinel-1 SAR Time Series

Transferring Deep Convolutional Neural Network Models for Generalization Mapping of Autumn Crops

High-resolution mapping of paddy rice fields from unmanned airborne vehicle images using enhanced-TransUnet

Large-scale Rice Mapping under Different Years Based on Time-Series Sentinel-1 Images Using Deep Semantic Segmentation Model

A new transferable deep learning approach for crop mapping

Deep learning with multi-scale temporal hybrid structure for robust crop mapping

DeepCropMapping: A multi-temporal deep learning approach with improved spatial generalizability for dynamic corn and soybean mapping

Deep ResU-Net Convolutional Neural Networks Segmentation for Smallholder Paddy Rice Mapping Using Sentinel 1 SAR and Sentinel 2 Optical Imagery

A Fast and Precise Method for Large-Scale Land-Use Mapping Based on Deep Learning

Generalization Enhancement Strategies to Enable Cross-year Cropland Mapping with Convolutional Neural Networks Trained Using Historical Samples

Transferable Deep Learning Model Based on the Phenological Matching Principle for Mapping Crop Extent

A full resolution deep learning network for paddy rice mapping using Landsat data