Abstract:Accurate crop mapping is crucial for ensuring food security. Recently, many studies have developed diverse crop mapping models based on deep learning. However, these models generally rely on a large amount of labeled crop samples to investigate the intricate relationship between the crop types of the samples and the corresponding remote sensing features. Moreover, their efficacy is often compromised when applied to other areas owing to the disparities between source and target data. To address this issue, a new multi-modal deep adaptation crop classification network (MDACCN) was proposed in this study. Specifically, MDACCN synergistically exploits time series optical and SAR images using a middle fusion strategy to achieve good classification capacity. Additionally, local maximum mean discrepancy (LMMD) is embedded into the model to measure and decrease domain discrepancies between source and target domains. As a result, a well-trained model in a source domain can still maintain satisfactory accuracy when applied to a target domain. In the training process, MDACCN incorporates the labeled samples from a source domain and unlabeled samples from a target domain. When it comes to the inference process, only unlabeled samples of the target domain are required. To assess the validity of the proposed model, Arkansas State in the United States was chosen as the source domain, and Heilongjiang Province in China was selected as the target domain. Supervised deep learning and traditional machine learning models were chosen as comparison models. The results indicated that the MDACCN achieved inspiring performance in the target domain, surpassing other models with overall accuracy, Kappa, and a macro-averaged F1 score of 0.878, 0.810, and 0.746, respectively. In addition, the crop-type maps produced by the MDACCN exhibited greater consistency with the reference maps. Moreover, the integration of optical and SAR features exhibited a substantial improvement of the model in the target domain compared with using single-modal features. This study indicated the considerable potential of combining multi-modal remote sensing data and an unsupervised domain adaptive approach to provide reliable crop distribution information in areas where labeled samples are missing.

Bayesian Joint Adaptation Network for Crop Mapping in the Absence of Mapping Year Ground-Truth Samples

Deep Learning-Based Crop Mapping in the Cloudy Season Using One-Shot Hyperspectral Satellite Imagery.

Uncertainty-guided Joint Unbalanced Optimal Transport for Unsupervised Domain Adaptation

Attention-based Cross-Layer Domain Alignment for Unsupervised Domain Adaptation

A new Bayesian semi-supervised active learning framework for large-scale crop mapping using Sentinel-2 imagery

An unsupervised domain adaptation deep learning method for spatial and temporal transferable crop type mapping using Sentinel-2 imagery

Integrating Optical and SAR Time Series Images for Unsupervised Domain Adaptive Crop Mapping

Crop Mapping Using the Historical Crop Data Layer and Deep Neural Networks: A Case Study in Jilin Province, China

A dual-branch network for crop-type mapping of scattered small agricultural fields in time series remote sensing images

Cross Domain Early Crop Mapping using CropSTGAN

Remote Sensing Crop Recognition by Coupling Phenological Features and Off-Center Bayesian Deep Learning

Joint Distribution Adaptive-Alignment for Cross-Domain Segmentation of High-Resolution Remote Sensing Images

3D Fully Convolutional Neural Networks with Intersection over Union Loss for Crop Mapping from Multi-Temporal Satellite Images

Bayesian Uncertainty Matching for Unsupervised Domain Adaptation

CACPU-Net: Channel attention U-net constrained by point features for crop type mapping

Unsupervised Domain Adaptation with Adversarial Self-Training for Crop Classification using Remote Sensing Images

Bures Joint Distribution Alignment with Dynamic Margin for Unsupervised Domain Adaptation

Generalization Enhancement Strategies to Enable Cross-year Cropland Mapping with Convolutional Neural Networks Trained Using Historical Samples

Bayesian Calibration of AquaCrop Model for Winter Wheat by Assimilating UAV Multi-Spectral Images

Early- and in-season crop type mapping without current-year ground truth: Generating labels from historical information via a topology-based approach

Multi-Temporal SAR Data Large-Scale Crop Mapping Based on U-Net Model