Abstract:Accurate remote sensing-based land use and crop maps provide important and timely information for decision support in large-scale agricultural monitoring. Most existing multi-crop products for complex agricultural areas based on traditional machine learning algorithms are not suitable for large agricultural management because of the poor model transfer capabilities. Therefore, a deep segmentation and classification model including spatiotemporal transfer across regions and years must be developed. In this study, a deep learning approach was developed based on the UNet++ architecture by integrating feature fusion and upsampling of small samples for large-scale land use and crop mapping. Classification experiments were conducted for ten categories at four sites using 10 m resolution Sentinel-2A images from 2019 to 2021 containing 4,194,304 pixels. The joint loss, including the label smoothing cross entropy and Dice coefficient, and the mean intersection over union (mIoU) were used to evaluate the model performance depending on different features and upsampling schemes. The joint loss and mIoU values of the training model and the prediction accuracies of the test sites indicate that the scheme including the upsampling and fusion of spectral bands, vegetation indices, and texture features yields the optimal model performance. For comparison, UNet, DeepLab V3+, Pyramid Scene Parsing Network (PSPNet), and random forest models were built. The improved UNet++ model exhibits the best performance, with an overall accuracy, kappa, and macro F1 above 91 %, 85 %, and 51 %, respectively. The deep segmentation and classification results without training samples demonstrate the spatiotemporal transfer capability of the UNet++ architecture during the key crop growth period. The patch parameter values also indicate that the improved model exhibits a better shape compactness and significantly reduces and suppresses patch fragmentation. Based on the analysis of the overall confusion matrix, the proposed method improves the classification accuracy for datasets with imbalanced land cover and crop types. This study provides a strategy for large-scale and complex land use and crop mapping based on the integration of feature fusion and deep learning.

Crop Classification of Satellite Imagery Using Synthetic Multitemporal and Multispectral Images in Convolutional Neural Networks

Cropnet: Deep Spatial-Temporal-Spectral Feature Learning Network for Crop Classification from Time-Series Multi-Spectral Images

Deep Learning-Based Crop Mapping in the Cloudy Season Using One-Shot Hyperspectral Satellite Imagery.

A CNN-Transformer Hybrid Approach for Crop Classification Using Multitemporal Multisensor Images

Early Crop Classification via Multi-Modal Satellite Data Fusion and Temporal Attention

Interleaved Group Convolutions for Multitemporal Multisensor Crop Classification

A hybrid UNet based approach for crop classification using Sentinel-1B synthetic aperture radar images

Multimodal Crop Type Classification Fusing Multi-Spectral Satellite Time Series with Farmers Crop Rotations and Local Crop Distribution

Classification from Sky: A Robust Remote Sensing Time Series Image Classification Using Spatial Encoder and Multi-Fast Channel Attention

Towards more efficient agricultural practices via transformer-based crop type classification

Crop type classification with combined spectral, texture, and radar features of time-series Sentinel-1 and Sentinel-2 data

Deep Segmentation and Classification of Complex Crops Using Multi-Feature Satellite Imagery

Resilient In-Season Crop Type Classification in Multispectral Satellite Observations using Growth Stage Normalization

Crop classification in high-resolution remote sensing images based on multi-scale feature fusion semantic segmentation model

Multi-Stage Feature Fusion of Multispectral and SAR Satellite Images for Seasonal Crop-Type Mapping at Regional Scale Using an Adapted 3D U-Net Model

A Dual Attention Convolutional Neural Network for Crop Classification Using Time-Series Sentinel-2 Imagery

Time-Space tradeoff in deep learning models for crop classification on satellite multi-spectral image time series

Spatio-temporal crop classification of low-resolution satellite imagery with capsule layers and distributed attention

Crop classification based on G-CNN using multi-scale remote sensing images

Crop Type Mapping from Optical and Radar Time Series Using Attention-Based Deep Learning

Recognition of Maize Phenology in Sentinel Images with Machine Learning