Abstract:Accurate remote sensing-based land use and crop maps provide important and timely information for decision support in large-scale agricultural monitoring. Most existing multi-crop products for complex agricultural areas based on traditional machine learning algorithms are not suitable for large agricultural management because of the poor model transfer capabilities. Therefore, a deep segmentation and classification model including spatiotemporal transfer across regions and years must be developed. In this study, a deep learning approach was developed based on the UNet++ architecture by integrating feature fusion and upsampling of small samples for large-scale land use and crop mapping. Classification experiments were conducted for ten categories at four sites using 10 m resolution Sentinel-2A images from 2019 to 2021 containing 4,194,304 pixels. The joint loss, including the label smoothing cross entropy and Dice coefficient, and the mean intersection over union (mIoU) were used to evaluate the model performance depending on different features and upsampling schemes. The joint loss and mIoU values of the training model and the prediction accuracies of the test sites indicate that the scheme including the upsampling and fusion of spectral bands, vegetation indices, and texture features yields the optimal model performance. For comparison, UNet, DeepLab V3+, Pyramid Scene Parsing Network (PSPNet), and random forest models were built. The improved UNet++ model exhibits the best performance, with an overall accuracy, kappa, and macro F1 above 91 %, 85 %, and 51 %, respectively. The deep segmentation and classification results without training samples demonstrate the spatiotemporal transfer capability of the UNet++ architecture during the key crop growth period. The patch parameter values also indicate that the improved model exhibits a better shape compactness and significantly reduces and suppresses patch fragmentation. Based on the analysis of the overall confusion matrix, the proposed method improves the classification accuracy for datasets with imbalanced land cover and crop types. This study provides a strategy for large-scale and complex land use and crop mapping based on the integration of feature fusion and deep learning.

Straw Segmentation Algorithm Based on Modified UNet in Complex Farmland Environment

Semantic segmentation of remote sensing images combined with attention mechanism and feature enhancement U-Net

UAM-Net: an Attention-Based Multi-level Feature Fusion UNet for Remote Sensing Image Segmentation.

Deep Segmentation and Classification of Complex Crops Using Multi-Feature Satellite Imagery

CM-Unet: A Novel Remote Sensing Image Segmentation Method Based on Improved U-Net

Real-Time Segmentation of Unstructured Environments by Combining Domain Generalization and Attention Mechanisms

Lightweight Deep Learning Models for High-Precision Rice Seedling Segmentation from UAV-Based Multispectral Images

Deep Attention Unet: A Network Model with Global Feature Perception Ability

A novel Deep Structure U-Net for Sea-Land Segmentation in Remote Sensing Images

FG-UNet: fine-grained feature-guided UNet for segmentation of weeds and crops in UAV images

Real-time Segmentation of Weeds in Cornfields Based on Depthwise Separable Convolution Residual Network.

Maize Crop Row Recognition Algorithm Based on Improved UNet Network

A Multi-Attention UNet for Semantic Segmentation in Remote Sensing Images

Extraction of Floating Raft Aquaculture Areas from Sentinel-1 SAR Images by a Dense Residual U-Net Model with Pre-Trained Resnet34 as the Encoder

ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data

Multistage Attention ResU-Net for Semantic Segmentation of Fine-Resolution Remote Sensing Images

Farmland Segmentation from Remote Sensing Images Using Deep Learning Methods

Semantic Segmentation of Urban Buildings from VHR Remote Sensing Imagery Using a Deep Convolutional Neural Network

ASCEND-UNet: An Improved UNet Configuration Optimized for Rural Settlements Mapping

InstaCropNet: an Efficient Unet-Based Architecture for Precise Crop Row Detection in Agricultural Applications

An Improved Instance Segmentation Method for Complex Elements of Farm UAV Aerial Survey Images