SepHRNet: Generating High-Resolution Crop Maps from Remote Sensing imagery using HRNet with Separable Convolution

Priyanka Goyal,Sohan Patnaik,Adway Mitra,Manjira Sinha

2023-07-12

Abstract:The accurate mapping of crop production is crucial for ensuring food security, effective resource management, and sustainable agricultural practices. One way to achieve this is by analyzing high-resolution satellite imagery. Deep Learning has been successful in analyzing images, including remote sensing imagery. However, capturing intricate crop patterns is challenging due to their complexity and variability. In this paper, we propose a novel Deep learning approach that integrates HRNet with Separable Convolutional layers to capture spatial patterns and Self-attention to capture temporal patterns of the data. The HRNet model acts as a backbone and extracts high-resolution features from crop images. Spatially separable convolution in the shallow layers of the HRNet model captures intricate crop patterns more effectively while reducing the computational cost. The multi-head attention mechanism captures long-term temporal dependencies from the encoded vector representation of the images. Finally, a CNN decoder generates a crop map from the aggregated representation. Adaboost is used on top of this to further improve accuracy. The proposed algorithm achieves a high classification accuracy of 97.5\% and IoU of 55.2\% in generating crop maps. We evaluate the performance of our pipeline on the Zuericrop dataset and demonstrate that our results outperform state-of-the-art models such as U-Net++, ResNet50, VGG19, InceptionV3, DenseNet, and EfficientNet. This research showcases the potential of Deep Learning for Earth Observation Systems.

Computer Vision and Pattern Recognition,Image and Video Processing

What problem does this paper attempt to address?

The problem this paper attempts to address is generating accurate crop distribution maps by analyzing high-resolution satellite images to ensure food security, effective management, and sustainable agricultural practices. Specifically, the paper proposes a novel deep learning method, SepHRNet, which combines HRNet (High-Resolution Network) and separable convolution layers to capture spatial patterns and utilizes a self-attention mechanism to capture temporal patterns in the data. This method aims to capture complex crop patterns more effectively while reducing computational costs. ### Main Issues: 1. **Generation of Accurate Crop Distribution Maps**: How to generate accurate crop distribution maps from high-resolution satellite images. 2. **Capturing Complex Crop Patterns**: How to effectively capture and process complex crop patterns. 3. **Computational Efficiency**: How to reduce computational costs while ensuring accuracy. ### Solutions: - **HRNet (High-Resolution Network)**: Used as the backbone network to extract high-resolution features. - **Separable Convolution**: Used in the shallow layers of HRNet to capture complex crop patterns more effectively while reducing computational costs. - **Self-Attention Mechanism**: Captures long-term temporal dependencies, enhancing the model's ability to handle time-series data. - **CNN Decoder**: Generates crop distribution maps from aggregated representations. - **AdaBoost**: Further improves the model's accuracy. ### Experimental Validation: - **Dataset**: Experiments were conducted using the ZueriCrop dataset, which contains high-resolution satellite images of the Zurich and Thurgau regions in Switzerland. - **Performance Metrics**: Classification accuracy, precision, recall, F1-score, and mean Intersection over Union (mIoU). - **Comparison Models**: Compared with existing advanced models such as U-Net++, ResNet50, VGG19, InceptionV3, DenseNet, and EfficientNet. ### Results: - **Classification Accuracy**: Achieved 97.5%. - **Mean Intersection over Union**: Achieved 55.2%. - **Performance Advantage**: Outperformed all other existing models across all metrics. ### Conclusion: This study demonstrates the potential of deep learning in Earth observation systems, particularly in generating high-resolution crop distribution maps. By combining HRNet, separable convolution, and self-attention mechanisms, SepHRNet excels in handling complex crop patterns and time-series data, providing strong support for precision agricultural management.

SepHRNet: Generating High-Resolution Crop Maps from Remote Sensing imagery using HRNet with Separable Convolution

Deep Learning-Based Crop Mapping in the Cloudy Season Using One-Shot Hyperspectral Satellite Imagery.

Cropnet: Deep Spatial-Temporal-Spectral Feature Learning Network for Crop Classification from Time-Series Multi-Spectral Images

A hybrid UNet based approach for crop classification using Sentinel-1B synthetic aperture radar images

Crop Monitoring using remote sensing land use and land change data: Comparative analysis of deep learning methods using pre-trained CNN models

Rethinking the Crop Row Detection Pipeline: an End-to-end Method for Crop Row Detection Based on Row-Column Attention

Crop Weed Image Recognition of UAV Based on Improved HRNet-OCRNet

Deep Segmentation and Classification of Complex Crops Using Multi-Feature Satellite Imagery

Geo-parcel-based Crop Classification in Very-High-resolution Images Via Hierarchical Perception

Cropland Extraction in Southern China from Very High-Resolution Images Based on Deep Learning

Efficient Remote Sensing in Agriculture via Active Learning and Opt-HRDNet

Dipper throated optimization with deep convolutional neural network-based crop classification for remote sensing image analysis

Deep ResU-Net Convolutional Neural Networks Segmentation for Smallholder Paddy Rice Mapping Using Sentinel 1 SAR and Sentinel 2 Optical Imagery

Dynamic High-Resolution Network for Semantic Segmentation in Remote-Sensing Images

Crop classification in high-resolution remote sensing images based on multi-scale feature fusion semantic segmentation model

Crop Mapping from Sentinel-1 Polarimetric Time-Series with a Deep Neural Network

MP-Net: an Efficient and Precise Multi-Layer Pyramid Crop Classification Network for Remote Sensing Images

A CNN approach to simultaneously count plants and detect plantation-rows from UAV imagery

A Generalized Approach Based on Convolutional Neural Networks for Large Area Cropland Mapping at Very High Resolution

An intelligent system for crop identification and classification from UAV images using conjugated dense convolutional neural network

Crop Mapping Based on Time-Series Synthetic Aperture Radar Images Using Deep Semantic Segmentation Model