Abstract:The ability to automatically monitor agricultural fields is an important capability in precision farming, enabling steps towards more sustainable agriculture. Precise, high-resolution monitoring is a key prerequisite for targeted intervention and the selective application of agro-chemicals. The main goal of this paper is developing a novel crop/weed segmentation and mapping framework that processes multispectral images obtained from an unmanned aerial vehicle (UAV) using a deep neural network (DNN). Most studies on crop/weed semantic segmentation only consider single images for processing and classification. Images taken by UAVs often cover only a few hundred square meters with either color only or color and near-infrared (NIR) channels. Although a map can be generated by processing single segmented images incrementally, this requires additional complex information fusion techniques which struggle to handle high fidelity maps due to their computational costs and problems in ensuring global consistency. Moreover, computing a single large and accurate vegetation map (e.g., crop/weed) using a DNN is non-trivial due to difficulties arising from: (1) limited ground sample distances (GSDs) in high-altitude datasets, (2) sacrificed resolution resulting from downsampling high-fidelity images, and (3) multispectral image alignment. To address these issues, we adopt a stand sliding window approach that operates on only small portions of multispectral orthomosaic maps (tiles), which are channel-wise aligned and calibrated radiometrically across the entire map. We define the tile size to be the same as that of the DNN input to avoid resolution loss. Compared to our baseline model (i.e., SegNet with 3 channel RGB (red, green, and blue) inputs) yielding an area under the curve (AUC) of [background=0.607, crop=0.681, weed=0.576], our proposed model with 9 input channels achieves [0.839, 0.863, 0.782]. Additionally, we provide an extensive analysis of 20 trained models, both qualitatively and quantitatively, in order to evaluate the effects of varying input channels and tunable network hyperparameters. Furthermore, we release a large sugar beet/weed aerial dataset with expertly guided annotations for further research in the fields of remote sensing, precision agriculture, and agricultural robotics.

A Deep Learning Approach to Mapping Irrigation: IrrMapper-U-Net

Mapping Irrigation Methods in the Northwestern US Using Deep Learning Classification

Deep Learning-Based Crop Mapping in the Cloudy Season Using One-Shot Hyperspectral Satellite Imagery.

An Attention-Enhanced Spatial–temporal High-Resolution Network for Irrigated Area Mapping Using Multitemporal Sentinel-2 Images

Mapping Irrigated Croplands from Sentinel-2 Images Using Deep Convolutional Neural Networks

A deep learning image segmentation model for agricultural irrigation system classification

IrrNet: Advancing Irrigation Mapping with Incremental Patch Size Training on Remote Sensing Imagery

WeedMap: A Large-Scale Semantic Weed Mapping Framework Using Aerial Multispectral Imaging and Deep Neural Network for Precision Farming

A multiscale spatiotemporal approach for smallholder irrigation detection

Application of the Random Forest Classifier to Map Irrigated Areas Using Google Earth Engine

Mapping agricultural tile drainage in the US Midwest using explainable random forest machine learning and satellite imagery

Comparing Deep Learning Models for Rice Mapping in Bhutan Using High Resolution Satellite Imagery

A shape-attention Pivot-Net for identifying central pivot irrigation systems from satellite images using a cloud computing platform: an application in the contiguous US

Advanced Deep Learning Architectures for Accurate Detection of Subsurface Tile Drainage Pipes from Remote Sensing Images

High-resolution global irrigation prediction with Sentinel-2 30m data

Crop Mapping Using the Historical Crop Data Layer and Deep Neural Networks: A Case Study in Jilin Province, China

Mapping Remote Roads Using Artificial Intelligence and Satellite Imagery

Deep learning approaches for delineating wetlands on historical topographic maps

Deep Learning-based Near-real-time Monitoring of Autumn Irrigation Extent at Sub-pixel Scale in a Large Irrigation District

Mapping Irrigated Areas Based on Remotely Sensed Crop Phenology and Soil Moisture

AI-driven optimization of agricultural water management for enhanced sustainability