Abstract:The ability to automatically monitor agricultural fields is an important capability in precision farming, enabling steps towards more sustainable agriculture. Precise, high-resolution monitoring is a key prerequisite for targeted intervention and the selective application of agro-chemicals. The main goal of this paper is developing a novel crop/weed segmentation and mapping framework that processes multispectral images obtained from an unmanned aerial vehicle (UAV) using a deep neural network (DNN). Most studies on crop/weed semantic segmentation only consider single images for processing and classification. Images taken by UAVs often cover only a few hundred square meters with either color only or color and near-infrared (NIR) channels. Although a map can be generated by processing single segmented images incrementally, this requires additional complex information fusion techniques which struggle to handle high fidelity maps due to their computational costs and problems in ensuring global consistency. Moreover, computing a single large and accurate vegetation map (e.g., crop/weed) using a DNN is non-trivial due to difficulties arising from: (1) limited ground sample distances (GSDs) in high-altitude datasets, (2) sacrificed resolution resulting from downsampling high-fidelity images, and (3) multispectral image alignment. To address these issues, we adopt a stand sliding window approach that operates on only small portions of multispectral orthomosaic maps (tiles), which are channel-wise aligned and calibrated radiometrically across the entire map. We define the tile size to be the same as that of the DNN input to avoid resolution loss. Compared to our baseline model (i.e., SegNet with 3 channel RGB (red, green, and blue) inputs) yielding an area under the curve (AUC) of [background=0.607, crop=0.681, weed=0.576], our proposed model with 9 input channels achieves [0.839, 0.863, 0.782]. Additionally, we provide an extensive analysis of 20 trained models, both qualitatively and quantitatively, in order to evaluate the effects of varying input channels and tunable network hyperparameters. Furthermore, we release a large sugar beet/weed aerial dataset with expertly guided annotations for further research in the fields of remote sensing, precision agriculture, and agricultural robotics.

A Transfer-Learning-based Feature Classification Algorithm for UAV Imagery in Crop Risk Management

Using Multi-Sensor Data Fusion Techniques and Machine Learning Algorithms for Improving UAV-Based Yield Prediction of Oilseed Rape

Transferring learned patterns from ground-based field imagery to predict UAV-based imagery for crop and weed semantic segmentation in precision crop farming

Weed Density Extraction Based on Few-Shot Learning Through UAV Remote Sensing RGB and Multispectral Images in Ecological Irrigation Area.

Low-Altitude Remote Sensing Based on Convolutional Neural Network for Weed Classification in Ecological Irrigation Area

Crop Weed Image Recognition of UAV Based on Improved HRNet-OCRNet

Fusion of UAV-Acquired Visible Images and Multispectral Data by Applying Machine-Learning Methods in Crop Classification

Cross-domain transfer learning for weed segmentation and mapping in precision farming using ground and UAV images

Fusion of Pixel and Object-Based Features for Weed Mapping Using Unmanned Aerial Vehicle Imagery

Rapid crops classification based on UAV low-altitude remote sensing

Area measurement for field crops based on UAV platform and image analysis

Intelligent Identification Method of Crop Species Using Improved U-Net Network in UAV Remote Sensing Image

A Deep-Learning- Based Low-Altitude Remote Sensing Algorithm for Weed Classification in Ecological Irrigation Area

Crop classification for UAV visible imagery using deep semantic segmentation methods

Real-Time Identification of Rice Weeds by UAV Low-Altitude Remote Sensing Based on Improved Semantic Segmentation Model

WEED DETECTION IN WHEAT CROP USING UAV for PRECISION AGRICULTURE

A novel semi-supervised framework for UAV based crop/weed classification

A Field Weed Density Evaluation Method Based on UAV Imaging and Modified U-Net

Precise Crop Classification Using Spectral-Spatial-Location Fusion Based on Conditional Random Fields for UAV-Borne Hyperspectral Remote Sensing Imagery

Machine Learning-Based Crop Drought Mapping System by UAV Remote Sensing RGB Imagery.

WeedMap: A Large-Scale Semantic Weed Mapping Framework Using Aerial Multispectral Imaging and Deep Neural Network for Precision Farming