Abstract:The ability to automatically monitor agricultural fields is an important capability in precision farming, enabling steps towards more sustainable agriculture. Precise, high-resolution monitoring is a key prerequisite for targeted intervention and the selective application of agro-chemicals. The main goal of this paper is developing a novel crop/weed segmentation and mapping framework that processes multispectral images obtained from an unmanned aerial vehicle (UAV) using a deep neural network (DNN). Most studies on crop/weed semantic segmentation only consider single images for processing and classification. Images taken by UAVs often cover only a few hundred square meters with either color only or color and near-infrared (NIR) channels. Although a map can be generated by processing single segmented images incrementally, this requires additional complex information fusion techniques which struggle to handle high fidelity maps due to their computational costs and problems in ensuring global consistency. Moreover, computing a single large and accurate vegetation map (e.g., crop/weed) using a DNN is non-trivial due to difficulties arising from: (1) limited ground sample distances (GSDs) in high-altitude datasets, (2) sacrificed resolution resulting from downsampling high-fidelity images, and (3) multispectral image alignment. To address these issues, we adopt a stand sliding window approach that operates on only small portions of multispectral orthomosaic maps (tiles), which are channel-wise aligned and calibrated radiometrically across the entire map. We define the tile size to be the same as that of the DNN input to avoid resolution loss. Compared to our baseline model (i.e., SegNet with 3 channel RGB (red, green, and blue) inputs) yielding an area under the curve (AUC) of [background=0.607, crop=0.681, weed=0.576], our proposed model with 9 input channels achieves [0.839, 0.863, 0.782]. Additionally, we provide an extensive analysis of 20 trained models, both qualitatively and quantitatively, in order to evaluate the effects of varying input channels and tunable network hyperparameters. Furthermore, we release a large sugar beet/weed aerial dataset with expertly guided annotations for further research in the fields of remote sensing, precision agriculture, and agricultural robotics.

Plant species recognition with optimized 3D polynomial neural networks and variably overlapping time–coherent sliding window

Plant-part Segmentation Using Deep Learning and Multi-View Vision

Robust diagnosis and meta visualizations of plant diseases through deep neural architecture with explainable AI

SWP-LeafNET: A novel multistage approach for plant leaf identification based on deep CNN

ThelR547v1—An Asymmetric Dilated Convolutional Neural Network for Real-time Semantic Segmentation of Horticultural Crops

Novel 3-D Deep Neural Network Architecture for Crop Classification Using Remote Sensing-Based Hyperspectral Images

Hierarchical Approach for Joint Semantic, Plant Instance, and Leaf Instance Segmentation in the Agricultural Domain

Optimized convolutional neural network model for plant species identification from leaf images using computer vision

Inside out: transforming images of lab-grown plants for machine learning applications in agriculture

Tailoring convolutional neural networks for custom botanical data

PhytNet -- Tailored Convolutional Neural Networks for Custom Botanical Data

A DEEP LEARNING METHODOLOGY FOR PLANT SPECIES RECOGNITION USING MORPHOLOGY OF LEAVES

Deep Convolutional Neural Network for Plant Seedlings Classification

Automatic Plant Cover Estimation with Convolutional Neural Networks

Transfer learning for versatile plant disease recognition with limited data

An ensemble of deep learning architectures for accurate plant disease classification

An Industrial-Grade Solution for Crop Disease Image Detection Tasks

Plant identification using deep neural networks via optimization of transfer learning parameters

Weed recognition using deep learning techniques on class-imbalanced imagery

WeedMap: A Large-Scale Semantic Weed Mapping Framework Using Aerial Multispectral Imaging and Deep Neural Network for Precision Farming

Central Attention and a Dual Path Convolutional Neural Network in Real-World Tree Species Recognition