Abstract:Site-specific treatment of weeds in agricultural landscapes has been gaining importance in recent years due to economic savings and minimal impact on the environment. Different detection methods have been developed and tested for precision weed management systems, but recent developments in neural networks have offered great prospects. However, a major limitation with the neural network models is the requirement of high volumes of data for training. The current study aims at exploring an alternative approach to the use of real images to address this issue. In this study, synthetic images were generated with various strategies using plant instances clipped from UAV-borne real images. In addition, the Generative Adversarial Networks (GAN) technique was used to generate fake plant instances which were used in generating synthetic images. These images were used to train a powerful convolutional neural network (CNN) known as "Mask R-CNN" for weed detection and segmentation in a transfer learning mode. The study was conducted on morningglories (MG) and grass weeds (Grass) infested in cotton. The biomass for individual weeds was also collected in the field for biomass modeling using detection and segmentation results derived from model inference. Results showed a comparable performance between the real plant-based synthetic image (mean average precision for mask-mAP m : 0.60; mean average precision for bounding box-mAP b : 0.64) and real image datasets (mAP m : 0.80; mAP b : 0.81). However, the mixed dataset (real image + real plant instance-based synthetic image dataset) resulted in no performance gain for segmentation mask whereas a very small performance gain for bounding box (mAP m : 0.80; mAP b : 0.83). Around 40–50 plant instances were sufficient for generating synthetic images that resulted in optimal performance. Row orientation of cotton in the synthetic images was beneficial compared to random-orientation. Synthetic images generated with automatically-clipped plant instances performed similarly to the ones generated with manually-clipped instances. Generative Adversarial Networks-derived fake plant instances-based synthetic images did not perform as effectively as real plant instance-based synthetic images. The canopy mask area predicted weed biomass better than bounding box area with R 2 values of 0.66 and 0.46 for MG and Grass, respectively. The findings of this study offer valuable insights for guiding future endeavors oriented towards using synthetic images for weed detection and segmentation, and biomass estimation in row crops.

A powerful image synthesis and semi-supervised learning pipeline for site-specific weed detection

Semi-Supervised Weed Detection for Rapid Deployment and Enhanced Efficiency

Weed Density and Distribution Estimation for Precision Agriculture Using Semi-Supervised Learning

CNN feature based graph convolutional network for weed and crop recognition in smart farming

Deep Learning with Unsupervised Data Labeling for Weeds Detection on UAV Images

Performance Evaluation of Semi-supervised Learning Frameworks for Multi-Class Weed Detection

Image patch-based deep learning approach for crop and weed recognition

Efficient Crop Segmentation Net and Novel Weed Detection Method

Weed detection to weed recognition: reviewing 50 years of research to identify constraints and opportunities for large-scale cropping systems

WeedMap: A Large-Scale Semantic Weed Mapping Framework Using Aerial Multispectral Imaging and Deep Neural Network for Precision Farming

Use of synthetic images for training a deep learning model for weed detection and biomass estimation in cotton

Deep learning based weed detection and target spraying robot system at seedling stage of cotton field

Transferring learned patterns from ground-based field imagery to predict UAV-based imagery for crop and weed semantic segmentation in precision crop farming

Deep convolutional neural networks for image-based Convolvulus sepium detection in sugar beet fields

Deep-CNN based Robotic Multi-Class Under-Canopy Weed Control in Precision Farming

Generative AI-based Pipeline Architecture for Increasing Training Efficiency in Intelligent Weed Control Systems

Deep Learning-Based Object Detection System for Identifying Weeds Using UAS Imagery

weedNet: Dense Semantic Weed Classification Using Multispectral Images and MAV for Smart Farming

Deep Learning Techniques for In-Crop Weed Identification: A Review

Cross-domain transfer learning for weed segmentation and mapping in precision farming using ground and UAV images

Weed recognition using deep learning techniques on class-imbalanced imagery