Abstract:Site-specific treatment of weeds in agricultural landscapes has been gaining importance in recent years due to economic savings and minimal impact on the environment. Different detection methods have been developed and tested for precision weed management systems, but recent developments in neural networks have offered great prospects. However, a major limitation with the neural network models is the requirement of high volumes of data for training. The current study aims at exploring an alternative approach to the use of real images to address this issue. In this study, synthetic images were generated with various strategies using plant instances clipped from UAV-borne real images. In addition, the Generative Adversarial Networks (GAN) technique was used to generate fake plant instances which were used in generating synthetic images. These images were used to train a powerful convolutional neural network (CNN) known as "Mask R-CNN" for weed detection and segmentation in a transfer learning mode. The study was conducted on morningglories (MG) and grass weeds (Grass) infested in cotton. The biomass for individual weeds was also collected in the field for biomass modeling using detection and segmentation results derived from model inference. Results showed a comparable performance between the real plant-based synthetic image (mean average precision for mask-mAP m : 0.60; mean average precision for bounding box-mAP b : 0.64) and real image datasets (mAP m : 0.80; mAP b : 0.81). However, the mixed dataset (real image + real plant instance-based synthetic image dataset) resulted in no performance gain for segmentation mask whereas a very small performance gain for bounding box (mAP m : 0.80; mAP b : 0.83). Around 40–50 plant instances were sufficient for generating synthetic images that resulted in optimal performance. Row orientation of cotton in the synthetic images was beneficial compared to random-orientation. Synthetic images generated with automatically-clipped plant instances performed similarly to the ones generated with manually-clipped instances. Generative Adversarial Networks-derived fake plant instances-based synthetic images did not perform as effectively as real plant instance-based synthetic images. The canopy mask area predicted weed biomass better than bounding box area with R 2 values of 0.66 and 0.46 for MG and Grass, respectively. The findings of this study offer valuable insights for guiding future endeavors oriented towards using synthetic images for weed detection and segmentation, and biomass estimation in row crops.

Addition of fake imagery generated by generative adversarial networks for improving crop classification

Enhancing crop classification accuracy by synthetic SAR-Optical data generation using deep learning

Image-to-Image Translation-Based Data Augmentation for Improving Crop/Weed Classification Models for Precision Agriculture Applications

Synthesis of Multispectral Optical Images From SAR/Optical Multitemporal Data Using Conditional Generative Adversarial Networks

A Comparative Analysis of GAN-Based Methods for SAR-to-Optical Image Translation

Assessing the Potential of Multi-Temporal Conditional Generative Adversarial Networks in SAR-to-Optical Image Translation for Early-Stage Crop Monitoring

A-CGAN based transformation from ISAR to optical image

A SAR-to-Optical Image Translation Method Based on Conditional Generation Adversarial Network (cGAN)

Multi-Spectral Image Synthesis for Crop/Weed Segmentation in Precision Farming

Serial GANs: A Feature-Preserving Heterogeneous Remote Sensing Image Transformation Model.

Image translation between high-resolution optical and synthetic aperture radar (SAR) data

Electrooptical Image Synthesis from SAR Imagery Using Generative Adversarial Networks

TSGAN: An Optical-to-SAR Dual Conditional GAN for Optical based SAR Temporal Shifting

Gradient Structure Information-Guided Attention Generative Adversarial Networks for Remote Sensing Image Generation

CycleGAN-Based SAR-Optical Image Fusion for Target Recognition

Use of synthetic images for training a deep learning model for weed detection and biomass estimation in cotton

GAN-Generated Ocean SAR Vignettes Classification

A Dual-Generator Translation Network Fusing Texture and Structure Features for SAR and Optical Image Matching

Improved Few-Shot SAR Image Generation by Enhancing Diversity

Channel Attention GAN-Based Synthetic Weed Generation for Precise Weed Identification

A Two-Stage SAR Image Generation Algorithm Based on GAN with Reinforced Constraint Filtering and Compensation Techniques