Abstract:Plant disease evaluation is crucial to pathogen management and plant breeding. Human field scouting has been widely used to monitor disease progress and provide qualitative and quantitative evaluation, which is costly, laborious, subjective, and often imprecise. To improve disease evaluation accuracy, throughput, and objectiveness, an image-based approach with a deep learning-based analysis pipeline was developed to calculate infection severity of grape foliar diseases. The image-based approach used a ground imaging system for field data acquisition, consisting of a custom stereo camera with strobe light for consistent illumination and real time kinematic (RTK) GPS for accurate localization. The deep learning-based pipeline used the hierarchical multiscale attention semantic segmentation (HMASS) model for disease infection segmentation, color filtering for grapevine canopy segmentation, and depth and location information for effective region masking. The resultant infection, canopy, and effective region masks were used to calculate the severity rate of disease infections in an image sequence collected in a given unit (e.g., grapevine panel). Fungicide trials for grape downy mildew (DM) and powdery mildew (PM) were used as case studies to evaluate the developed approach and pipeline. Experimental results showed that the HMASS model achieved acceptable to good segmentation accuracy of DM (mIoU > 0.84) and PM (mIoU > 0.74) infections in testing images, demonstrating the model capability for symptomatic disease segmentation. With the consistent image quality and multimodal metadata provided by the imaging system, the color filter and overlapping region removal could accurately and reliably segment grapevine canopies and identify repeatedly imaged regions between consecutive image frames, leading to critical information for infection severity calculation. Image-derived severity rates were highly correlated (r > 0.95) with human-assessed values, and had comparable statistical power in differentiating fungicide treatment efficacy in both case studies. Therefore, the developed approach and pipeline can be used as an effective and efficient tool to quantify the severity of foliar disease infections, enabling objective, high-throughput disease evaluation for fungicide trial evaluation, genetic mapping, and breeding programs.

Semi-supervised deep learning and low-cost cameras for the semantic segmentation of natural images in viticulture

Semi-Supervised Learning for Visual Bird's Eye View Semantic Segmentation

Semi-Supervised Learning for Visual Bird's Eye View Semantic Segmentation

Deep Semantic Segmentation at the Edge for Autonomous Navigation in Vineyard Rows

Weakly and Semi-Supervised Detection, Segmentation and Tracking of Table Grapes with Limited and Noisy Data

Semantic Image Segmentation with Deep Learning for Vine Leaf Phenotyping

Grape Bunch Detection at Different Growth Stages Using Deep Learning Quantized Models

Counting of Grapevine Berries in Images via Semantic Segmentation using Convolutional Neural Networks

End-to-end deep learning for directly estimating grape yield from ground-based imagery

Using deep learning for pruning region detection and plant organ segmentation in dormant spur-pruned grapevines

Deep semantic segmentation for the quantification of grape foliar diseases in the vineyard

Detection of Single Grapevine Berries in Images Using Fully Convolutional Neural Networks

Vine disease detection in UAV multispectral images with deep learning segmentation approach

A Deep Learning Approach for Precision Viticulture, Assessing Grape Maturity via YOLOv7

Enlisting 3D Crop Models and GANs for More Data Efficient and Generalizable Fruit Detection

Bagging Improves the Performance of Deep Learning-Based Semantic Segmentation with Limited Labeled Images: A Case Study of Crop Segmentation for High-Throughput Plant Phenotyping

DualSeg: Fusing transformer and CNN structure for image segmentation in complex vineyard environment

A Non-Invasive Method Based on Computer Vision for Grapevine Cluster Compactness Assessment Using a Mobile Sensing Platform under Field Conditions

Surgical fine-tuning for Grape Bunch Segmentation under Visual Domain Shifts

Vineyard yield estimation by combining remote sensing, computer vision and artificial neural network techniques

Semantic Segmentation of Fruits on Multi-sensor Fused Data in Natural Orchards