Towards practical 2D grapevine bud detection with fully convolutional networks
Wenceslao Villegas Marset,Diego Sebastián Pérez,Carlos Ariel Díaz,Facundo Bromberg
DOI: https://doi.org/10.1016/j.compag.2020.105947
IF: 8.3
2021-03-01
Computers and Electronics in Agriculture
Abstract:<p>In Viticulture, visual inspection of the plant is a necessary task for measuring relevant variables. In many cases, these visual inspections are susceptible to automation through computer vision methods. Bud detection is one such visual task, central for the measurement of important variables such as: measurement of bud sunlight exposure, autonomous pruning, bud counting, type-of-bud classification, bud geometric characterization, internode length, bud area, and bud development stage, among others. This paper presents a computer method for grapevine bud detection based on a <em>Fully Convolutional Networks MobileNet</em> architecture (<strong>FCN-MN</strong>). To validate its performance, this architecture was compared in the detection task with a strong method for bud detection, Scanning Windows (<strong>SW</strong>) based on a patch classifier, showing improvements over three aspects of detection: <em>segmentation, correspondence identification</em> and <em>localization</em>. The best version of FCN-MN showed a detection F1-measure of <span class="math"><math>88.6%</math></span> (for true positives defined as detected components whose intersection-over-union with the true bud is above <span class="math"><math>0.5</math></span>), and false positives that are small and near the true bud. Splits –false positives overlapping the true bud– showed a mean segmentation precision of <span class="math"><math>89.3%(21.7)</math></span>, while false alarms –false positives not overlapping the true bud– showed a mean pixel area of only <span class="math"><math>8%</math></span> the area of a true bud, and a distance (between mass centers) of <span class="math"><math>1.1</math></span> true bud diameters. The paper concludes by discussing how these results for FCN-MN would produce sufficiently accurate measurements of bud variables such as <em>bud number</em>, <em>bud area</em>, and <em>internode length</em>, suggesting a good performance in a practical setup.</p>
agriculture, multidisciplinary,computer science, interdisciplinary applications