Abstract:The use of deep neural networks (DNNs) in plant phenotyping has recently received considerable attention. By using DNNs, valuable insights into plant traits can be readily achieved. While these networks have made considerable advances in plant phenotyping, the results are processed too slowly to allow for real-time decision-making. Therefore, being able to perform plant phenotyping computations in real-time has become a critical part of precision agriculture and agricultural informatics. In this work, we utilize state-of-the-art object detection networks to accurately detect, count, and localize plant leaves in real-time. Our work includes the creation of an annotated dataset of Arabidopsis plants captured using Cannon Rebel XS camera. These images and annotations have been complied and made publicly available. This dataset is then fed into a Tiny-YOLOv3 network for training. The Tiny-YOLOv3 network is then able to converge and accurately perform real-time localization and counting of the leaves. We also create a simple robotics platform based on an Android phone and iRobot create2 to demonstrate the real-time capabilities of the network in the greenhouse. Additionally, a performance comparison is conducted between Tiny-YOLOv3 and Faster R-CNN. Unlike Tiny-YOLOv3, which is a single network that does localization and identification in a single pass, the Faster R-CNN network requires two steps to do localization and identification. While with Tiny-YOLOv3, inference time, F1 Score, and false positive rate (FPR) are improved compared to Faster R-CNN, other measures such as difference in count (DiC) and AP are worsened. Specifically, for our implementation of Tiny-YOLOv3, the inference time is under 0.01 s, the F1 Score is over 0.94, and the FPR is around 24%. Last, transfer learning using Tiny-YOLOv3 to detect larger leaves on a model trained only on smaller leaves is implemented. The main contributions of the paper are in creating dataset (shared with the research community), as well as the trained Tiny-YOLOv3 network for leaf localization and counting.

LeTra: a leaf tracking workflow based on convolutional neural networks and intersection over union

Joint Multi-Leaf Segmentation, Alignment and Tracking from Fluorescence Plant Videos

Hierarchical Approach for Joint Semantic, Plant Instance, and Leaf Instance Segmentation in the Agricultural Domain

Local refinement mechanism for improved plant leaf segmentation in cluttered backgrounds

Leaf Angle Estimation using Mask R-CNN and LETR Vision Transformer

Doing More With Less: A Multitask Deep Learning Approach in Plant Phenotyping

Real-Time Plant Leaf Counting Using Deep Object Detection Networks

A Segmentation-Guided Deep Learning Framework for Leaf Counting

Unsupervised Pre-Training for 3D Leaf Instance Segmentation

Plant leaf identification based on shape and convolutional features

Deep Leaf Segmentation Using Synthetic Data

Leaf segmentation through the classification of edges

Leaf Recognition Using Convolutional Neural Networks Based Features

An overlapping-free leaf segmentation method for plant point clouds

LeafNet: a Tool for Segmenting and Quantifying Stomata and Pavement Cells.

: Recognizing Leaf Images Like Human Botanists.

An Approach for Plant Leaf Image Segmentation Based on YOLOV8 and the Improved DEEPLABV3

Toward Automatic Plant Phenotyping: Starting from Leaf Counting

Leaf Counting: Fusing Network Components for Improved Accuracy

Plant-part Segmentation Using Deep Learning and Multi-View Vision

Automated and accurate segmentation of leaf venation networks via deep learning