Evaluation of the YOLO Models for Discrimination of the Alfalfa Pollinating Bee Species

Chuan-Jie Zhang,Teng Liu,Jinxu Wang,Danlan Zhai,Youxin Zhang,Yang Gao,Hui-Zhen Wu,Jialin Yu,Min Chen
DOI: https://doi.org/10.1016/j.aspen.2023.102195
IF: 1.586
2024-01-01
Journal of Asia-Pacific Entomology
Abstract:Identifying insect pollinators and their roles in mediating pollen flow is critical to understand the potential gene flow risks of insect pollination-dependent crop species, such as alfalfa. This study was conducted to evaluate and compare the feasibility of You Only Look Once (YOLO) version 3 (YOLOv3), YOLOv5, YOLOv7, and YOLO Representation (YOLOR) to discriminate the three most common alfalfa pollinating bee species, including honeybee, bumblebee, and leafcutting bee. The metrics comparison results showed YOLOv3 and YOLOv5 outperformed YOLOv7 and YOLOR regarding model precision, recall, F1 score, and mAP50 values. YOLOv3 and YOLOv5 could successfully discriminate the three different bee species with an accuracy of almost 100% (99.9%, 99.8%, and 100% accuracy for honeybee, bumblebee, and leafcutting bee for the two models, respectively). Comparatively, YOLOv7 could discriminate honeybee with an accuracy of 95% but was more likely to mistakenly discriminate bumblebee and leafcutting bee due to the relatively lower discriminating accuracy (87.3% and 66.2%, respectively). While the values of determined parameters for YOLOR were lower than YOLOv3 and YOLOv5, the higher precision (0.99680) along with recall (0.98721), F1 (0.99198), mAP50 (0.99323), and mAP50-100 (0.89076) values indicate that this model could be able to obtain a favorable performance in discriminating the three bee species. In summary, the proposed method in this study has the potential for identifying the alfalfa pollinating bee species, studying the bees' flower-visiting behaviors, evaluating the risks of insect-mediated pollen flow, and thus contributing to the management of genetically engineered (GE) alfalfa transgene flow.
What problem does this paper attempt to address?