Abstract:In the production management of agriculture, accurate fruit counting plays a vital role in the orchard yield estimation and appropriate production decisions. Although recent tracking-by-detection algorithms have emerged as a promising fruit-counting method, they still cannot completely avoid fruit occlusion and light variations in complex orchard environments, and it is difficult to realize automatic and accurate apple counting. In this paper, a video-based multiple-object tracking method, MR-SORT (Multiple Rematching SORT), is proposed based on the improved YOLOv8 and BoT-SORT. First, we propose the AD-YOLO model, which aims to reduce the number of incorrect detections during object tracking. In the YOLOv8s backbone network, an Omni-dimensional Dynamic Convolution (ODConv) module is used to extract local feature information and enhance the model's ability better; a Global Attention Mechanism (GAM) is introduced to improve the detection ability of a foreground object (apple) in the whole image; a Soft Spatial Pyramid Pooling Layer (SSPPL) is designed to reduce the feature information dispersion and increase the sensory field of the network. Then, the improved BoT-SORT algorithm is proposed by fusing the verification mechanism, SURF feature descriptors, and the Vector of Local Aggregate Descriptors (VLAD) algorithm, which can match apples more accurately in adjacent video frames and reduce the probability of ID switching in the tracking process. The results show that the mAP metrics of the proposed AD-YOLO model are 3.1% higher than those of the YOLOv8 model, reaching 96.4%. The improved tracking algorithm has 297 fewer ID switches, which is 35.6% less than the original algorithm. The multiple-object tracking accuracy of the improved algorithm reached 85.6%, and the average counting error was reduced to 0.07. The coefficient of determination R2 between the ground truth and the predicted value reached 0.98. The above metrics show that our method can give more accurate counting results for apples and even other types of fruit.

Kiwifruit Counting Using Kiwidetector and Kiwitracker

A Real-Time Kiwifruit Detection Based on Improved YOLOv7.

Multiscale Kiwifruit Detection from Digital Images.

Fast and accurate detection of kiwifruit in orchard using improved YOLOv3-tiny model

Fruit Detection and Counting in Apple Orchards Based on Improved Yolov7 and Multi-Object Tracking Methods

A novel apple fruit detection and counting methodology based on deep learning and trunk tracking in modern orchard

Robust Fruit Counting: Combining Deep Learning, Tracking, and Structure from Motion

Fast Recognition and Counting Method of Dragon Fruit Flowers and Fruits Based on Video Stream

Automatic Apple Detection and Counting with AD-YOLO and MR-SORT

Utilizing RT-DETR Model for Fruit Calorie Estimation from Digital Images

Identifying the Branch of Kiwifruit Based on Unmanned Aerial Vehicle (UAV) Images Using Deep Learning Method

Deep-learning-based in-field citrus fruit detection and tracking

Enhancing kiwifruit flower pollination detection through frequency domain feature fusion: a novel approach to agricultural monitoring

Two-Stage Detection Algorithm for Kiwifruit Leaf Diseases Based on Deep Learning

A Real-Time Detection Algorithm for Kiwifruit Defects Based on YOLOv5

A robust and efficient citrus counting approach for large-scale unstructured orchards

Improved multi-classes kiwifruit detection in orchard to avoid collisions during robotic picking

Improved binocular localization of kiwifruit in orchard based on fruit and calyx detection using YOLOv5x for robotic picking

Development of effective model for non-destructive detection of defective kiwifruit based on graded lines

Kiwifruit detection in challenging conditions

Towards Real Scenery: A Light-weight Tomato Growth Inspection Algorithm for Leaf Disease Detection and Fruit Counting