Abstract:In the production management of agriculture, accurate fruit counting plays a vital role in the orchard yield estimation and appropriate production decisions. Although recent tracking-by-detection algorithms have emerged as a promising fruit-counting method, they still cannot completely avoid fruit occlusion and light variations in complex orchard environments, and it is difficult to realize automatic and accurate apple counting. In this paper, a video-based multiple-object tracking method, MR-SORT (Multiple Rematching SORT), is proposed based on the improved YOLOv8 and BoT-SORT. First, we propose the AD-YOLO model, which aims to reduce the number of incorrect detections during object tracking. In the YOLOv8s backbone network, an Omni-dimensional Dynamic Convolution (ODConv) module is used to extract local feature information and enhance the model's ability better; a Global Attention Mechanism (GAM) is introduced to improve the detection ability of a foreground object (apple) in the whole image; a Soft Spatial Pyramid Pooling Layer (SSPPL) is designed to reduce the feature information dispersion and increase the sensory field of the network. Then, the improved BoT-SORT algorithm is proposed by fusing the verification mechanism, SURF feature descriptors, and the Vector of Local Aggregate Descriptors (VLAD) algorithm, which can match apples more accurately in adjacent video frames and reduce the probability of ID switching in the tracking process. The results show that the mAP metrics of the proposed AD-YOLO model are 3.1% higher than those of the YOLOv8 model, reaching 96.4%. The improved tracking algorithm has 297 fewer ID switches, which is 35.6% less than the original algorithm. The multiple-object tracking accuracy of the improved algorithm reached 85.6%, and the average counting error was reduced to 0.07. The coefficient of determination R2 between the ground truth and the predicted value reached 0.98. The above metrics show that our method can give more accurate counting results for apples and even other types of fruit.

Object Detection for Vision-Aided Inventory Counting

Recognition and Distance Estimation of an Irregular Object in Package Sorting Line Based on Monocular Vision

Design and Implementation of an Intelligent Passenger Counting System Based on the Kinect Sensor

An Image Processing based Object Counting Approach for Machine Vision Application

Study and Application of Automatic Count System Based on Computer Vision Detect Technology

A Real-Time Cup-Detection Method Based on YOLOv3 for Inventory Management

Review Of Computer Vision Based Object Counting Methods

A Vision-based Inventory Method for Stacked Goods in Stereoscopic Warehouse

Training-free Object Counting with Prompts

MINSU (Mobile Inventory And Scanning Unit):Computer Vision and AI

Utilizing Density Estimation to Count Object

A Fast and High-Performance Object Proposal Method for Vision Sensors: Application to Object Detection

CLIP-Count: Towards Text-Guided Zero-Shot Object Counting

Counting Everyday Objects in Everyday Scenes

Automated Counting of Steel Construction Materials: Model, Methodology, and Online Deployment

A Design of Smart Unmanned Vending Machine for New Retail Based on Binocular Camera and Machine Vision

A Versatile Machine Vision Algorithm for Real-Time Counting Manually Assembled Pieces

Zero-Shot Object Counting with Language-Vision Models

Automatic Apple Detection and Counting with AD-YOLO and MR-SORT

Tracking indoor construction progress by deep-learning-based analysis of site surveillance video

Computer Vision for Construction Progress Monitoring: A Real-Time Object Detection Approach