Abstract:Automatic fruit counting is an important task for growers to estimate yield and manage orchards. Although many deep-learning-based fruit detection algorithms have been developed to improve performance of automatic fruit counting systems, abnormal fruit detection has often been caused by these algorithms detecting non-target fruits that have similar growth characteristics to target fruits. For abnormal fruit detection, detected fruits in the back row of the tree were defined as DFBRT, while detected fruits on the ground were defined as DFG. Both of them would result in a higher number of fruits counting than the ground truth. This study proposes an automatic fruit counting system called NDMFCS (Normal Detection Matched Fruit Counting System) to solve this problem for improving fruit counting accuracy in modern apple orchard. NDMFCS consists of three sub-systems, i.e. object detection based on You Only Look Once Version 4-tiny (YOLOv4-tiny), abatement of abnormal fruit detection based on threshold, and fruit counting based on trunk tracking and identity document (ID) assignment. YOLOv4tiny was selected to implement detection of fruits and trunks, whose output is confidence and pixel coordinates of detected object. The DFBRT and DFG were abated by thresholds to improve detection performance of fruit. This meant that detected fruits were removed when their distance from camera is further than a distance threshold or the confidence of fruit detection is less than a confidence threshold. Finally, fruit counting was implemented by trunk tracking and ID assignment, where each fruit was assigned a unique tracking ID. Results on 10 sets of original videos indicated that average fruit detection precision was improved from 89.1% to 93.3% after abatement of abnormal fruit detection. Also, Multiple Object Tracking Accuracy and Multiple Object Tracking Precision were improved on average by 4.2% and 3.3%, respectively, while average ID Switch Rate was decreased on average by 1.1%. And average fruit counting accuracy was improved to 95.0% by 4.2%. Coefficient of determination (R2) was 0.97, which indicated the number of fruits counted by NDMFCS was near to the ground truth. These results demonstrate that the abatement of abnormal fruit detection can improve performance of apple counting, which has the potential to provide a technical support for estimating fruit yield in modern apple orchards.

Apple orchard production estimation using deep learning strategies: A comparison of tracking-by-detection algorithms

A novel apple fruit detection and counting methodology based on deep learning and trunk tracking in modern orchard

Automatic Apple Detection and Counting with AD-YOLO and MR-SORT

Apple Fruit Detection and Counting Based on Deep Learning and Trunk Tracking

A Comparative Study of Fruit Detection and Counting Methods for Yield Mapping in Apple Orchards

Fruit Detection and Counting in Apple Orchards Based on Improved Yolov7 and Multi-Object Tracking Methods

Recognition and Counting of Apples in a Dynamic State Using a 3D Camera and Deep Learning Algorithms for Robotic Harvesting Systems

Kiwifruit Counting Using Kiwidetector and Kiwitracker

A Seamless Deep Learning Approach for Apple Detection, Depth Estimation, and Tracking Using YOLO Models Enhanced by Multi-Head Attention Mechanism

Deep-learning-based in-field citrus fruit detection and tracking

Approach of Dynamic Tracking and Counting for Obscured Citrus in Smart Orchard Based on Machine Vision

NDMFCS: an Automatic Fruit Counting System in Modern Apple Orchard Using Abatement of Abnormal Fruit Detection

Real-time Tracking and Counting of Grape Clusters in the Field Based on Channel Pruning with YOLOv5s

Twice Matched Fruit Counting System: an Automatic Fruit Counting Pipeline in Modern Apple Orchard Using Mutual and Secondary Matches

Towards Real Scenery: A Light-weight Tomato Growth Inspection Algorithm for Leaf Disease Detection and Fruit Counting

Apple Counting using Convolutional Neural Networks

Research on Apple Recognition Algorithm in Complex Orchard Environment Based on Deep Learning

Detection and Counting of Small Target Apples under Complicated Environments by Using Improved YOLOv7-tiny

A Two-Stage Deep-Learning Model for Detection and Occlusion-Based Classification of Kashmiri Orchard Apples for Robotic Harvesting

Detection of Overlapped Apples in Orchard Scene Using Improved K-means and Distance Least Square

Image Segmentation for Fruit Detection and Yield Estimation in Apple Orchards