Abstract:The precision detection of dense small targets in orchards is critical for the visual perception of agricultural picking robots. At present, the visual detection algorithms for plums still have a poor recognition effect due to the characteristics of small plum shapes and dense growth. Thus, this paper proposed a lightweight model based on the improved You Only Look Once version 4 (YOLOv4) to detect dense plums in orchards. First, we employed a data augmentation method based on category balance to alleviate the imbalance in the number of plums of different maturity levels and insufficient data quantity. Second, we abandoned Center and Scale Prediction Darknet53 (CSPDarknet53) and chose a lighter MobilenetV3 on selecting backbone feature extraction networks. In the feature fusion stage, we used depthwise separable convolution (DSC) instead of standard convolution to achieve the purpose of reducing model parameters. To solve the insufficient feature extraction problem of dense targets, this model achieved fine-grained detection by introducing a 152 × 152 feature layer. The Focal loss and complete intersection over union (CIOU) loss were joined to balance the contribution of hard-to-classify and easy-to-classify samples to the total loss. Then, the improved model was trained through transfer learning at different stages. Finally, several groups of detection experiments were designed to evaluate the performance of the improved model. The results showed that the improved YOLOv4 model had the best mean average precision (mAP) performance than YOLOv4, YOLOv4-tiny, and MobileNet-Single Shot Multibox Detector (MobileNet-SSD). Compared with some results from the YOLOv4 model, the model size of the improved model is compressed by 77.85%, the parameters are only 17.92% of the original model parameters, and the detection speed is accelerated by 112%. In addition, the influence of the automatic data balance algorithm on the accuracy of the model and the detection effect of the improved model under different illumination angles, different intensity levels, and different types of occlusions were discussed in this paper. It is indicated that the improved detection model has strong robustness and high accuracy under the real natural environment, which can provide data reference for the subsequent orchard yield estimation and engineering applications of robot picking work.

Real-time and Accurate Detection of Citrus in Complex Scenes Based on HPL-YOLOv4.

Detecting Citrus in Orchard Environment by Using Improved YOLOv4

CitrusYOLO: A Algorithm for Citrus Detection under Orchard Environment Based on YOLOv4

A Method of Robot Picking Citrus Based on 3D Detection

Detection and localization of citrus fruit based on improved You Only Look Once v5s and binocular vision in the orchard

YOLOC-tiny: a generalized lightweight real-time detection model for multiripeness fruits of large non-green-ripe citrus in unstructured environments

A Multiscale Lightweight and Efficient Model Based on YOLOv7: Applied to Citrus Orchard

Fruits hidden by green: an improved YOLOV8n for detection of young citrus in lush citrus trees

Detection of Dense Citrus Fruits by Combining Coordinated Attention and Cross-Scale Connection with Weighted Feature Fusion

YOLO-P: An efficient method for pear fast detection in complex orchard picking environment

Fusion of fruit image processing and deep learning: a study on identification of citrus ripeness based on R-LBP algorithm and YOLO-CIT model

Lemon‐YOLO: an Efficient Object Detection Method for Lemons in the Natural Environment

A Real-Time Kiwifruit Detection Based on Improved YOLOv7.

Green Citrus Detection and Counting in Orchards Based on YOLOv5-CS and AI Edge System

Xiaomila Green Pepper Target Detection Method under Complex Environment Based on Improved YOLOv5s

Real-time citrus variety detection in orchards based on complex scenarios of improved YOLOv7

A Lightweight and High-Precision Passion Fruit YOLO Detection Model for Deployment in Embedded Devices

A Real-Time Zanthoxylum Target Detection Method for an Intelligent Picking Robot under a Complex Background, Based on an Improved YOLOv5s Architecture

Precision Detection of Dense Plums in Orchards Using the Improved YOLOv4 Model

Fruit fast tracking and recognition of apple picking robot based on improved YOLOv5

Apple Detection in Complex Scene Using the Improved YOLOv4 Model