Abstract:The precision detection of dense small targets in orchards is critical for the visual perception of agricultural picking robots. At present, the visual detection algorithms for plums still have a poor recognition effect due to the characteristics of small plum shapes and dense growth. Thus, this paper proposed a lightweight model based on the improved You Only Look Once version 4 (YOLOv4) to detect dense plums in orchards. First, we employed a data augmentation method based on category balance to alleviate the imbalance in the number of plums of different maturity levels and insufficient data quantity. Second, we abandoned Center and Scale Prediction Darknet53 (CSPDarknet53) and chose a lighter MobilenetV3 on selecting backbone feature extraction networks. In the feature fusion stage, we used depthwise separable convolution (DSC) instead of standard convolution to achieve the purpose of reducing model parameters. To solve the insufficient feature extraction problem of dense targets, this model achieved fine-grained detection by introducing a 152 × 152 feature layer. The Focal loss and complete intersection over union (CIOU) loss were joined to balance the contribution of hard-to-classify and easy-to-classify samples to the total loss. Then, the improved model was trained through transfer learning at different stages. Finally, several groups of detection experiments were designed to evaluate the performance of the improved model. The results showed that the improved YOLOv4 model had the best mean average precision (mAP) performance than YOLOv4, YOLOv4-tiny, and MobileNet-Single Shot Multibox Detector (MobileNet-SSD). Compared with some results from the YOLOv4 model, the model size of the improved model is compressed by 77.85%, the parameters are only 17.92% of the original model parameters, and the detection speed is accelerated by 112%. In addition, the influence of the automatic data balance algorithm on the accuracy of the model and the detection effect of the improved model under different illumination angles, different intensity levels, and different types of occlusions were discussed in this paper. It is indicated that the improved detection model has strong robustness and high accuracy under the real natural environment, which can provide data reference for the subsequent orchard yield estimation and engineering applications of robot picking work.

A Lightweight SOD-YOLOv5n Model-Based Winter Jujube Detection and Counting Method Deployed on Android

Detection of Subtle Bruises on Winter Jujube Using Hyperspectral Imaging with Pixel-Wise Deep Learning Method

Research on Winter Jujube Object Detection Based on Optimized Yolov5s

MLG-YOLO: A Model for Real-Time Accurate Detection and Localization of Winter Jujube in Complex Structured Orchard Environments

Real-Time Detection of Winter Jujubes Based on Improved YOLOX-Nano Network

An Automatic Jujube Fruit Detection and Ripeness Inspection Method in the Natural Environment

YOLOv7-Branch: A Jujube Leaf Branch Detection Model for Agricultural Robot

LDC-PP-YOLOE: a lightweight model for detecting and counting citrus fruit

YOLOC-tiny: a generalized lightweight real-time detection model for multiripeness fruits of large non-green-ripe citrus in unstructured environments

Fast and precise detection of litchi fruits for yield estimation based on the improved YOLOv5 model

Innovative Research on Intelligent Recognition of Winter Jujube Defects by Applying Convolutional Neural Networks

Fruits hidden by green: an improved YOLOV8n for detection of young citrus in lush citrus trees

Complete and Accurate Holly Fruits Counting Using YOLOX Object Detection

Fruit Detection and Positioning Technology for a Camellia Oleifera C. Abel Orchard Based on Improved YOLOv4-tiny Model and Binocular Stereo Vision

Detection and Counting of Small Target Apples under Complicated Environments by Using Improved YOLOv7-tiny

Automatic Apple Detection and Counting with AD-YOLO and MR-SORT

A Method of Robot Picking Citrus Based on 3D Detection

Precision Detection of Dense Plums in Orchards Using the Improved YOLOv4 Model

Fruit Detection and Counting in Apple Orchards Based on Improved Yolov7 and Multi-Object Tracking Methods

CitrusYOLO: A Algorithm for Citrus Detection under Orchard Environment Based on YOLOv4

Detection and localization of citrus fruit based on improved You Only Look Once v5s and binocular vision in the orchard