Abstract:Introduction: Fruit detection is one of the key functions of an automatic picking robot, but fruit detection accuracy is seriously decreased when fruits are against a disordered background and in the shade of other objects, as is commmon in a complex orchard environment. Methods: Here, an effective mode based on YOLOv5, namely YOLO-P, was proposed to detect pears quickly and accurately. Shuffle block was used to replace the Conv, Batch Norm, SiLU (CBS) structure of the second and third stages in the YOLOv5 backbone, while the inverted shuffle block was designed to replace the fourth stage's CBS structure. The new backbone could extract features of pears from a long distance more efficiently. A convolutional block attention module (CBAM) was inserted into the reconstructed backbone to improve the robot's ability to capture pears' key features. Hard-Swish was used to replace the activation functions in other CBS structures in the whole YOLOv5 network. A weighted confidence loss function was designed to enhance the detection effect of small targets. Result: At last, model comparison experiments, ablation experiments, and daytime and nighttime pear detection experiments were carried out. In the model comparison experiments, the detection effect of YOLO-P was better than other lightweight networks. The results showed that the module's average precision (AP) was 97.6%, which was 1.8% higher than the precision of the original YOLOv5s. The model volume had been compressed by 39.4%, from 13.7MB to only 8.3MB. Ablation experiments verified the effectiveness of the proposed method. In the daytime and nighttime pear detection experiments, an embedded industrial computer was used to test the performance of YOLO-P against backgrounds of different complexities and when fruits are in different degrees of shade. Discussion: The results showed that YOLO-P achieved the highest F1 score (96.1%) and frames per second (FPS) (32 FPS). It was sufficient for the picking robot to quickly and accurately detect pears in orchards. The proposed method can quickly and accurately detect pears in unstructured environments. YOLO-P provides support for automated pear picking and can be a reference for other types of fruit detection in similar environments.

Peach Detection Algorithm Based on Information Extraction of Color Difference Coupled Circle Fitting Technique

Feature Extraction And Recognition Based On Machine Vision Application In Lotus Picking Robot

Recognition and Localization Method of Overlapping Apples for Apple Harvesting Robot

Image Detection of Peach Diseases and Pests

Fast detection method of green peach for application of picking robot

Fruit detection in natural environment using partial shape matching and probabilistic Hough transform

Detecting ripe fruits under natural occlusion and illumination conditions

A Dragon Fruit Picking Detection Method Based on YOLOv7 and PSP-Ellipse

Guava Detection and Pose Estimation Using a Low-Cost RGB-D Sensor in the Field

Green Grape Detection and Picking-Point Calculation in a Night-Time Natural Environment Using a Charge-Coupled Device (CCD) Vision Sensor with Artificial Illumination

CRLNet: A Multimodal Peach Detection Network Based on Cooperative Asymptotic Enhancement and the Fusion of Granularity Refinement

An FCM-based Method to Recognize and Extract Ripe Tomato for Harvesting Robotic System

Fruit position recognition and ripeness determination methods for a fruit automatic harvesting robot

A spraying path planning algorithm based on colour-depth fusion segmentation in peach orchards

Mature pomegranate fruit detection and location combining improved F-PointNet with 3D point cloud clustering in orchard

Identification and Location Algorithm of Fragrant Pear Fruit and Its Application in Automatic Picking System

Design of Yellow Peach Quality Identification System Based on PlC and Machine Vision

Peaches Detection Using a Deep Learning Technique—A Contribution to Yield Estimation, Resources Management, and Circular Economy

Fruit Detection and Pose Estimation for Grape Cluster-Harvesting Robot Using Binocular Imagery Based on Deep Neural Networks

YOLO-P: An efficient method for pear fast detection in complex orchard picking environment

Inspecting Diameter and Defect Area of Fruit With Machine Vision