Abstract:The apple target recognition algorithm is one of the core technologies of the apple picking robot. However, most of the existing apple detection algorithms cannot distinguish between the apples that are occluded by tree branches and occluded by other apples. The apples, grasping end-effector and mechanical picking arm of the robot are very likely to be damaged if the algorithm is directly applied to the picking robot. Based on this practical problem, in order to automatically recognize the graspable and ungraspable apples in an apple tree image, a light-weight apple targets detection method was proposed for picking robot using improved YOLOv5s. Firstly, BottleneckCSP module was improved designed to BottleneckCSP-2 module which was used to replace the BottleneckCSP module in backbone architecture of original YOLOv5s network. Secondly, SE module, which belonged to the visual attention mechanism network, was inserted to the proposed improved backbone network. Thirdly, the bonding fusion mode of feature maps, which were inputs to the target detection layer of medium size in the original YOLOv5s network, were improved. Finally, the initial anchor box size of the original network was improved. The experimental results indicated that the graspable apples, which were unoccluded or only occluded by tree leaves, and the ungraspable apples, which were occluded by tree branches or occluded by other fruits, could be identified effectively using the proposed improved network model in this study. Specifically, the recognition recall, precision, mAP and F1 were 91.48%, 83.83%, 86.75% and 87.49%, respectively. The average recognition time was 0.015 s per image. Contrasted with original YOLOv5s, YOLOv3, YOLOv4 and EfficientDet-D0 model, the mAP of the proposed improved YOLOv5s model increased by 5.05%, 14.95%, 4.74% and 6.75% respectively, the size of the model compressed by 9.29%, 94.6%, 94.8% and 15.3% respectively. The average recognition speeds per image of the proposed improved YOLOv5s model were 2.53, 1.13 and 3.53 times of EfficientDet-D0, YOLOv4 and YOLOv3 and model, respectively. The proposed method can provide technical support for the real-time accurate detection of multiple fruit targets for the apple picking robot.

A recognition algorithm applied to apple orchard picking robot

Research on Trunk and Branch Recognition Method of Apple Harvesting Robot

Recognition and Localization Method of Overlapping Apples for Apple Harvesting Robot

Research on High Performance Apple Recognition Model Construction Strategy Based on Deep Learning

Image Recognition for Fruit-Picking Robots

Design and Research on Vision System of Apple Harvesting Robot

Apple-Harvesting Robot Based on the YOLOv5-RACF Model

Fruit fast tracking and recognition of apple picking robot based on improved YOLOv5

Apple recognition and picking sequence planning for harvesting robot in the complex environment

Apple Ripeness Identification from Digital Images Using Transformers

RGB-D Camera and Fractal-Geometry-Based Maximum Diameter Estimation Method of Apples for Robot Intelligent Selective Graded Harvesting

Apple Ripeness Identification Using Deep Learning

Research on Apple Recognition Algorithm in Complex Orchard Environment Based on Deep Learning

A Real-Time Apple Targets Detection Method for Picking Robot Based on Improved YOLOv5

An Apple Detection Method Based on Des-YOLO v4 Algorithm for Harvesting Robots in Complex Environment

Accurate segmentation of green fruit based on optimized mask RCNN application in complex orchard

Recognition of green apples in an orchard environment by combining the GrabCut model and Ncut algorithm

Attention-Based Fine-Grained Lightweight Architecture for Fuji Apple Maturity Classification in an Open-World Orchard Environment

Apple Fruit Edge Detection Model Using a Rough Set and Convolutional Neural Network

Apple Detection in Complex Scene Using the Improved YOLOv4 Model

Research on Robot Image Recognition Based on Deep Learning