Abstract:The typical occlusion of cherry tomatoes in the natural environment is one of the most critical factors affecting the accurate picking of cherry tomato picking robots. To recognize occluded cherry tomatoes accurately and efficiently using deep convolutional neural networks, a new occluded cherry tomato recognition model DSP-YOLOv7-CA is proposed. Firstly, images of cherry tomatoes with different degrees of occlusion are acquired, four occlusion areas and four occlusion methods are defined, and a cherry tomato dataset (TOSL) is constructed. Then, based on YOLOv7, the convolution module of the original residual edges was replaced with null residual edges, depth-separable convolutional layers were added, and jump connections were added to reuse feature information. Then, a depth-separable convolutional layer is added to the SPPF module with fewer parameters to replace the original SPPCSPC module to solve the problem of loss of small target information by different pooled residual layers. Finally, a coordinate attention mechanism (CA) layer is introduced at the critical position of the enhanced feature extraction network to strengthen the attention to the occluded cherry tomato. The experimental results show that the DSP-YOLOv7-CA model outperforms other target detection models, with an average detection accuracy (mAP) of 98.86%, and the number of model parameters is reduced from 37.62MB to 33.71MB, which is better on the actual detection of cherry tomatoes with less than 95% occlusion. Relatively average results were obtained on detecting cherry tomatoes with a shade level higher than 95%, but such cherry tomatoes were not targeted for picking. The DSP-YOLOv7-CA model can accurately recognize the occluded cherry tomatoes in the natural environment, providing an effective solution for accurately picking cherry tomato picking robots.

Visual recognition system of cherry picking robot based on Lab color model

Feature Extraction And Recognition Based On Machine Vision Application In Lotus Picking Robot

Computer Vision-Based Localisation of Picking Points for Automatic Litchi Harvesting Applications Towards Natural Scenarios

Outdoor Color Rating of Sweet Cherries Using Computer Vision

Recognition and Localization Method of Overlapping Apples for Apple Harvesting Robot

Design and Research on Vision System of Apple Harvesting Robot

Design and application of visual system in the Agaricus bisporus picking robot

An FCM-based Method to Recognize and Extract Ripe Tomato for Harvesting Robotic System

Color Model for Fruit Quality Inspection with Machine Vision

Application of Image Segmentation Algorithm Based on Entropy Clustering in Apple Harvesting Robot

3D Reconstruction of Camellia Oleifera Fruit Recognition and Fruit Branch based on Kinect Camera

Research in Target Recognition Arithmetic of Robot Based on Color

Recognition of fruits and vegetables with similar‐color background in natural environment: A survey

Analysis and Recognition Based on Citrus Color Grading Model considering Computer Vision Technology

Fuzzy color recognition and segmentation of robot vision scene

Peach Detection Algorithm Based on Information Extraction of Color Difference Coupled Circle Fitting Technique

A Method of Robot Picking Citrus Based on 3D Detection

Intelligent robotics harvesting system process for fruits grasping prediction

Fruit fast tracking and recognition of apple picking robot based on improved YOLOv5

An Autonomous Robot Oriented Real-Time Color Vision System

An occluded cherry tomato recognition model based on improved YOLOv7