Abstract:Camellia oleifera fruits are randomly distributed in an orchard, and the fruits are easily blocked or covered by leaves. In addition, the colors of leaves and fruits are alike, and flowers and fruits grow at the same time, presenting many ambiguities. The large shock force will cause flowers to fall and affect the yield. As a result, accurate positioning becomes a difficult problem for robot picking. Therefore, studying target recognition and localization of Camellia oleifera fruits in complex environments has many difficulties. In this paper, a fusion method of deep learning based on visual perception and image processing is proposed to adaptively and actively locate fruit recognition and picking points for Camellia oleifera fruits. First, to adapt to the target classification and recognition of complex scenes in the field, the parameters of the You Only Live Once v7 (YOLOv7) model were optimized and selected to achieve Camellia oleifera fruits’ detection and determine the center point of the fruit recognition frame. Then, image processing and a geometric algorithm are used to process the image, segment, and determine the morphology of the fruit, extract the centroid of the outline of Camellia oleifera fruit, and then analyze the position deviation of its centroid point and the center point in the YOLO recognition frame. The frontlighting, backlight, partial occlusion, and other test conditions for the perceptual recognition processing were validated with several experiments. The results demonstrate that the precision of YOLOv7 is close to that of YOLOv5s, and the mean average precision of YOLOv7 is higher than that of YOLOv5s. For some occluded Camellia oleifera fruits, the YOLOv7 algorithm is better than the YOLOv5s algorithm, which improves the detection accuracy of Camellia oleifera fruits. The contour of Camellia oleifera fruits can be extracted entirely via image processing. The average position deviation between the centroid point of the image extraction and the center point of the YOLO recognition frame is 2.86 pixels; thus, the center point of the YOLO recognition frame is approximately considered to be consistent with the centroid point of the image extraction.

Christ-Siemens-Touraine syndrome--a clinical and genetic analysis of a large Brazilian kindred: III. Carrier detection.

Computer Vision-Based Localisation of Picking Points for Automatic Litchi Harvesting Applications Towards Natural Scenarios

CES-YOLOv8: Strawberry Maturity Detection Based on the Improved YOLOv8

Fruit Localization and Environment Perception for Strawberry Harvesting Robots

Real-Time Detection and Instance Segmentation of Strawberry in Unstructured Environment

Strawberry Ripeness Detection Using Deep Learning Models

A Small Target Strawberry Recognition Method Based on Improved YOLOv8n Model

Real-time Strawberry Detection Based on Improved YOLOv5s Architecture for Robotic Harvesting in open-field environment

YOLOv5-ASFF: A Multistage Strawberry Detection Algorithm Based on Improved YOLOv5

Strawberry detection and counting based on YOLOv7 pruning and information based tracking algorithm

Multi-Target Recognition of Bananas and Automatic Positioning for the Inflorescence Axis Cutting Point

DSW-YOLO: A detection method for ground-planted strawberry fruits under different occlusion levels

Adaptive Active Positioning of Camellia oleifera Fruit Picking Points: Classical Image Processing and YOLOv7 Fusion Algorithm

Real-Time Monitoring Method of Strawberry Fruit Growth State Based on YOLO Improved Model

Strawberries recognition and cutting point detection for fruit harvesting and truss pruning

CR-YOLOv9: Improved YOLOv9 Multi-Stage Strawberry Fruit Maturity Detection Application Integrated with CRNET

Fruit fast tracking and recognition of apple picking robot based on improved YOLOv5

Real-Time Identification of Strawberry Pests and Diseases Using an Improved YOLOv8 Algorithm