Abstract:In the complex environment of an orchard, changes in illumination, leaf occlusion, and fruit overlap make it challenging for mobile picking robots to detect and locate oil-seed camellia fruit. To address this problem, YOLO-Oleifera was developed as a fruit detection model method based on a YOLOv4-tiny model, To obtain clustering results appropriate to the size of the Camellia oleifera fruit, the k-means++ clustering algorithm was used instead of the k-means clustering algorithm used by the YOLOv4-tiny model to determine bounding box priors. Two convolutional kernels of 1 x 1 and 3 x 3 were respectively added after the second and third CSPBlock modules of the YOLOv4-tiny model. This model allows the learning of Camellia oleifera fruit feature information and reduces overall computational complexity. Compared with the classic stereo matching method based on binocular camera images, this method innovatively used the bounding box generated by the YOLO-Oleifera model to extract the region of interest of the fruit, and then adaptively performs stereo matching according to the gen-eration mechanism of the bounding box. This allows the determination of disparity and facilitates the subsequent use of the triangulation principle to determine the picking position of the fruit. An ablation experiment demonstrated the effective improvement of the YOLOv4-tiny model. Camellia oleifera fruit images obtained under sunlight and shading conditions were used to test the YOLO-Oleifera model, and the model robustly detected the fruit under different illumination conditions. Occluded Camellia oleifera fruit decreased precision and recall due to the loss of semantic information. Comparison of this model with deep learning models YOLOv5-s,YOLOv3-tiny, and YOLOv4-tiny, the YOLO-Oleifera model achieved the highest AP of 0.9207 with the smallest data weight of 29 MB. The YOLO-Oleifera model took an average of 31 ms to detect each fruit image, fast enough to meet the demand for real-time detection. The algorithm exhibited high positioning stability and robust function despite changes in illumination. The results of this study can provide a technical reference for the robust detection and positioning of Camellia oleifera fruit by a mobile picking robot in a complex orchard environment.

3D Reconstruction of Camellia Oleifera Fruit Recognition and Fruit Branch based on Kinect Camera

Research on Trunk and Branch Recognition Method of Apple Harvesting Robot

Research on 3D Reconstruction Algorithm of Citrus Seedlings Based on Multi-View Geometry

Adaptive Active Positioning of Camellia oleifera Fruit Picking Points: Classical Image Processing and YOLOv7 Fusion Algorithm

Three-dimensional reconstruction of guava fruits and branches using instance segmentation and geometry analysis

Fruit Detection and Positioning Technology for a Camellia Oleifera C. Abel Orchard Based on Improved YOLOv4-tiny Model and Binocular Stereo Vision

Research summary of "Camellia oleifera fruit picking robot" technical analysis

Integrated detection of citrus fruits and branches using a convolutional neural network

Image recognition of camellia fruit based on preference for aiNET multi-features integration

YOLO-CFruit: a robust object detection method for Camellia oleifera fruit in complex environments

Robotic Harvesting of the Occluded Fruits with a Precise Shape and Position Reconstruction Approach

Fruit position recognition and ripeness determination methods for a fruit automatic harvesting robot

Occluded Apple Fruit Detection and Localization with a Frustum-Based Point-Cloud-Processing Approach for Robotic Harvesting

An Automatic Segmentation and Recognition Method of Apple Tree Point Clouds in the Real Scene Based on the Fusion of Color and 3D Feature

Fruit Recognition, Task Plan, and Control for Apple Harvesting Robots

Automatic Apple Recognition Based on the Fusion of Color and 3D Feature for Robotic Fruit Picking

Design and implementation of an automatic peach-harvesting robot system

Intelligent Tomato Picking Robot System Based on Multimodal Depth Feature Analysis Method

An FCM-based Method to Recognize and Extract Ripe Tomato for Harvesting Robotic System

Research on Spatial Positioning System of Fruits to be Picked in Field Based on Binocular Vision and SSD Model

Guava Detection and Pose Estimation Using a Low-Cost RGB-D Sensor in the Field