Abstract:Citrus fruits are extensively cultivated fruits with high nutritional value. The identification of distinct ripeness stages in citrus fruits plays a crucial role in guiding the planning of harvesting paths for citrus-picking robots and facilitating yield estimations in orchards. However, challenges arise in the identification of citrus fruit ripeness due to the similarity in color between green unripe citrus fruits and tree leaves, leading to an omission in identification. Additionally, the resemblance between partially ripe, orange-green interspersed fruits and fully ripe fruits poses a risk of misidentification, further complicating the identification of citrus fruit ripeness. This study proposed the YOLO-CIT (You Only Look Once-Citrus) model and integrated an innovative R-LBP (Roughness-Local Binary Pattern) method to accurately identify citrus fruits at distinct ripeness stages. The R-LBP algorithm, an extension of the LBP algorithm, enhances the texture features of citrus fruits at distinct ripeness stages by calculating the coefficient of variation in grayscale values of pixels within a certain range in different directions around the target pixel. The C3 model embedded by the CBAM (Convolutional Block Attention Module) replaced the original backbone network of the YOLOv5s model to form the backbone of the YOLO-CIT model. Instead of traditional convolution, Ghostconv is utilized by the neck network of the YOLO-CIT model. The fruit segment of citrus in the original citrus images processed by the R-LBP algorithm is combined with the background segment of the citrus images after grayscale processing to construct synthetic images, which are subsequently added to the training dataset. The experiment showed that the R-LBP algorithm is capable of amplifying the texture features among citrus fruits at distinct ripeness stages. The YOLO-CIT model combined with the R-LBP algorithm has a Precision of 88.13%, a Recall of 93.16%, an F1 score of 90.89, a mAP@0.5 of 85.88%, and 6.1ms of average detection speed for citrus fruit ripeness identification in complex environments. The model demonstrates the capability to accurately and swiftly identify citrus fruits at distinct ripeness stages in real-world environments, effectively guiding the determination of picking targets and path planning for harvesting robots.

CitrusYOLO: A Algorithm for Citrus Detection under Orchard Environment Based on YOLOv4

Detecting Citrus in Orchard Environment by Using Improved YOLOv4

Detection and localization of citrus fruit based on improved You Only Look Once v5s and binocular vision in the orchard

Real-time and Accurate Detection of Citrus in Complex Scenes Based on HPL-YOLOv4.

Detection of Dense Citrus Fruits by Combining Coordinated Attention and Cross-Scale Connection with Weighted Feature Fusion

A Multiscale Lightweight and Efficient Model Based on YOLOv7: Applied to Citrus Orchard

Fruits hidden by green: an improved YOLOV8n for detection of young citrus in lush citrus trees

A Method of Robot Picking Citrus Based on 3D Detection

Multi-stage Citrus Detection Based on Improved Yolov4

Green Citrus Detection and Counting in Orchards Based on YOLOv5-CS and AI Edge System

YOLOC-tiny: a generalized lightweight real-time detection model for multiripeness fruits of large non-green-ripe citrus in unstructured environments

LDC-PP-YOLOE: a lightweight model for detecting and counting citrus fruit

Real-time citrus variety detection in orchards based on complex scenarios of improved YOLOv7

CURI-YOLOv7: A Lightweight YOLOv7tiny Target Detector for Citrus Trees from UAV Remote Sensing Imagery Based on Embedded Device

Deep-learning-based in-field citrus fruit detection and tracking

Fusion of fruit image processing and deep learning: a study on identification of citrus ripeness based on R-LBP algorithm and YOLO-CIT model

Lemon‐YOLO: an Efficient Object Detection Method for Lemons in the Natural Environment

A Detection Algorithm for Citrus Huanglongbing Disease Based on an Improved YOLOv8n

SAW-YOLO: A Multi-Scale YOLO for Small Target Citrus Pests Detection

Approach of Dynamic Tracking and Counting for Obscured Citrus in Smart Orchard Based on Machine Vision

RESEARCH ON RECOGNITION OF OCCLUDED ORANGE FRUIT ON TREES BASED ON YOLOv4