Abstract:Citrus fruits are extensively cultivated fruits with high nutritional value. The identification of distinct ripeness stages in citrus fruits plays a crucial role in guiding the planning of harvesting paths for citrus-picking robots and facilitating yield estimations in orchards. However, challenges arise in the identification of citrus fruit ripeness due to the similarity in color between green unripe citrus fruits and tree leaves, leading to an omission in identification. Additionally, the resemblance between partially ripe, orange-green interspersed fruits and fully ripe fruits poses a risk of misidentification, further complicating the identification of citrus fruit ripeness. This study proposed the YOLO-CIT (You Only Look Once-Citrus) model and integrated an innovative R-LBP (Roughness-Local Binary Pattern) method to accurately identify citrus fruits at distinct ripeness stages. The R-LBP algorithm, an extension of the LBP algorithm, enhances the texture features of citrus fruits at distinct ripeness stages by calculating the coefficient of variation in grayscale values of pixels within a certain range in different directions around the target pixel. The C3 model embedded by the CBAM (Convolutional Block Attention Module) replaced the original backbone network of the YOLOv5s model to form the backbone of the YOLO-CIT model. Instead of traditional convolution, Ghostconv is utilized by the neck network of the YOLO-CIT model. The fruit segment of citrus in the original citrus images processed by the R-LBP algorithm is combined with the background segment of the citrus images after grayscale processing to construct synthetic images, which are subsequently added to the training dataset. The experiment showed that the R-LBP algorithm is capable of amplifying the texture features among citrus fruits at distinct ripeness stages. The YOLO-CIT model combined with the R-LBP algorithm has a Precision of 88.13%, a Recall of 93.16%, an F1 score of 90.89, a mAP@0.5 of 85.88%, and 6.1ms of average detection speed for citrus fruit ripeness identification in complex environments. The model demonstrates the capability to accurately and swiftly identify citrus fruits at distinct ripeness stages in real-world environments, effectively guiding the determination of picking targets and path planning for harvesting robots.

Multispectral imaging and deep learning for oil palm fruit bunch ripeness detection

Application of Visible/Near-Infrared Spectroscopy Combined with Machine Vision Technique to Evaluate the Ripeness of Melons ( Cucumis melo L.)

Video based oil palm ripeness detection model using deep learning

Annotated Datasets of Oil Palm Fruit Bunch Piles for Ripeness Grading Using Deep Learning

Rapidly and exactly determining postharvest dry soybean seed quality based on machine vision technology.

Fast and robust detection of oil palm trees using high-resolution remote sensing images

Leveraging Deep Learning and Geospatial Analysis and Visualization

Outdoor oil palm fruit ripeness dataset

AI-Based Ripeness Grading for Oil Palm Fresh Fruit Bunch in Smart Crane Grabber

Non-Destructive Evaluation of Oil Palm Fresh Fruit Bunch Quality Using Thermal Vision

Integrated Fruit Ripeness Assessment System Based on an Artificial Olfactory Sensor and Deep Learning

Automatic detection of oil palm fruits from UAV images using an improved YOLO model

The Image Extraction Using the HSV Method to Determine the Maturity Level of Palm Oil Fruit with the k-nearest Neighbor Algorithm

A Machine Vision Rapid Method to Determine the Ripeness Degree of Olive Lots

Large-Scale Oil Palm Trees Detection from High-Resolution Remote Sensing Images Using Deep Learning

A Method of Robot Picking Citrus Based on 3D Detection

Fusion of fruit image processing and deep learning: a study on identification of citrus ripeness based on R-LBP algorithm and YOLO-CIT model

Non-Destructive Estimation of Physicochemical Properties and Detection of Ripeness Level of Apples Using Machine Vision

Automatic Detection of Oil Palm Tree from UAV Images Based on the Deep Learning Method

Enhancing sustainability in the production of palm oil: creative monitoring methods using YOLOv7 and YOLOv8 for effective plantation management

Development of deep learning method for predicting firmness and soluble solid content of postharvest Korla fragrant pear using Vis/NIR hyperspectral reflectance imaging