Abstract:Blueberries are grown worldwide because of their high nutritional value; however, manual picking is difficult, and expert pickers are scarce. To meet the real needs of the market, picking robots that can identify the ripeness of blueberries are increasingly being used to replace manual operators. However, they struggle to accurately identify the ripeness of blueberries because of the heavy shading between the fruits and the small size of the fruit. This makes it difficult to obtain sufficient information on characteristics; and the disturbances caused by environmental changes remain unsolved. Additionally, the picking robot has limited computational power for running complex algorithms. To address these issues, we propose a new YOLO-based algorithm to detect the ripeness of blueberry fruits. The algorithm improves the structure of YOLOv5x. We replaced the fully connected layer with a one-dimensional convolution and also replaced the high-latitude convolution with a null convolution based on the structure of CBAM, and finally obtained a lightweight CBAM structure with efficient attention-guiding capability (Little-CBAM), which we embedded into MobileNetv3 while replacing the original backbone structure with the improved MobileNetv3. We expanded the original three-layer neck path by one to create a larger-scale detection layer leading from the backbone network. We added a multi-scale fusion module to the channel attention mechanism to build a multi-method feature extractor (MSSENet) and then embedded the designed channel attention module into the head network, which can significantly enhance the feature representation capability of the small target detection network and the anti-interference capability of the algorithm. Considering that these improvements will significantly extend the training time of the algorithm, we used EIOU_Loss instead of CIOU_Loss, whereas the k-means++ algorithm was used to cluster the detection frames such that the generated predefined anchor frames are better adapted to the scale of the blueberries. The algorithm in this study achieved a final mAP of 78.3% on the PC terminal, which was 9% higher than that of YOLOv5x, and the FPS was 2.1 times higher than that of YOLOv5x. By translating the algorithm into a picking robot, the algorithm in this study ran at 47 FPS and achieved real-time detection well beyond that achieved manually.

An Automatic Jujube Fruit Detection and Ripeness Inspection Method in the Natural Environment

Detection of Subtle Bruises on Winter Jujube Using Hyperspectral Imaging with Pixel-Wise Deep Learning Method

Research on Winter Jujube Object Detection Based on Optimized Yolov5s

Real-Time Detection of Winter Jujubes Based on Improved YOLOX-Nano Network

A Method of Robot Picking Citrus Based on 3D Detection

YOLOv7-Branch: A Jujube Leaf Branch Detection Model for Agricultural Robot

Fruit ripeness identification using YOLOv8 model

MLG-YOLO: A Model for Real-Time Accurate Detection and Localization of Winter Jujube in Complex Structured Orchard Environments

YOLO Models for Fresh Fruit Classification from Digital Videos

Fruits hidden by green: an improved YOLOV8n for detection of young citrus in lush citrus trees

Accurate Recognition of Jujube Tree Trunks Based on Contrast Limited Adaptive Histogram Equalization Image Enhancement and Improved YOLOv8

YOLO-P: An efficient method for pear fast detection in complex orchard picking environment

Innovative Research on Intelligent Recognition of Winter Jujube Defects by Applying Convolutional Neural Networks

CR-YOLOv9: Improved YOLOv9 Multi-Stage Strawberry Fruit Maturity Detection Application Integrated with CRNET

DSW-YOLO: A detection method for ground-planted strawberry fruits under different occlusion levels

Fusion of fruit image processing and deep learning: a study on identification of citrus ripeness based on R-LBP algorithm and YOLO-CIT model

A real-time table grape detection method based on improved YOLOv4-tiny network in complex background

YOLOC-tiny: a generalized lightweight real-time detection model for multiripeness fruits of large non-green-ripe citrus in unstructured environments

Detection of Gannan Navel Orange Ripeness in Natural Environment Based on YOLOv5-NMM

"Is this blueberry ripe?": a blueberry ripeness detection algorithm for use on picking robots