Abstract:Dragon fruit is one of the most popular fruits in China and Southeast Asia. It, however, is mainly picked manually, imposing high labor intensity on farmers. The hard branches and complex postures of dragon fruit make it difficult to achieve automated picking. For picking dragon fruits with diverse postures, this paper proposes a new dragon fruit detection method, not only to identify and locate the dragon fruit, but also to detect the endpoints that are at the head and root of the dragon fruit, which can provide more visual information for the dragon fruit picking robot. First, YOLOv7 is used to locate and classify the dragon fruit. Then, we propose a PSP-Ellipse method to further detect the endpoints of the dragon fruit, including dragon fruit segmentation via PSPNet, endpoints positioning via an ellipse fitting algorithm and endpoints classification via ResNet. To test the proposed method, some experiments are conducted. In dragon fruit detection, the precision, recall and average precision of YOLOv7 are 0.844, 0.924 and 0.932, respectively. YOLOv7 also performs better compared with some other models. In dragon fruit segmentation, the segmentation performance of PSPNet on dragon fruit is better than some other commonly used semantic segmentation models, with the segmentation precision, recall and mean intersection over union being 0.959, 0.943 and 0.906, respectively. In endpoints detection, the distance error and angle error of endpoints positioning based on ellipse fitting are 39.8 pixels and 4.3°, and the classification accuracy of endpoints based on ResNet is 0.92. The proposed PSP-Ellipse method makes a great improvement compared with two kinds of keypoint regression method based on ResNet and UNet. Orchard picking experiments verified that the method proposed in this paper is effective. The detection method proposed in this paper not only promotes the progress of the automatic picking of dragon fruit, but it also provides a reference for other fruit detection.

Identification of Stages of Ripening of Dragon Fruit Using Neural Networks for Smart Agriculture

Dragon Fruit Maturity Detection Based-HSV Space Color Using Naive Bayes Classifier Method

Fruit Detection and Three-Stage Maturity Grading Using CNN

Software for classification of banana ripening stage using machine learning

Quality Classification of Dragon Fruits Based on External Performance Using a Convolutional Neural Network

Classification of Durian Fruits based on Ripening with Machine Learning Techniques

Fast Recognition and Counting Method of Dragon Fruit Flowers and Fruits Based on Video Stream

Prediction of Fruit Maturity, Quality, and Its Life Using Deep Learning Algorithms

Apple Ripeness Identification from Digital Images Using Transformers

Strawberry Ripeness Detection Using Deep Learning Models

Fruit Maturity Detection Using Matlab Image Processing

Deep neural network based fruit identification and grading system for precision agriculture

Apple Ripeness Identification Using Deep Learning

Banana Ripeness Classification Based On Image Processing With Machine Learning

The Novel Combination of Nano Vector Network Analyzer and Machine Learning for Fruit Identification and Ripeness Grading

Integrated Fruit Ripeness Assessment System Based on an Artificial Olfactory Sensor and Deep Learning

Comparison Analysis of HSV Method, CNN Algorithm, and SVM Algorithm in Detecting the Ripeness of Mangosteen Fruit Images

A Dragon Fruit Picking Detection Method Based on YOLOv7 and PSP-Ellipse

A general purpose multi-fruit system for assessing the quality of fruits with the application of recurrent neural network

Dragon fruit detection in natural orchard environment by integrating lightweight network and attention mechanism

Automatic Detection of Banana Maturity—Application of Image Recognition in Agricultural Production