Abstract:In order to improve the working efficiency and environmental adaptability of apple picking robots, which can realize accurate recognition and localization, ripening assessment, and quality assessment under complex situations such as "leaf occlusion", "branch occlusion", "fruit occlusion", "mixed occlusion", etc., this paper proposes a Faster R-CNN-based apple recognition method. "mixed occlusion" and other complex situations to achieve accurate recognition and localization, maturity assessment, quality assessment, the paper proposes an apple recognition method based on Faster R-CNN. The method combines the cv2.inRange and cv2.fitEllipse functions in OpenCV to optimize the model, and performs color segmentation and shape fitting by setting up color and shape thresholds to recognize apples. The trained model was tested to have a recall of 88.44% under the validation set, an accuracy of 90.35%, an F1 value of 89.38%, and a recognition time of about 0.3 s per image.The experimental results showed that the number of apples in the dataset showed a normal distribution, with the number distributed more in the range of 0 to 10. Candidate frames are screened by RPN, and apple coordinates are derived based on the coordinate transformation formula, and the experimental results show that the apples are more densely distributed near the range of x=100, y=100. The image color distribution was extracted through color histogram, and the entropy value of GLCM, contrast as the texture feature of apples, and the classification prediction of apple ripeness was carried out by using Random Forest Model, and the accuracy of the model prediction was 83.2%, the precision rate was 84.1%, and the recall rate was 83.5%, and the experimental results showed that 88.7% of the apples were ripe. Image edges were extracted by the Canny edge detection algorithm and the area values of pixel points within the edges were calculated. The ratio of pixel area converted to apple mass was estimated to be 0.007 based on the image resolution and apple density, and the test results indicated that the mass of apples was mostly concentrated in the range of 0~100g.

Detection Of Young Green Apples In Orchard Environment Using Adaptive Ratio Chromatic Aberration And Hog-Svm

Computer Vision-Based Localisation of Picking Points for Automatic Litchi Harvesting Applications Towards Natural Scenarios

Combining an information-maximization-based attention mechanism and illumination invariance theory for the recognition of green apples in natural scenes

Application of Image Segmentation Algorithm Based on Entropy Clustering in Apple Harvesting Robot

The role of pulse time Toff on porous silicon as template for Au nanoparticles by using integrated electrochemical technique

Recognition of green apples in an orchard environment by combining the GrabCut model and Ncut algorithm

Immature Green Apple Detection and Sizing in Commercial Orchards Using YOLOv8 and Shape Fitting Techniques

Three Dimensional Apple Tree Organs Classification and Yield Estimation Algorithm Based on Multi-Features Fusion and Support Vector Machine

Fruit detection in natural environment using partial shape matching and probabilistic Hough transform

Detecting ripe fruits under natural occlusion and illumination conditions

Green Fruit‐Stem Pairing and Clustering for Machine Vision System in Robotic Thinning of Apples

Fruit Detection and Counting in Apple Orchards Based on Improved Yolov7 and Multi-Object Tracking Methods

Apple stem/calyx real-time recognition using YOLO-v5 algorithm for fruit automatic loading system

Research on High Performance Apple Recognition Model Construction Strategy Based on Deep Learning

An Apple Image Segmentation Method Based on a Color Index Obtained by a Genetic Algorithm

Examination of the Efficiency of Electrical Stimulation in Case of Stress and Urge Incontinence.

An improved YOLOv5s model for assessing apple graspability in automated harvesting scene

Image Segmentation for Fruit Detection and Yield Estimation in Apple Orchards

FCOS-LSC: A Novel Model for Green Fruit Detection in a Complex Orchard Environment

[Functional significance of adrenaline excretion induced by histamine].