Abstract:The 'Huangguan' pear disease spot detection and grading is the key to fruit processing automation. Due to the variety of individual shapes and disease spot types of 'Huangguan' pear. The traditional computer vision technology and pattern recognition methods have some limitations in the detection of 'Huangguan' pear diseases. In recent years, with the development of deep learning technology and convolutional neural network provides a new solution for the fast and accurate detection of 'Huangguan' pear diseases. To achieve automatic grading of 'Huangguan' pear appearance quality in a complex context, this study proposes an integrated framework combining instance segmentation, semantic segmentation and grading models. In the first stage, Mask R-CNN and Mask R-CNN with the introduction of the preprocessing module are used to segment 'Huangguan' pears from complex backgrounds. In the second stage, DeepLabV3+, UNet and PSPNet are used to segment the 'Huangguan' pear spots to get the spots, and the ratio of the spot pixel area to the 'Huangguan' pear pixel area is calculated and classified into three grades. In the third stage, the grades of 'Huangguan' pear are obtained using ResNet50, VGG16 and MobileNetV3. The experimental results show that the model proposed in this paper can segment the 'Huangguan' pear and disease spots in complex background in steps, and complete the grading of 'Huangguan' pear fruit disease severity. According to the experimental results. The Mask R-CNN that introduced the CLAHE preprocessing module in the first-stage instance segmentation model is the most accurate. The resulting pixel accuracy (PA) is 97.38% and the Dice coefficient is 68.08%. DeepLabV3+ is the most accurate in the second-stage semantic segmentation model. The pixel accuracy is 94.03% and the Dice coefficient is 67.25%. ResNet50 is the most accurate among the third-stage classification models. The average precision (AP) was 97.41% and the F1 (harmonic average assessment) was 95.43%.In short, it not only provides a new framework for the detection and identification of 'Huangguan' pear fruit diseases in complex backgrounds, but also lays a theoretical foundation for the assessment and grading of 'Huangguan' pear diseases.

Apple, peach, and pear flower detection using semantic segmentation network and shape constraint level set

A Novel Adaptive Zone-fusion Network for Precise Waxberry Semantic Segmentation to Improve Automated-Harvesting in a Complex Orchard Environment

Multispecies Fruit Flower Detection Using a Refined Semantic Segmentation Network

Semantic Segmentation of Fruits on Multi-sensor Fused Data in Natural Orchards

Real-Time Grading of Defect Apples Using Semantic Segmentation Combination with a Pruned YOLO V4 Network

Fruit Detection from Digital Images Using CenterNet

Semantic segmentation for partially occluded apple trees based on deep learning

Apple Flower Detection using Deep Convolutional Networks

Application of an improved U-Net with image-to-image translation and transfer learning in peach orchard segmentation

Appearance quality classification method of Huangguan pear under complex background based on instance segmentation and semantic segmentation

Apple Fruit Edge Detection Model Using a Rough Set and Convolutional Neural Network

Labour-saving Detection of Hybrid Rice Rows at the Pollination Stage Based on a Multi-Perturbed Semi-Supervised Model

Fruit Detection, Segmentation and 3D Visualisation of Environments in Apple Orchards

Apple inflorescence recognition of phenology stage in complex background based on improved YOLOv7

Real-time Fruit Detection Method Based on RGB-D Image Fusion

Apple detection and instance segmentation in natural environments using an improved Mask Scoring R-CNN Model

PD-SegNet: Semantic Segmentation of Small Agricultural Targets in Complex Environments

ResDense-focal-DeepLabV3+ enabled litchi branch semantic segmentation for robotic harvesting

Efficient Semantic Segmentation for Large-Scale Agricultural Nursery Managements via Point Cloud-Based Neural Network

SE-COTR: A Novel Fruit Segmentation Model for Green Apples Application in Complex Orchard

CRLNet: A Multimodal Peach Detection Network Based on Cooperative Asymptotic Enhancement and the Fusion of Granularity Refinement