Abstract:Accurate segmentation of apple fruit under natural illumination conditions provides benefits for growers to plan relevant applications of nutrients and pesticides. It also plays an important role for monitoring the growth status of the fruit. However, the segmentation of apples throughout various growth stages had only achieved a limited success so far due to the color changes of apple fruit as it matures as well as occlusion and the non-uniform background of apple images acquired in an orchard environment. To achieve the segmentation of apples with different colors and with various illumination conditions for the whole growth stage, a segmentation method independent of color was investigated. Features, including saliency and contour of the image, were combined in this algorithm to remove background and extract apples. Saliency using natural statistics (SUN) visual attention model was used for background removal and it was combined with threshold segmentation algorithm to extract salient binary region of apple images. The centroids of the obtained salient binary region were then extracted as initial seed points. Image sharpening, globalized probability of boundary-oriented watershed transform-ultrametric contour map (gPb-OWT-UCM) and Otsu algorithms were applied to detect saliency contours of images. With the built seed points and extracted saliency contours, a region growing algorithm was performed to accurately segment apples by retaining as many fruit pixels and removing as many background pixels as possible. A total of 556 apple images captured in natural conditions were used to evaluate the effectiveness of the proposed method. An average segmentation error ( SE ), false positive rate ( FPR ), false negative rate ( FNR ) and overlap Index ( OI ) of 8.4, 0.8, 7.5 and 90.5% respectively, were achieved and the performance of the proposed method outperformed other six methods in comparison. The method developed in this study can provide a more effective way to segment apples with green, red, and partially red colors without changing any features and parameters and therefore it is also applicable for monitoring the growth status of apples.

Correction Algorithm of Illumination Nonuniformity on Fruit Surface and Defects Extraction Using Single Threshold Value

Automatic Detection of Common Surface Defects on Oranges Using Combined Lighting Transform and Image Ratio Methods

Background and External Defects Segmentation of Navel Orange Based on Mask and Edge Gray Value Compensation Algorithm

Computer Vision Detection of Surface Defect on Oranges by Means of A Sliding Comparison Window Local Segmentation Algorithm

Background Segmentation and Object Extraction of Apples Images

Enhancing Fruit SSC Detection Accuracy Via a Light Attenuation Theory-Based Correction Method to Mitigate Measurement Orientation Variability

Image Matching Algorithm of Defects on Navel Orange Surface Based on Compressed Sensing

Embedded Vision Detection of Defective Orange by Fast Adaptive Lightness Correction Algorithm.

Detection of Common Defects on Mandarins by Using Visible and Near Infrared Hyperspectral Imaging

Computer Vision Detection of Defective Apples Using Automatic Lightness Correction and Weighted Rvm Classifier

An Image Recognition and Detection Algorithm for Defect, Stem and Calyx of Fruit Surface

Identification of Common Skin Defects and Classification of Early Decayed Citrus Using Hyperspectral Imaging Technique

A Method for Surface Defects Detection in Kiwi Fruit Classification

Color Model for Fruit Quality Inspection with Machine Vision

Research on Target Extraction Technology of Fruit and Vegetable Images in the Complex Environment.

Citrus Fruit Recognition Using Color Image Analysis

Apple Surface Defect Detection Based on Gray Level Co-Occurrence Matrix and Retinex Image Enhancement

Immature Green Citrus Fruit Detection and Counting Based on Fast Normalized Cross Correlation (FNCC) Using Natural Outdoor Colour Images

Combining SUN-based Visual Attention Model and Saliency Contour Detection Algorithm for Apple Image Segmentation

Application of Machine Vision in Identifying Size And Surface Defect of Huanghua Pear

Hyperspectral Imaging Combined with Multivariate Analysis and Band Math for Detection of Common Defects on Peaches (prunus Persica)