Abstract:Accurate segmentation of apple fruit under natural illumination conditions provides benefits for growers to plan relevant applications of nutrients and pesticides. It also plays an important role for monitoring the growth status of the fruit. However, the segmentation of apples throughout various growth stages had only achieved a limited success so far due to the color changes of apple fruit as it matures as well as occlusion and the non-uniform background of apple images acquired in an orchard environment. To achieve the segmentation of apples with different colors and with various illumination conditions for the whole growth stage, a segmentation method independent of color was investigated. Features, including saliency and contour of the image, were combined in this algorithm to remove background and extract apples. Saliency using natural statistics (SUN) visual attention model was used for background removal and it was combined with threshold segmentation algorithm to extract salient binary region of apple images. The centroids of the obtained salient binary region were then extracted as initial seed points. Image sharpening, globalized probability of boundary-oriented watershed transform-ultrametric contour map (gPb-OWT-UCM) and Otsu algorithms were applied to detect saliency contours of images. With the built seed points and extracted saliency contours, a region growing algorithm was performed to accurately segment apples by retaining as many fruit pixels and removing as many background pixels as possible. A total of 556 apple images captured in natural conditions were used to evaluate the effectiveness of the proposed method. An average segmentation error ( SE ), false positive rate ( FPR ), false negative rate ( FNR ) and overlap Index ( OI ) of 8.4, 0.8, 7.5 and 90.5% respectively, were achieved and the performance of the proposed method outperformed other six methods in comparison. The method developed in this study can provide a more effective way to segment apples with green, red, and partially red colors without changing any features and parameters and therefore it is also applicable for monitoring the growth status of apples.

An Adaptive Segmentation Method Combining MSRCR and Mean Shift Algorithm with K-means Correction of Green Apples in Natural Environment

Combining an information-maximization-based attention mechanism and illumination invariance theory for the recognition of green apples in natural scenes

Combining SUN-based Visual Attention Model and Saliency Contour Detection Algorithm for Apple Image Segmentation

A Method of Segmenting Apples Based on Gray-Centered RGB Color Space

Recognition of green apples in an orchard environment by combining the GrabCut model and Ncut algorithm

Multi-Feature Patch-Based Segmentation Technique in the Gray-Centered RGB Color Space for Improved Apple Target Recognition

A Method of Apple Image Segmentation Based on Color-Texture Fusion Feature and Machine Learning

Detection Of Young Green Apples In Orchard Environment Using Adaptive Ratio Chromatic Aberration And Hog-Svm

Segmentation of Foreground Apple Targets by Fusing Visual Attention Mechanism and Growth Rules of Seed Points

Application of Image Segmentation Algorithm Based on Entropy Clustering in Apple Harvesting Robot

Segmentation Method of Apple Image Based on GaussAdaptive Curve Fitting

Segmentation Algorithm for Green Apples Recognition Based on K-means Algorithm

Fusion of Mask RCNN and Attention Mechanism for Instance Segmentation of Apples under Complex Background

A Segmentation Method of Red Apple Image

Recognition and Localization of Apples Based on Super-red Image and Contour Curvature

A Segmentation Method of Bagged Green Apple Image

Recognition of Green Apples Based on Fuzzy Set Theory and Manifold Ranking Algorithm

An Apple Image Segmentation Method Based on a Color Index Obtained by a Genetic Algorithm

Fast Location and Recognition of Green Apple Based on RGB-D Image

Segmentation on Ripe Fuji Apple with Fuzzy 2d Entropy Based on 2d Histogram and Ga Optimization

Recognition and localization method of occluded apples based on K-means clustering segmentation algorithm and convex hull theory