Abstract:Accurate segmentation of apple fruit under natural illumination conditions provides benefits for growers to plan relevant applications of nutrients and pesticides. It also plays an important role for monitoring the growth status of the fruit. However, the segmentation of apples throughout various growth stages had only achieved a limited success so far due to the color changes of apple fruit as it matures as well as occlusion and the non-uniform background of apple images acquired in an orchard environment. To achieve the segmentation of apples with different colors and with various illumination conditions for the whole growth stage, a segmentation method independent of color was investigated. Features, including saliency and contour of the image, were combined in this algorithm to remove background and extract apples. Saliency using natural statistics (SUN) visual attention model was used for background removal and it was combined with threshold segmentation algorithm to extract salient binary region of apple images. The centroids of the obtained salient binary region were then extracted as initial seed points. Image sharpening, globalized probability of boundary-oriented watershed transform-ultrametric contour map (gPb-OWT-UCM) and Otsu algorithms were applied to detect saliency contours of images. With the built seed points and extracted saliency contours, a region growing algorithm was performed to accurately segment apples by retaining as many fruit pixels and removing as many background pixels as possible. A total of 556 apple images captured in natural conditions were used to evaluate the effectiveness of the proposed method. An average segmentation error ( SE ), false positive rate ( FPR ), false negative rate ( FNR ) and overlap Index ( OI ) of 8.4, 0.8, 7.5 and 90.5% respectively, were achieved and the performance of the proposed method outperformed other six methods in comparison. The method developed in this study can provide a more effective way to segment apples with green, red, and partially red colors without changing any features and parameters and therefore it is also applicable for monitoring the growth status of apples.

An Apple Image Segmentation Method Based on a Color Index Obtained by a Genetic Algorithm

Recognition and Localization Method of Overlapping Apples for Apple Harvesting Robot

A Method of Apple Image Segmentation Based on Color-Texture Fusion Feature and Machine Learning

A Method of Segmenting Apples Based on Gray-Centered RGB Color Space

Application of Image Segmentation Algorithm Based on Entropy Clustering in Apple Harvesting Robot

Combining SUN-based Visual Attention Model and Saliency Contour Detection Algorithm for Apple Image Segmentation

Multi-Feature Patch-Based Segmentation Technique in the Gray-Centered RGB Color Space for Improved Apple Target Recognition

Segmentation Method of Apple Image Based on GaussAdaptive Curve Fitting

Estimation Method of Apple Growing Attitude Based on Computer Vision

SEGMENTATION OF APPLE POINT CLOUDS BASED ON ROI IN RGB IMAGES

Segmentation of Foreground Apple Targets by Fusing Visual Attention Mechanism and Growth Rules of Seed Points

An Automatic Segmentation and Recognition Method of Apple Tree Point Clouds in the Real Scene Based on the Fusion of Color and 3D Feature

Background Segmentation and Object Extraction of Apples Images

Combining an information-maximization-based attention mechanism and illumination invariance theory for the recognition of green apples in natural scenes

Segmentation on Ripe Fuji Apple with Fuzzy 2d Entropy Based on 2d Histogram and Ga Optimization

A Segmentation Method of Bagged Green Apple Image

Study on the method of separating apple fruits based on limiting corrosiont

An Apple Recognition Method Based on Color Space

Fast Location and Recognition of Green Apple Based on RGB-D Image

Recognition of Apple Fruit in Natural Environment

Segmentation Algorithm for Green Apples Recognition Based on K-means Algorithm