Abstract:Accurate segmentation of apple fruit under natural illumination conditions provides benefits for growers to plan relevant applications of nutrients and pesticides. It also plays an important role for monitoring the growth status of the fruit. However, the segmentation of apples throughout various growth stages had only achieved a limited success so far due to the color changes of apple fruit as it matures as well as occlusion and the non-uniform background of apple images acquired in an orchard environment. To achieve the segmentation of apples with different colors and with various illumination conditions for the whole growth stage, a segmentation method independent of color was investigated. Features, including saliency and contour of the image, were combined in this algorithm to remove background and extract apples. Saliency using natural statistics (SUN) visual attention model was used for background removal and it was combined with threshold segmentation algorithm to extract salient binary region of apple images. The centroids of the obtained salient binary region were then extracted as initial seed points. Image sharpening, globalized probability of boundary-oriented watershed transform-ultrametric contour map (gPb-OWT-UCM) and Otsu algorithms were applied to detect saliency contours of images. With the built seed points and extracted saliency contours, a region growing algorithm was performed to accurately segment apples by retaining as many fruit pixels and removing as many background pixels as possible. A total of 556 apple images captured in natural conditions were used to evaluate the effectiveness of the proposed method. An average segmentation error ( SE ), false positive rate ( FPR ), false negative rate ( FNR ) and overlap Index ( OI ) of 8.4, 0.8, 7.5 and 90.5% respectively, were achieved and the performance of the proposed method outperformed other six methods in comparison. The method developed in this study can provide a more effective way to segment apples with green, red, and partially red colors without changing any features and parameters and therefore it is also applicable for monitoring the growth status of apples.

Detection of Green Apples in Natural Scenes Based on Saliency Theory and Gaussian Curve Fitting

Recognition of green apples in an orchard environment by combining the GrabCut model and Ncut algorithm

Detection of Young Green Apples for Fruit Robot in Natural Scene

Combining an information-maximization-based attention mechanism and illumination invariance theory for the recognition of green apples in natural scenes

Detection Of Young Green Apples In Orchard Environment Using Adaptive Ratio Chromatic Aberration And Hog-Svm

Combining SUN-based Visual Attention Model and Saliency Contour Detection Algorithm for Apple Image Segmentation

Recognition of Green Apples Based on Fuzzy Set Theory and Manifold Ranking Algorithm

Segmentation Method of Apple Image Based on GaussAdaptive Curve Fitting

Recognition and Localization of Apples Based on Super-red Image and Contour Curvature

A Method of Apple Image Segmentation Based on Color-Texture Fusion Feature and Machine Learning

Detection of Double Overlapped Fruits in Natural Scene for Apple Operation Robot

Ripe Fuji Apple Detection Model Analysis in Natural Tree Canopy

Efficient Saliency Detection Based on Gaussian Models

Fast Location and Recognition of Green Apple Based on RGB-D Image

A Method of Segmenting Apples Based on Gray-Centered RGB Color Space

Segmentation on Ripe Fuji Apple with Fuzzy 2d Entropy Based on 2d Histogram and Ga Optimization

Recognition and localization method of occluded apples based on K-means clustering segmentation algorithm and convex hull theory

Immature Green Apple Detection and Sizing in Commercial Orchards Using YOLOv8 and Shape Fitting Techniques

A Segmentation Method of Bagged Green Apple Image

Using colour features of cv. ‘Gala’ apple fruits in an orchard in image processing to predict yield

Apple Detection From Apple Tree Image Based On Bp Neural Network And Hough Transform