Abstract:In the planting environment, it is difficult to detect the ripe mulberry targets automatically by machine vision because of the small shape, irregular distribution of fruits, non-uniformly illuminating condition and complex background interference. This paper presents a visual segmentation approach of ripe mulberries based on frequency-tuned (FT) saliency map and the pulse coupled neural network (PCNN) model in order to improve the segmentation precision and robustness for ripe mulberries. Firstly, the captured mulberry image is transformed into Lab color space. This color space is designed by the perception of the human eye in the natural color. Consequently, the color feature of the target can be expressed by 3 independent components i.e.L,a, andb. Next, the FT saliency map of mulberries can be computed by a multiscale edge detector. And it typically distinguishes differences between the region of ripe mulberries and the complex background in Lab color space. This saliency is illustrated as the difference matrix which includes the Euclidean distance of each pixel between the Lab vectors in the Gaussian filtered image and the average Lab vectors in the original image. Thereafter, the hue feature is extracted from the HSI (hue, saturation, intensity) color space of the captured mulberry image, and then equalized by contrast limited adaptive histogram equalization (CLAHE), which can enhance the color contrast of the mulberry image without being affected by illumination changes. And the feature image of mulberries is generated by fusing the FT saliency and the hue feature, as an input of the improved multilevel threshold PCNN model. Furthermore, the region of ripe mulberries can be detected by this PCNN model, which is a bio-inspired neural network and derived from synchronous dynamics of neuronal activity in a mammal visual cortex. This model is able to cause the adjacent neurons with similar inputs to pulse synchronously, and be appropriate to segment the small target from the complex background. Finally, the segmentation result of the ripe mulberry is acquired by morphology repair operation, and it ensures the integrity of the target region and the independent noise removal. In order to verify the effect of the method proposed in this paper, there were 200 test images captured from the mulberry ecological park of the Tianfu Town, Chongqing City, China in May, 2016. The acquisition time was often on sunny day and cloudy day, aiming at obtaining images under different lighting conditions, such as balanced illumination, imbalanced illumination and backlight. These images were collected by the Canon EOS70D digital camera with 3648×5472 pixels, and zoomed into 720×1280 pixels to apply to the remote intelligent monitoring system of mulberry growth. The algorithm programming development platform is Visual C++ 2015. The experimental results point out that the average misclassification error (ME) by our method is only 1.87%, infinitely superior to the OTSU method with FT saliency (17.73%), theK-means method (10.69%), the improved multilevel threshold PCNN method based on Itti saliency map (7.34%), and the PCNN method based on graph-based visual saliency (GBVS) image (5.83%). The average segmentation time of a test image based on our method is 2.5623 s. Consequently, our approach is effective to segment the ripe mulberries in the complicated background and different lighting conditions.

Image segmentation of ripe mulberries based on visual saliency and pulse coupled neural network

Computer Vision-Based Localisation of Picking Points for Automatic Litchi Harvesting Applications Towards Natural Scenarios

Nondestructive Determination of TSS Content in Postharvest Mulberry Fruits Using Hyperspectral Imaging and Deep Learning

A fine recognition method of strawberry ripeness combining Mask R-CNN and region segmentation

Recognition Method for Apple Fruit Based on SUSAN and PCNN

An Image Segmentation Algorithm Based on Double-Layer Pulse-Coupled Neural Network Model for Kiwifruit Detection

Combining SUN-based Visual Attention Model and Saliency Contour Detection Algorithm for Apple Image Segmentation

Deep learning image segmentation and extraction of blueberry fruit traits associated with harvestability and yield

Automatic Pear Extraction from High-Resolution Images by a Visual Attention Mechanism Network.

Image Segmentation and Maturity Recognition Algorithm Based on Color Features of Lingwu Long Jujube

Research on Bayberry Image Segmentation Method in Natural Environment

A Real-Time Detection Algorithm for Sweet Cherry Fruit Maturity Based on YOLOX in the Natural Environment

Instance Segmentation and Number Counting of Grape Berry Images Based on Deep Learning

A Deep Learning-Based Web Application for Segmentation and Quantification of Blueberry Internal Bruising.

Instance Segmentation and Localization of Strawberries in Farm Conditions for Automatic Fruit Harvesting

Recognition of green apples in an orchard environment by combining the GrabCut model and Ncut algorithm

Detecting green citrus fruit on trees in low light and complex background based on MSER and HCA

Recognising Blueberry Fruit of Different Maturity Using Histogram Oriented Gradients and Colour Features in Outdoor Scenes

Immature Citrus Fruit Detection Based on Local Binary Pattern Feature and Hierarchical Contour Analysis

Citrus Tree Segmentation from UAV Images Based on Monocular Machine Vision in a Natural Orchard Environment

A Method of Apple Image Segmentation Based on Color-Texture Fusion Feature and Machine Learning