Abstract:Accurate crop-load estimation is very important for efficient management of nutrients and harvest operations. Current machine vision techniques for crop-load estimation have achieved only limited success mostly due to partial occlusion, shape irregularity, varying illumination and multiple sizes. Detecting immature green fruit is a more challenging task for similar color of fruit and background. The key starting point of this paper for detecting immature citrus fruit was the observation that the light distribution on citrus fruit follows a general pattern in which the light intensity decreases with the distance from a local maximum due to specular reflection. Immature citrus fruit detection was achieved by detecting this pattern with concentric circles or parts of circles. This pattern was proposed with the maximally stable extremal region (MSER) method and validated by hierarchical contour analysis (HCA) which was the first proposed in this paper. The images were captured by a color camera under low natural light conditions with a flashlight, and the green component of the color images was used for further analysis. After smoothing the whole image by Weiner filter, the regions of interest (ROIs) in the image were extracted by the method of MSER. The ROIs detected by MSER were those whose support was nearly the same over a range of thresholds, so the regions on citrus fruit were detected by MSER for the pattern that the light intensity decreases stably and gently with the distance from a local maximum. However, many regions on leaves and background were also detected as ROIs and should be excluded in the next step. A novel algorithmic technique was proposed to remove these regions on background, and this method was named as the HCA. Firstly, shape analysis was used for each ROI and only those ROIs were considered as valid if the shape was nearly circular. Secondly, multiple levels of contours around each valid ROI were extracted and fitted with the circular Hough transform (CHT). Lastly, multiple fitted circles would be merged into one if their most parts were overlapped together, this step was called circle merging and the merged circles were considered as the last detected citrus fruits. The algorithm was tested on a testing dataset with 20 images and achieved the recall rate of 81.2% and the precision rate of 83.5%. The processing time of the proposed method was 3.70 s totally on each image, on average, in which 0.57 s was used for MSER detection and 3.13 s was used for HCA. The result showed that the proposed method can detect green citrus fruit in a very difficult and challenging scene with so many fruits in one image and extensive partial occlusion. The good performance of partial occlusion tolerance of the proposed method in this paper is mainly due to that the proposed HCA doesn't use the shape of outer contour of fruit, but uses multiple concentric contours which come from the pattern of light intensity distribution on fruit surface. The research framework in this paper can give a novel thought on other green fruit detection besides citrus fruit.

Noninvasive Maturity Detection of Citrus with Machine Vision

Non-invasive maturity detection of citrus with computer vision

Non-Destructive Maturity Evaluation of Citrus by Hue Frequency Sequence Method

Application of Visible/Near-Infrared Spectroscopy Combined with Machine Vision Technique to Evaluate the Ripeness of Melons ( Cucumis melo L.)

Immature Green Citrus Detection by Multiple Features Using Machine Vision

Maturity Identification for Citrus based on BP Neural Network Algorithm

Feature Extraction of Hyperspectral Images for Detecting Immature Green Citrus Fruit

Navel Orange Maturity Classification by Multispectral Indexes Based on Hyperspectral Diffuse Transmittance Imaging

Identification of Common Skin Defects and Classification of Early Decayed Citrus Using Hyperspectral Imaging Technique

Immature Citrus Fruit Detection Based on Local Binary Pattern Feature and Hierarchical Contour Analysis

Analysis and Recognition Based on Citrus Color Grading Model considering Computer Vision Technology

Detection of orchard citrus fruits using a monocular machine vision-based method for automatic fruit picking applications

Immature Green Citrus Fruit Detection and Counting Based on Fast Normalized Cross Correlation (FNCC) Using Natural Outdoor Colour Images

Detecting green citrus fruit on trees in low light and complex background based on MSER and HCA

Immature green citrus detection based on colour feature and sum of absolute transformed difference (SATD) using colour images in the citrus grove

Rapid Detection of Surface Color of Shatian Pomelo Using Vis-NIR Spectrometry for the Identification of Maturity

Citrus Fruit Recognition Using Color Image Analysis

Rapid Identification of Apple Maturity Based on Multispectral Sensor Combined with Spectral Shape Features

Mangosteen Grading Based on Computer Vision

Automatic Detection of Common Surface Defects on Oranges Using Combined Lighting Transform and Image Ratio Methods

A Novel Detection Method of Citrus Fruit with Glare Within a Tree Canopy