Abstract:Accurate crop-load estimation is very important for efficient management of nutrients and harvest operations. Current machine vision techniques for crop-load estimation have achieved only limited success mostly due to partial occlusion, shape irregularity, varying illumination and multiple sizes. Detecting immature green fruit is a more challenging task for similar color of fruit and background. The key starting point of this paper for detecting immature citrus fruit was the observation that the light distribution on citrus fruit follows a general pattern in which the light intensity decreases with the distance from a local maximum due to specular reflection. Immature citrus fruit detection was achieved by detecting this pattern with concentric circles or parts of circles. This pattern was proposed with the maximally stable extremal region (MSER) method and validated by hierarchical contour analysis (HCA) which was the first proposed in this paper. The images were captured by a color camera under low natural light conditions with a flashlight, and the green component of the color images was used for further analysis. After smoothing the whole image by Weiner filter, the regions of interest (ROIs) in the image were extracted by the method of MSER. The ROIs detected by MSER were those whose support was nearly the same over a range of thresholds, so the regions on citrus fruit were detected by MSER for the pattern that the light intensity decreases stably and gently with the distance from a local maximum. However, many regions on leaves and background were also detected as ROIs and should be excluded in the next step. A novel algorithmic technique was proposed to remove these regions on background, and this method was named as the HCA. Firstly, shape analysis was used for each ROI and only those ROIs were considered as valid if the shape was nearly circular. Secondly, multiple levels of contours around each valid ROI were extracted and fitted with the circular Hough transform (CHT). Lastly, multiple fitted circles would be merged into one if their most parts were overlapped together, this step was called circle merging and the merged circles were considered as the last detected citrus fruits. The algorithm was tested on a testing dataset with 20 images and achieved the recall rate of 81.2% and the precision rate of 83.5%. The processing time of the proposed method was 3.70 s totally on each image, on average, in which 0.57 s was used for MSER detection and 3.13 s was used for HCA. The result showed that the proposed method can detect green citrus fruit in a very difficult and challenging scene with so many fruits in one image and extensive partial occlusion. The good performance of partial occlusion tolerance of the proposed method in this paper is mainly due to that the proposed HCA doesn't use the shape of outer contour of fruit, but uses multiple concentric contours which come from the pattern of light intensity distribution on fruit surface. The research framework in this paper can give a novel thought on other green fruit detection besides citrus fruit.

Immature Green Citrus Detection by Multiple Features Using Machine Vision

Computer Vision-Based Localisation of Picking Points for Automatic Litchi Harvesting Applications Towards Natural Scenarios

Immature Citrus Fruit Detection Based on Local Binary Pattern Feature and Hierarchical Contour Analysis

Immature Green Citrus Fruit Detection and Counting Based on Fast Normalized Cross Correlation (FNCC) Using Natural Outdoor Colour Images

Feature Extraction of Hyperspectral Images for Detecting Immature Green Citrus Fruit

Detecting green citrus fruit on trees in low light and complex background based on MSER and HCA

Noninvasive Maturity Detection of Citrus with Machine Vision

Non-invasive maturity detection of citrus with computer vision

Application of Visible/Near-Infrared Spectroscopy Combined with Machine Vision Technique to Evaluate the Ripeness of Melons ( Cucumis melo L.)

Detection and localization of citrus fruit based on improved You Only Look Once v5s and binocular vision in the orchard

Immature green citrus detection based on colour feature and sum of absolute transformed difference (SATD) using colour images in the citrus grove

Citrus Tree Segmentation from UAV Images Based on Monocular Machine Vision in a Natural Orchard Environment

Approach of Dynamic Tracking and Counting for Obscured Citrus in Smart Orchard Based on Machine Vision

Detection of orchard citrus fruits using a monocular machine vision-based method for automatic fruit picking applications

Deep-learning-based in-field citrus fruit detection and tracking

A Novel Detection Method of Citrus Fruit with Glare Within a Tree Canopy

Citrus Fruit Recognition Using Color Image Analysis

Detecting Citrus Fruits with Highlight on Tree Based on Fusion of Multi-Map

Analysis and Recognition Based on Citrus Color Grading Model considering Computer Vision Technology

Fruits hidden by green: an improved YOLOV8n for detection of young citrus in lush citrus trees

Green Citrus Detection and Counting in Orchards Based on YOLOv5-CS and AI Edge System