Abstract:Automatic fruit picking is a challenging problem in robotics with a wide application field. A prerequisite for realization of a robotic fruit picker is its ability to detect fruits in tree tops. An expert system, which would be able to compete with human perception, must be capable of recognizing fruits among leaves and branches under uncontrolled conditions, where fruits are occluded and shaded. In this paper, a novel approach for fruit recognition in RGB-D images based on detection and classification of convex surfaces is proposed. The input RGB-D image is first segmented into convex surfaces by a region growing procedure. Each convex surface is then described by an appropriate descriptor and classified with the aid of the associated descriptor. A novel descriptor of approximately convex surfaces is proposed, which we named Convex Template Instance (CTI) descriptor. It is based on approximating surfaces by convex polyhedrons with quantized face orientations, where every polyhedron face corresponds to one descriptor component. Computation of the proposed descriptor is simple and can be performed very efficiently. The proposed CTI descriptor is compared to the SHOT descriptor, a standard descriptor for 3D point clouds. Two variants of the both CTI and SHOT descriptor are evaluated, a variant which uses color and a variant which does not. A k-nearest neighbor classifier is used to classify detected surfaces into two classes: fruit and other. The main advantage of the proposed expert system in comparison to other fruit recognition solutions is its computational efficiency, which is of great importance for its target application – an automatic fruit picker. The proposed approach is evaluated using a challenging dataset containing RGB-D images of four fruit sorts acquired under uncontrolled conditions, which has been made publicly available to the scientific community, allowing benchmarking of novel fruit recognition methods.

A New Algorithm For Fruit Shape Classification Based On Level Set

Fruit Shape Detection by Level Set

Fruit Shape Detection Based on Multi-scale Level Set Framework

Fruit Shape Classification Using Support Vector Machine

A Novel Fruit Shape Classification Method Based on Multi-Scale Analysis

A novel segmentation algorithm for clustered flexional agricultural products based on image analysis.

Application of Machine Vision in Inspecting Stem and Shape of Fruits

Image Detection of Peach Diseases and Pests

Fruit Shape Classification Based on Zernike Moments

Research on Description of Fruit Shape Based on Machine Vision

Fruit detection in natural environment using partial shape matching and probabilistic Hough transform

A novel algorithm for segmenting fruit from unorganized point clouds

An Active Structured Light 3D Point Cloud Measurement for Orange Shape Based On Adaptive Co-Opposite-Direction Slicing Method

Apple, peach, and pear flower detection using semantic segmentation network and shape constraint level set

Identification of fruit using a flexible tactile sensor array

Fruit Detection from Digital Images Using CenterNet

Symmetry-based 3D shape completion for fruit localisation for harvesting robots

Tests Of A Recognition Algorithm For Clustered Tomatoes Based On Mathematical Morphology

Three-dimensional reconstruction of guava fruits and branches using instance segmentation and geometry analysis

A nearest neighbor approach for fruit recognition in RGB-D images based on detection of convex surfaces

Fruits Stem Inspection with Computer Vision