Abstract:Fruit detection is a fundamental task for automatic yield estimation. The goal is to detect all the fruits in images. The-state of the art of fruit detection algorithm, Faster R-CNN, shows a lack of detection advantage on small fruits. One of the reasons is only that single-level features and a classifier are used for localization of proposal candidates. In this article, we propose to incorporate a multiple classifier fusion strategy into a Faster R-CNN network for small fruit detection. We utilize features from three different levels to learn three classifiers for objectness classification in the stage of proposal localization. Probabilities from classifiers are combined by a simple convolutional layer to generate final objectness classification for proposal candidates. During training, in order to train a model with strong generalization capability, we propose to use correlation coefficients to measure the diversity of multiple classifiers. A novel loss function with classifier correlation is introduced to train the region proposal network. We evaluate the proposed model on two data sets of small fruits. Extensive experiments show that the proposed model outperforms the state-of-the-art detectors for fruit detection. Note to Practitioners—This article was motivated by the problem of the detection of small fruits for yield estimation but it also applies to the detection of other small objects. Existing approaches to fruit detection experience difficulty in detecting small fruits and the overall detection accuracy suffers as a result. This article suggests a novel approach to detect fruits of all sizes by using a multiple classifier fusion strategy in the stage of fruit localization. In the learning of the classifiers, multilevel features of fruits are extracted. In addition, we achieve classifier diversity through the analysis of the correlation of classification probabilities. The diversity of classifiers also helps improve the performance of fruit localization. Using experiments on real fruit tree images, we show that the suggested approach is feasible on orange detection of various sites in different seasons. As a future work, we will integrate the suggested algorithm into a fruit yield estimation system and test it online.

DeepFruits: A Fruit Detection System Using Deep Neural Networks

Detection of Strawberry Flowers in Outdoor Field by Deep Neural Network

Single-Shot Convolution Neural Networks for Real-Time Fruit Detection Within the Tree

Fruit Detection from Digital Images Using CenterNet

Faster R-CNN for Multi-Class Fruit Detection Using a Robotic Vision System

Integrated detection of citrus fruits and branches using a convolutional neural network

Fruit Detection and Recognition Based on Deep Learning for Automatic Harvesting: An Overview and Review

Real-time Fruit Detection Method Based on RGB-D Image Fusion

A general purpose multi-fruit system for assessing the quality of fruits with the application of recurrent neural network

Fruit Classification System with Deep Learning and Neural Architecture Search

Improved Kiwifruit Detection Using Pre-Trained VGG16 with RGB and NIR Information Fusion

High-Quality Coarse-to-Fine Fruit Detector for Harvesting Robot in Open Environment

Multi-Task Cascaded Convolutional Networks Based Intelligent Fruit Detection for Designing Automated Robot.

Fruit Target Detection Method Based on Faster R-CNN

Multi-class Fruit-on-plant Detection for Apple in SNAP System Using Faster R-CNN

Faster R-CNN with Classifier Fusion for Automatic Detection of Small Fruits

Fruit Detection and Pose Estimation for Grape Cluster-Harvesting Robot Using Binocular Imagery Based on Deep Neural Networks

&lt;i&gt;Optimized Faster R-CNN for Fruit Detection of Strawberry Harvesting Robot&lt;/i&gt;

Kiwifruit Detection in Field Images Using Faster R-CNN with ZFNet

Fruit Detection Research Based on Near-Infrared Spectroscopy and Lightweight Neural Network

Fruit Detection, Segmentation and 3D Visualisation of Environments in Apple Orchards