Abstract:Image/video processing for fruit detection in the tree using hard-coded feature extraction algorithms has shown high accuracy on fruit detection during recent years. While accurate, these approaches even with high-end hardware are still computationally intensive and too slow for real-time systems. This paper details the use of deep convolution neural networks architecture based on single-stage detectors. Using deep-learning techniques eliminates the need for hard-code specific features for specific fruit shapes, color and/or other attributes. This architecture takes the input image and divides into AxA grid, where A is a configurable hyper-parameter that defines the fineness of the grid. To each grid cell an image detection and localization algorithm is applied. Each of those cells is responsible to predict bounding boxes and confidence score for fruit (apple and pear in the case of this study) detected in that cell. We want this confidence score to be high if a fruit exists in a cell, otherwise to be zero, if no fruit is in the cell. More than 100 images of apple and pear trees were taken. Each tree image with approximately 50 fruits, that at the end resulted on more than 5000 images of apple and pear fruits each. Labeling images for training consisted on manually specifying the bounding boxes for fruits, where (x, y) are the center coordinates of the box and (w, h) are width and height. This architecture showed an accuracy of more than 90% fruit detection. Based on correlation between number of visible fruits, detected fruits on one frame and the real number of fruits on one tree, a model was created to accommodate this error rate. Processing speed is higher than 20 FPS which is fast enough for any grasping/harvesting robotic arm or other real-time applications.HIGHLIGHTSUsing new convolutional deep learning techniques based on single-shot detectors to detect and count fruits (apple and pear) within the tree canopy.

Fruits Recognition using Deep Convolutional Neural Network for Low Computing Device

Detection of Strawberry Flowers in Outdoor Field by Deep Neural Network

DeepFruits: A Fruit Detection System Using Deep Neural Networks

Implementation of Fruits Recognition Classifier using Convolutional Neural Network Algorithm for Observation of Accuracies for Various Hidden Layers

Fruit Classification System with Deep Learning and Neural Architecture Search

Deep Learning-Based Fruit Recognition and Quality Assessment: A Convolutional Neural Network Approach

Fruit Image Classification Based on MobileNetV2 with Transfer Learning Technique

Fruit classification using attention-based MobileNetV2 for industrial applications

Apple Ripeness Identification Using Deep Learning

Fruit Detection from Digital Images Using CenterNet

Fruit Detection and Three-Stage Maturity Grading Using CNN

Fruit Quality Assessment with Densely Connected Convolutional Neural Network

DGCC-Fruit: a lightweight fine-grained fruit recognition network

Fruit recognition from images using deep learning applications

Single-Shot Convolution Neural Networks for Real-Time Fruit Detection Within the Tree

Research on Apple Recognition Algorithm in Complex Orchard Environment Based on Deep Learning

A Review of Convolutional Neural Network Applied to Fruit Image Processing

Fruit Image Classification Model Based on MobileNetV2 with Deep Transfer Learning Technique

Fruit Tree Disease Recognition Based on Residual Neural Network and Attention Mechanism

L-Net: A lightweight convolutional neural network for devices with low computing power

Deep neural network based fruit identification and grading system for precision agriculture