Abstract:Highlights An egg-collecting robot embedded with deep-learning-based computer vision algorithms was constructed. The retrained deep-learning detector achieved >93% performance for detecting and locating eggs in images. The kernel sizes of 65 × 65 pixels for erosion and dilation in image processing assisted in extracting geometry features of eggs with the least remaining noises. The robot with soft grouting sponge on the gripper had 92% to 94% success in picking white and brown eggs. Abstract . Manual collection of floor eggs in cage-free hen housing systems is time-consuming and laborious. The objectives of this study were to (1) develop a robot to automatically collect floor eggs and (2) optimize the performance of recognizing and picking eggs with the robot. The robot consisted of a deep-learning-based egg detector, a robot arm, a two-finger gripper, and a hand-mounted camera. The deep-learning model, You Only Look Once (YOLO) V3, was embedded in the vision system to detect and locate eggs on a simulated litter floor in real-time. Image processing algorithms (e.g., cropping, erosion, etc.) were implemented for the detection and provided the robot with centroid coordinates, orientation, and axis lengths of the detected eggs, so that the gripper could be manipulated with an appropriate angle and opening width to grasp the detected eggs. For optimization, the YOLO V3 model was retrained with a dataset of floor eggs and achieved >93% performance in detecting and locating eggs. The kernel size of 65 × 65 pixels for erosion and dilation in image processing assisted in extracting the geometry features of eggs with the least remaining noises. Among the tested materials, soft grouting sponge attached to the gripper had the highest success rates for egg picking. The robot achieved 92% to 94% success in picking white and brown eggs. In sum, the developed egg-collecting robot can be relied on for picking floor eggs to assist in precision management of cage-free hen housing systems. Keywords: Floor egg, Image processing, Laying hen, Robot arm, Soft gripper, YOLO V3.

Egg Volume Estimation Based on Image Processing and Computer Vision

Image Classification of Chicken Embryo Based on Matched Filter and Skeleton Curvature Feature

A Novel Method for Measuring the Volume and Surface Area of Egg

A Computer Vision-Based Automatic System for Egg Grading and Defect Detection

Egg Weight Detection on Machine Vision System

Online chicken carcass volume estimation using depth imaging and 3-D reconstruction

Egg Freshness on-Line Estimation Using Machine Vision and Dynamic Weighing

Eggshell Biometrics for Individual Egg Identification Based on Convolutional Neural Networks.

Detection of Double-yolk Eggs Based on Computer Vision

A Multi-Flow Production Line for Sorting of Eggs Using Image Processing

Weight and volume estimation of single and occluded tomatoes using machine vision

Computer Vision Technology and the Development of Its Application to Detection of Egg Quality

Study on Image Processiong Technology in Egg Quality Detection System

K-Means Segmentation Based-on Lab Color Space for Embryo Detection in Incubated Egg

Development and Optimization of a Deep-Learning-Based Egg-Collecting Robot

Study on the Model of Egg Weight Detecting Based on its Geometry

Non destructive detection of egg freshness based on computer vision

An automatic sorting system for unwashed eggs using deep learning

A Machine Vision System for Identification of Micro-Crack in Egg Shell

Study on egg sorting model based on visible-near infrared spectroscopy

Visual detection of eggs based on deep learning for egg picking robot