Development and Optimization of a Deep-Learning-Based Egg-Collecting Robot
Guoming Li,Gary D. Chesser,Yanbo Huang,Yang Zhao,Joseph L. Purswell
DOI: https://doi.org/10.13031/trans.14642
2021-01-01
Transactions of the ASABE
Abstract:Highlights An egg-collecting robot embedded with deep-learning-based computer vision algorithms was constructed. The retrained deep-learning detector achieved >93% performance for detecting and locating eggs in images. The kernel sizes of 65 × 65 pixels for erosion and dilation in image processing assisted in extracting geometry features of eggs with the least remaining noises. The robot with soft grouting sponge on the gripper had 92% to 94% success in picking white and brown eggs. Abstract . Manual collection of floor eggs in cage-free hen housing systems is time-consuming and laborious. The objectives of this study were to (1) develop a robot to automatically collect floor eggs and (2) optimize the performance of recognizing and picking eggs with the robot. The robot consisted of a deep-learning-based egg detector, a robot arm, a two-finger gripper, and a hand-mounted camera. The deep-learning model, You Only Look Once (YOLO) V3, was embedded in the vision system to detect and locate eggs on a simulated litter floor in real-time. Image processing algorithms (e.g., cropping, erosion, etc.) were implemented for the detection and provided the robot with centroid coordinates, orientation, and axis lengths of the detected eggs, so that the gripper could be manipulated with an appropriate angle and opening width to grasp the detected eggs. For optimization, the YOLO V3 model was retrained with a dataset of floor eggs and achieved >93% performance in detecting and locating eggs. The kernel size of 65 × 65 pixels for erosion and dilation in image processing assisted in extracting the geometry features of eggs with the least remaining noises. Among the tested materials, soft grouting sponge attached to the gripper had the highest success rates for egg picking. The robot achieved 92% to 94% success in picking white and brown eggs. In sum, the developed egg-collecting robot can be relied on for picking floor eggs to assist in precision management of cage-free hen housing systems. Keywords: Floor egg, Image processing, Laying hen, Robot arm, Soft gripper, YOLO V3.
agricultural engineering