Abstract:Animal dimensions are essential indicators for monitoring their growth rate, diet efficiency, and health status. A computer vision system is a recently emerging precision livestock farming technology that overcomes the previously unresolved challenges pertaining to labor and cost. Depth sensor cameras can be used to estimate the depth or height of an animal, in addition to two-dimensional information. Collecting top-view depth images is common in evaluating body mass or conformational traits in livestock species. However, in the depth image data acquisition process, manual interventions are involved in controlling a camera from a laptop or where detailed steps for automated data collection are not documented. Furthermore, open-source image data acquisition implementations are rarely available. The objective of this study was to 1) investigate the utility of automated top-view dairy cow depth data collection methods using picture- and video-based methods, 2) evaluate the performance of an infrared cut lens, 3) and make the source code available. Both methods can automatically perform animal detection, trigger recording, capture depth data, and terminate recording for individual animals. The picture-based method takes only a predetermined number of images whereas the video-based method uses a sequence of frames as a video. For the picture-based method, we evaluated 3- and 10-picture approaches. The depth sensor camera was mounted 2.75 m above-the-ground over a walk-through scale between the milking parlor and the free-stall barn. A total of 150 Holstein and 100 Jersey cows were evaluated. A pixel location where the depth was monitored was set up as a point of interest. More than 89% of cows were successfully captured using both picture- and video-based methods. The success rates of the picture- and video-based methods further improved to 92% and 98%, respectively, when combined with an infrared cut lens. Although both the picture-based method with 10 pictures and the video-based method yielded accurate results for collecting depth data on cows, the former was more efficient in terms of data storage. The current study demonstrates automated depth data collection frameworks and a Python implementation available to the community, which can help facilitate the deployment of computer vision systems for dairy cows.

Teat Pose Estimation via RGBD Segmentation for Automated Milking

A Stereo-Vision System for 3D Position Recognition of Cow Teats on Robot Milking System

Automatic Teat Detection for Rotary Milking System Based on Deep Learning Algorithms

Automated acquisition of top-view dairy cow depth image data using an RGB-D sensor camera

RGB-D-Based Pose Estimation of Workpieces with Semantic Segmentation and Point Cloud Registration

Biometric Physiological Responses from Dairy Cows Measured by Visible Remote Sensing Are Good Predictors of Milk Productivity and Quality through Artificial Intelligence

Learning metric volume estimation of fruits and vegetables from short monocular video sequences

RGB-D Image Instance Segmentation Based On Seeded Region Growing Algorithm

2-D/3-D Fusion-Based Robust Pose Normalisation of 3-D Livestock from Multiple RGB-D Cameras

Extracting Cow Point Clouds from Multi-View RGB Images with an Improved YOLACT++ Instance Segmentation.

RGB Matters: Learning 7-DoF Grasp Poses on Monocular RGBD Images

Extraction of key regions of beef cattle based on bidirectional tomographic slice features from point cloud data

Pose estimation and bin picking for deformable products

Semantic keypoint extraction for scanned animals using multi-depth-camera systems

The development of a pneumatic robot for attaching a milking machine to a cow

Mushroom Detection and Three Dimensional Pose Estimation from Multi-View Point Clouds

Automated Measurement of Dairy Cows Body Size Via 3D Point Cloud Data Analysis

RGB-D Instance Segmentation-based Suction Point Detection for Grasping

Automated Measurement of Cattle Dimensions Using Improved Keypoint Detection Combined with Unilateral Depth Imaging

AI-Based Teat Shape and Skin Condition Prediction for Dairy Management

Pose Estimation of a Cobot Implemented on a Small AI-Powered Computing System and a Stereo Camera for Precision Evaluation