Abstract:Automatic estimation of the poses of dairy cows over a long period can provide relevant information regarding their status and well-being in precision farming. Due to appearance similarity, cow pose estimation is challenging. To monitor the health of dairy cows in actual farm environments, a multicow pose estimation algorithm was proposed in this study. First, a monitoring system was established at a dairy cow breeding site, and 175 surveillance videos of 10 different cows were used as raw data to construct object detection and pose estimation data sets. To achieve the detection of multiple cows, the You Only Look Once (YOLO)v4 model based on CSPDarkNet53 was built and fine-tuned to output the bounding box for further pose estimation. On the test set of 400 images including single and multiple cows throughout the whole day, the average precision (AP) reached 94.58%. Second, the keypoint heatmaps and part affinity field (PAF) were extracted to match the keypoints of the same cow based on the real-time multiperson 2D pose detection model. To verify the performance of the algorithm, 200 single-object images and 200 dual-object images with occlusions were tested under different light conditions. The test results showed that the AP of leg keypoints was the highest, reaching 91.6%, regardless of day or night and single cows or double cows. This was followed by the AP values of the back, neck and head, sequentially. The AP of single cow pose estimation was 85% during the day and 78.1% at night, compared to double cows with occlusion, for which the values were 74.3% and 71.6%, respectively. The keypoint detection rate decreased when the occlusion was severe. However, in actual cow breeding sites, cows are seldom strongly occluded. Finally, a pose classification network was built to estimate the three typical poses (standing, walking and lying) of cows based on the extracted cow skeleton in the bounding box, achieving precision of 91.67%, 92.97% and 99.23%, respectively. The results showed that the algorithm proposed in this study exhibited a relatively high detection rate. Therefore, the proposed method can provide a theoretical reference for animal pose estimation in large-scale precision livestock farming.

Deep Multi-task Learning for Animal Chest Circumference Estimation from Monocular Images

Automatic livestock body measurement based on keypoint detection with multiple depth cameras

Deep learning-based multi-cattle tracking in crowded livestock farming using video

Automatic Estimation of Dairy Cattle Body Condition Score from Depth Image Using Ensemble Model

MultiCamCows2024 -- A Multi-view Image Dataset for AI-driven Holstein-Friesian Cattle Re-Identification on a Working Farm

Automated Measurement of Cattle Dimensions Using Improved Keypoint Detection Combined with Unilateral Depth Imaging

Universal Bovine Identification via Depth Data and Deep Metric Learning

Double-Camera Fusion System for Animal-Position Awareness in Farming Pens

Human Pose Estimation from Depth Images via Inference Embedded Multi-task Learning

Body Dimension Measurements of Qinchuan Cattle with Transfer Learning from LiDAR Sensing

Multi-animal pose estimation, identification and tracking with DeepLabCut

Multi-Task Image-Based Dietary Assessment for Food Recognition and Portion Size Estimation

A Multi-Stage Framework for Joint Chest X-Ray Diagnosis and Visual Attention Prediction Using Deep Learning

Depth video data-enabled predictions of longitudinal dairy cow body weight using thresholding and Mask R-CNN algorithms

Individual Cattle Identification Using a Deep Learning Based Framework

A multi-target cow face detection model in complex scenes

Multi-Center Agent Loss for Visual Identification of Chinese Simmental in the Wild

Multicow pose estimation based on keypoint extraction

A Multi-Objective Segmentation Method for Chest X-rays Based on Collaborative Learning from Multiple Partially Annotated Datasets

Evaluation of Deep Learning for Automatic Multi-View Face Detection in Cattle