Abstract:Recent advancements in machine learning and deep learning have revolutionized various computer vision applications, including object detection, tracking, and classification. This research investigates the application of deep learning for cattle lameness detection in dairy farming. Our study employs image processing techniques and deep learning methods for cattle detection, tracking, and lameness classification. We utilize two powerful object detection algorithms: Mask-RCNN from Detectron2 and the popular YOLOv8. Their performance is compared to identify the most effective approach for this application. Bounding boxes are drawn around detected cattle to assign unique local IDs, enabling individual tracking and isolation throughout the video sequence. Additionally, mask regions generated by the chosen detection algorithm provide valuable data for feature extraction, which is crucial for subsequent lameness classification. The extracted cattle mask region values serve as the basis for feature extraction, capturing relevant information indicative of lameness. These features, combined with the local IDs assigned during tracking, are used to compute a lameness score for each cattle. We explore the efficacy of various established machine learning algorithms, such as Support Vector Machines (SVM), AdaBoost and so on, in analyzing the extracted lameness features. Evaluation of the proposed system was conducted across three key domains: detection, tracking, and lameness classification. Notably, the detection module employing Detectron2 achieved an impressive accuracy of 98.98%. Similarly, the tracking module attained a high accuracy of 99.50%. In lameness classification, AdaBoost emerged as the most effective algorithm, yielding the highest overall average accuracy (77.9%). Other established machine learning algorithms, including Decision Trees (DT), Support Vector Machines (SVM), and Random Forests, also demonstrated promising performance (DT: 75.32%, SVM: 75.20%, Random Forest: 74.9%). The presented approach demonstrates the successful implementation for cattle lameness detection. The proposed system has the potential to revolutionize dairy farm management by enabling early lameness detection and facilitating effective monitoring of cattle health. Our findings contribute valuable insights into the application of advanced computer vision methods for livestock health management.

Cattle Detection Occlusion Problem

Mask YOLOv7-Based Drone Vision System for Automated Cattle Detection and Counting

Cattle body detection based on YOLOv5-ASFF for precision livestock farming

Automatic Cattle Identification using YOLOv5 and Mosaic Augmentation: A Comparative Analysis

Research on Cattle Behavior Recognition and Multi-Object Tracking Algorithm Based on YOLO-BoT

Deep learning-based multi-cattle tracking in crowded livestock farming using video

Customized Tracking Algorithm for Robust Cattle Detection and Tracking in Occlusion Environments

An algorithm for cattle counting in rangeland based on multi‐scale perception and image association

Comparing State-of-the-Art Deep Learning Algorithms for the Automated Detection and Tracking of Black Cattle

Detection of Cattle Using Drones and Convolutional Neural Networks

Evaluation of Deep Learning for Automatic Multi-View Face Detection in Cattle

Development of a real-time cattle lameness detection system using a single side-view camera

Cattle face recognition under partial occlusion

Detection, identification and posture recognition of cattle with satellites, aerial photography and UAVs using deep learning techniques

A New Method for Non-Destructive Identification and Tracking of Multi-Object Behaviors in Beef Cattle Based on Deep Learning

CattleEyeView: A Multi-task Top-down View Cattle Dataset for Smarter Precision Livestock Farming

Cattle Body Detection Based on YOLOv5-EMA for Precision Livestock Farming

A multi-target cow face detection model in complex scenes

Research on the Behavior Recognition of Beef Cattle Based on the Improved Lightweight CBR-YOLO Model Based on YOLOv8 in Multi-Scene Weather

Contour Extraction of Individual Cattle From an Image Using Enhanced Mask R-CNN Instance Segmentation Method