Abstract:Recent advancements in machine learning and deep learning have revolutionized various computer vision applications, including object detection, tracking, and classification. This research investigates the application of deep learning for cattle lameness detection in dairy farming. Our study employs image processing techniques and deep learning methods for cattle detection, tracking, and lameness classification. We utilize two powerful object detection algorithms: Mask-RCNN from Detectron2 and the popular YOLOv8. Their performance is compared to identify the most effective approach for this application. Bounding boxes are drawn around detected cattle to assign unique local IDs, enabling individual tracking and isolation throughout the video sequence. Additionally, mask regions generated by the chosen detection algorithm provide valuable data for feature extraction, which is crucial for subsequent lameness classification. The extracted cattle mask region values serve as the basis for feature extraction, capturing relevant information indicative of lameness. These features, combined with the local IDs assigned during tracking, are used to compute a lameness score for each cattle. We explore the efficacy of various established machine learning algorithms, such as Support Vector Machines (SVM), AdaBoost and so on, in analyzing the extracted lameness features. Evaluation of the proposed system was conducted across three key domains: detection, tracking, and lameness classification. Notably, the detection module employing Detectron2 achieved an impressive accuracy of 98.98%. Similarly, the tracking module attained a high accuracy of 99.50%. In lameness classification, AdaBoost emerged as the most effective algorithm, yielding the highest overall average accuracy (77.9%). Other established machine learning algorithms, including Decision Trees (DT), Support Vector Machines (SVM), and Random Forests, also demonstrated promising performance (DT: 75.32%, SVM: 75.20%, Random Forest: 74.9%). The presented approach demonstrates the successful implementation for cattle lameness detection. The proposed system has the potential to revolutionize dairy farm management by enabling early lameness detection and facilitating effective monitoring of cattle health. Our findings contribute valuable insights into the application of advanced computer vision methods for livestock health management.

A Stereo-Vision System for 3D Position Recognition of Cow Teats on Robot Milking System

Stereo Calibration and Rectification for Omnidirectional Multi-Camera Systems

Calibration and location analysis of a heterogeneous binocular stereo vision system

Teat Pose Estimation via RGBD Segmentation for Automated Milking

Stereo-vision-based crop height estimation for agricultural robots

Real-time teat detection using haar cascade classifier in smart automatic milking system

Crop Height Measurement System Based on 3D Image and Tilt Sensor Fusion

The development of a pneumatic robot for attaching a milking machine to a cow

Automated acquisition of top-view dairy cow depth image data using an RGB-D sensor camera

Case Study: Improving the Quality of Dairy Cow Reconstruction with a Deep Learning-Based Framework

Development of an autonomous cow-milking robot control system

Utilizing 3D Point Cloud Technology with Deep Learning for Automated Measurement and Analysis of Dairy Cows

AI-enhanced real-time cattle identification system through tracking across various environments

Near-infrared spectroscopic sensing system for on-line milk quality assessment in a milking robot

Korean Cattle 3D Reconstruction from Multi-View 3D-Camera System in Real Environment

Three-dimensional Location of Tomato Based on Binocular Stereo Vision for Tomato Harvesting Robot

Development of a real-time cattle lameness detection system using a single side-view camera

Accurate and Robust Stereo Direct Visual Odometry for Agricultural Environment

Open-Set Recognition of Individual Cows Based on Spatial Feature Transformation and Metric Learning

Stereo Vision Based Robot for Remote Monitoring with VR Support

Biometric Physiological Responses from Dairy Cows Measured by Visible Remote Sensing Are Good Predictors of Milk Productivity and Quality through Artificial Intelligence