Metals compositions of indoor PM2.5, health risk assessment, and birth outcomes in Lanzhou, China

Yaqun Zhang,S. Cao,Xiaoying Xu,J. Qiu,Mingxia Chen,Dennis Wang,Donghong Guan,Chengyuan Wang,Xiao Wang,B. Dong,Huang Huang,N. Zhao,Lan Jin,Yana Bai,Xiaoli Duan

DOI: https://doi.org/10.1007/s10661-016-5319-y

2016-05-04

Abstract:

What problem does this paper attempt to address?

Deep learning-based hierarchical cattle behavior recognition with spatio-temporal information

Alvaro Fuentes,Sook Yoon,Jongbin Park,Dong Sun Park

DOI: https://doi.org/10.1016/j.compag.2020.105627

IF: 8.3

2020-10-01

Computers and Electronics in Agriculture

Abstract:<p>Behavior is an important indicator for understanding the well-being of animals. This process has been frequently carried out by observing video records to detect changes with statistical analysis, or by using portable devices to monitor animal movements. However, regarding animal welfare, the use of such devices could affect the normal behavior of the animal, and present limitations in its applicability. This paper introduces an approach for hierarchical cattle behavior recognition with spatio-temporal information based on deep learning. Our research extends the idea of activity recognition in video and focuses specifically on cattle behavior. Our framework involves appearance features at frame-level and spatio-temporal information that incorporates more context-temporal features. The system can detect (class) and localize (bounding box) regions containing multiple cattle behaviors in the video frames. Additionally, we introduce our cattle behavior dataset that includes videos recorded with RGB cameras on different livestock farms during day and night environments. Experimental results show that our system can effectively recognize 15 different types of hierarchical activities divided into individual and group activities, and also part actions. Qualitative and quantitative evaluation evidence the performance of our framework as an effective method to monitor cattle behavior.</p>

agriculture, multidisciplinary,computer science, interdisciplinary applications
Deep learning-based multi-cattle tracking in crowded livestock farming using video

Shujie Han,Alvaro Fuentes,Sook Yoon,Yongchae Jeong,Hyongsuk Kim,Dong Sun Park

DOI: https://doi.org/10.1016/j.compag.2023.108044

IF: 8.3

2023-07-25

Computers and Electronics in Agriculture

Abstract:Cattle monitoring is an essential aspect of precision farming, and recent advancements have greatly contributed to understanding cattle behavior using wearable devices like ear tags and collars, as well as contactless cameras for image-based detection. However, tracking multiple cattle in real farm conditions with cameras, particularly in crowded scenarios, poses significant challenges mainly due to scale variations, random motion, and occlusion. This paper proposes a deep learning-based framework with improved techniques for multi-cattle tracking using video, aiming to overcome these limitations. The proposed algorithm utilizes a detection-based tracking approach, leveraging a YOLO-v5 detector trained specifically for cattle detection to provide initial targets. The main contributions of our research primarily focus on implementing the tracking algorithm to address the aforementioned problems. Several improvements are introduced: first, to handle appearance and scale deformation, a wide residual network with SPP-Net is employed as the backbone to extract cattle appearance information. Second, an ensemble Kalman filter is utilized to adapt to unexpected movements. Additionally, the angle from the centered position of the individuals to the origin of the image is incorporated to predict their location. Third, to tackle occlusion, a novel bench-matching mechanism is designed, allowing for the retrieval of lost trajectories based on the assumption of a known number of cattle in the barn. To validate the performance of the proposed framework, experiments are conducted using video sequences from our Hanwoo cattle tracking dataset. Comparisons with other state-of-the-art trackers are also performed. Our method achieves an accuracy of 84.49 % in data association, which represents a significant improvement considering the challenges involved in precision livestock farming applications.

agriculture, multidisciplinary,computer science, interdisciplinary applications
Video-based cattle identification and action recognition

Chuong Nguyen,Dadong Wang,Karl Von Richter,Philip Valencia,Flavio A.P. Alvarenga,Gregory Bishop–Hurley,Gregory Bishop-Hurley

DOI: https://doi.org/10.1109/dicta52665.2021.9647417

2021-11-01

Abstract:We demonstrate a working prototype for the monitoring of cow welfare by automatically analysing the animal behaviours. Deep learning models have been developed and tested with videos acquired in a farm, and a precision of 81.2% has been achieved for cow identification. An accuracy of 84.4% has been achieved for the detection of drinking events, and 94.4% for the detection of grazing events. Experimental results show that the proposed deep learning method can be used to identify the behaviours of individual animals to enable automated farm provenance. Our raw and ground-truth dataset will be released as the first public video dataset for cow identification and action recognition. Recommendations for further development are also provided.
AnimalFormer: Multimodal Vision Framework for Behavior-based Precision Livestock Farming

Ahmed Qazi,Taha Razzaq,Asim Iqbal

2024-06-14

Abstract:We introduce a multimodal vision framework for precision livestock farming, harnessing the power of GroundingDINO, HQSAM, and ViTPose models. This integrated suite enables comprehensive behavioral analytics from video data without invasive animal tagging. GroundingDINO generates accurate bounding boxes around livestock, while HQSAM segments individual animals within these boxes. ViTPose estimates key body points, facilitating posture and movement analysis. Demonstrated on a sheep dataset with grazing, running, sitting, standing, and walking activities, our framework extracts invaluable insights: activity and grazing patterns, interaction dynamics, and detailed postural evaluations. Applicable across species and video resolutions, this framework revolutionizes non-invasive livestock monitoring for activity detection, counting, health assessments, and posture analyses. It empowers data-driven farm management, optimizing animal welfare and productivity through AI-powered behavioral understanding.

Computer Vision and Pattern Recognition
A New Method for Non-Destructive Identification and Tracking of Multi-Object Behaviors in Beef Cattle Based on Deep Learning

Guangbo Li,Jiayong Sun,Manyu Guan,Shuai Sun,Guolong Shi,Changjie Zhu

DOI: https://doi.org/10.3390/ani14172464

2024-08-24

Abstract:The method proposed in this paper provides theoretical and practical support for the intelligent recognition and management of beef cattle. Accurate identification and tracking of beef cattle behaviors are essential components of beef cattle production management. Traditional beef cattle identification and tracking methods are time-consuming and labor-intensive, which hinders precise cattle farming. This paper utilizes deep learning algorithms to achieve the identification and tracking of multi-object behaviors in beef cattle, as follows: (1) The beef cattle behavior detection module is based on the YOLOv8n algorithm. Initially, a dynamic snake convolution module is introduced to enhance the ability to extract key features of beef cattle behaviors and expand the model's receptive field. Subsequently, the BiFormer attention mechanism is incorporated to integrate high-level and low-level feature information, dynamically and sparsely learning the behavioral features of beef cattle. The improved YOLOv8n_BiF_DSC algorithm achieves an identification accuracy of 93.6% for nine behaviors, including standing, lying, mounting, fighting, licking, eating, drinking, working, and searching, with average 50 and 50:95 precisions of 96.5% and 71.5%, showing an improvement of 5.3%, 5.2%, and 7.1% over the original YOLOv8n. (2) The beef cattle multi-object tracking module is based on the Deep SORT algorithm. Initially, the detector is replaced with YOLOv8n_BiF_DSC to enhance detection accuracy. Subsequently, the re-identification network model is switched to ResNet18 to enhance the tracking algorithm's capability to gather appearance information. Finally, the trajectory generation and matching process of the Deep SORT algorithm is optimized with secondary IOU matching to reduce ID mismatching errors during tracking. Experimentation with five different complexity levels of test video sequences shows improvements in IDF1, IDS, MOTA, and MOTP, among other metrics, with IDS reduced by 65.8% and MOTA increased by 2%. These enhancements address issues of tracking omission and misidentification in sparse and long-range dense environments, thereby facilitating better tracking of group-raised beef cattle and laying a foundation for intelligent detection and tracking in beef cattle farming.
Video-Based Analysis of Cattle Behaviors: Improved Classification Using FlowEQ Transform

Jung-Woo Chae,Hyeon-Seok Sim,Chang-Woo Lee,Chang-Sik Choi,Hyun-Chong Cho

DOI: https://doi.org/10.1109/access.2024.3379277

IF: 3.9

2024-03-30

IEEE Access

Abstract:Cattle management plays a crucial role in determining the productivity of livestock farms. With the expansion of large-scale livestock operations, it has become increasingly impractical for livestock managers to rely on traditional visual observations for comprehensive monitoring of cattle behaviors, encompassing health and overall welfare. Consequently, the incorporation of automation technology in livestock management is emphasized. The objective of this study is the video-based identification of cattle behavior that can be utilized in automated cattle management systems. With a specific focus on behaviors closely associated with their management, the study employs deep learning-based action classification methods over the commonly used object detection. This approach enables the classification of intricate, repetitive, and slow behaviors that were challenging to detect. Furthermore, a novel method named FlowEQ transform was introduced, incorporating temporal information into the input data. This enhancement proved instrumental in providing valuable insights for inferring cattle behavior, resulting in an impressive 8% improvement in classification performance and achieving a high accuracy rate of 91.5%. The utilization of action classification and the introduction of the innovative FlowEQ transform mark a significant advancement in automated cattle management. This approach is poised to enhance the efficiency of behavior monitoring on livestock farms.

computer science, information systems,telecommunications,engineering, electrical & electronic
Dairy Cow rumination detection: A deep learning approach

Safa Ayadi,Ahmed ben said,Rateb Jabbar,Chafik Aloulou,Achraf Chabbouh,Ahmed Ben Achballah

DOI: https://doi.org/10.48550/arXiv.2101.10445

2021-01-07

Computer Vision and Pattern Recognition

Abstract:Cattle activity is an essential index for monitoring health and welfare of the ruminants. Thus, changes in the livestock behavior are a critical indicator for early detection and prevention of several diseases. Rumination behavior is a significant variable for tracking the development and yield of animal husbandry. Therefore, various monitoring methods and measurement equipment have been used to assess cattle behavior. However, these modern attached devices are invasive, stressful and uncomfortable for the cattle and can influence negatively the welfare and diurnal behavior of the animal. Multiple research efforts addressed the problem of rumination detection by adopting new methods by relying on visual features. However, they only use few postures of the dairy cow to recognize the rumination or feeding behavior. In this study, we introduce an innovative monitoring method using Convolution Neural Network (CNN)-based deep learning models. The classification process is conducted under two main labels: ruminating and other, using all cow postures captured by the monitoring camera. Our proposed system is simple and easy-to-use which is able to capture long-term dynamics using a compacted representation of a video in a single 2D image. This method proved efficiency in recognizing the rumination behavior with 95%, 98% and 98% of average accuracy, recall and precision, respectively.
Dynamic Serpentine Convolution with Attention Mechanism Enhancement for Beef Cattle Behavior Recognition

Guangbo Li,Guolong Shi,Changjie Zhu

DOI: https://doi.org/10.3390/ani14030466

2024-01-31

Abstract:Behavior recognition in beef cattle is a crucial component of beef cattle behavior warning and intelligent farming. Traditional beef cattle behavior recognition faces challenges in both difficulty in identification and low accuracy. In this study, the YOLOv8n_BiF_DSC (Fusion of Dynamic Snake Convolution and BiFormer Attention) algorithm was employed for the non-intrusive recognition of beef cattle behavior. The specific steps are as follows: 45 beef cattle were observed using a fixed camera (A LINE OF DEFENSE) and a mobile phone (Huawei Mate20Pro) to collect and filter posture data, yielding usable videos ranging from 1 to 30 min in length. These videos cover nine different behaviors in various scenarios, including standing, lying, mounting, fighting, licking, eating, drinking, walking, and searching. After data augmentation, the dataset comprised 34,560 samples. The convolutional layer (CONV) was improved by introducing variable convolution and dynamic snake-like convolution modules. The dynamic snake-like convolution, which yielded the best results, expanded the model's receptive field, dynamically perceived key features of beef cattle behavior, and enhanced the algorithm's feature extraction capability. Attention mechanism modules, including SE (Squeeze-and-Excitation Networks), CBAM (Convolutional Block Attention Module), CA (Coordinate Attention), and BiFormer (Vision Transformer with Bi-Level Routing Attention), were introduced. The BiFormer attention mechanism, selected for its optimal performance, improved the algorithm's ability to capture long-distance context dependencies. The model's computational efficiency was enhanced through dynamic and query-aware perception. Experimental results indicated that YOLOv8n_BiF_DSC achieved the best results among all improved algorithms in terms of accuracy, average precision at IoU 50, and average precision at IoU 50:95. The accuracy of beef cattle behavior recognition reached 93.6%, with the average precision at IoU 50 and IoU 50:95 being 96.5% and 71.5%, respectively. This represents a 5.3%, 5.2%, and 7.1% improvement over the original YOLOv8n. Notably, the average accuracy of recognizing the lying posture of beef cattle reached 98.9%. In conclusion, the YOLOv8n_BiF_DSC algorithm demonstrates excellent performance in feature extraction and high-level data fusion, displaying high robustness and adaptability. It provides theoretical and practical support for the intelligent recognition and management of beef cattle.
A new dataset for video-based cow behavior recognition

Kuo Li,Daoerji Fan,Huijuan Wu,Aruna Zhao

DOI: https://doi.org/10.1038/s41598-024-65953-x

2024-08-12

Abstract:A new video based multi behavior dataset for cows, CBVD-5, is introduced in this paper. The dataset includes five cow behaviors: standing, lying down, foraging,rumination and drinking. The dataset comprises 107 cows from the entire barn, maintaining an 80% stocking density. Monitoring occurred over 96 h for these 20-month-old cows, considering varying light conditions and nighttime data to ensure standardization and inclusivity.The dataset consists of ranch monitoring footage collected by seven cameras, including 687 video segment samples and 206,100 image samples, covering five daily behaviors of cows. The data collection process entailed the deployment of cameras, hard drives, software, and servers for storage. Data annotation was conducted using the VIA web tool, leveraging the video expertise of pertinent professionals. The annotation coordinates and category labels of each individual cow in the image, as well as the generated configuration file, are also saved in the dataset. With this dataset,we propose a slowfast cow multi behavior recognition model based on video sequences as the baseline evaluation model. The experimental results show that the model can effectively learn corresponding category labels from the behavior type data of the dataset, with an error rate of 21.28% on the test set. In addition to cow behavior recognition, the dataset can also be used for cow target detection, and so on.The CBVD-5 dataset significantly influences dairy cow behavior recognition, advancing research, enriching data resources, standardizing datasets, enhancing dairy cow health and welfare monitoring, and fostering agricultural intelligence development. Additionally, it serves educational and training needs, supporting research and practical applications in related fields. The dataset will be made freely available to researchers world-wide.
A cow structural model for video analytics of cow health

He Liu,Amy R. Reibman,Jacquelyn P. Boerman

DOI: https://doi.org/10.48550/arXiv.2003.05903

2020-03-12

Image and Video Processing

Abstract:In livestock farming, animal health directly influences productivity. For dairy cows, many health conditions can be evaluated by trained observers based on visual appearance and movement. However, to manually evaluate every cow in a commercial farm is expensive and impractical. This paper introduces a video-analytic system which automatically detects the cow structure from captured video sequences. A side-view cow structural model is designed to describe the spatial positions of the joints (keypoints) of the cow, and we develop a system using deep learning to automatically extract the structural model from videos. The proposed detection system can detect multiple cows in the same frame and provide robust performance under practical challenges like obstacles (fences) and poor illumination. Compared to other object detection methods, this system provides better detection results and successfully isolates the keypoints of each cow even when they are close to each other.
Real-Time Cattle Interaction Recognition via Triple-stream Network

Yang Yang,Mizuka Komatsu,Kenji Oyama,Takenao Ohkawa

DOI: https://doi.org/10.48550/arXiv.2209.02241

2022-09-06

Computer Vision and Pattern Recognition

Abstract:In stockbreeding of beef cattle, computer vision-based approaches have been widely employed to monitor cattle conditions (e.g. the physical, physiology, and health). To this end, the accurate and effective recognition of cattle action is a prerequisite. Generally, most existing models are confined to individual behavior that uses video-based methods to extract spatial-temporal features for recognizing the individual actions of each cattle. However, there is sociality among cattle and their interaction usually reflects important conditions, e.g. estrus, and also video-based method neglects the real-time capability of the model. Based on this, we tackle the challenging task of real-time recognizing interactions between cattle in a single frame in this paper. The pipeline of our method includes two main modules: Cattle Localization Network and Interaction Recognition Network. At every moment, cattle localization network outputs high-quality interaction proposals from every detected cattle and feeds them into the interaction recognition network with a triple-stream architecture. Such a triple-stream network allows us to fuse different features relevant to recognizing interactions. Specifically, the three kinds of features are a visual feature that extracts the appearance representation of interaction proposals, a geometric feature that reflects the spatial relationship between cattle, and a semantic feature that captures our prior knowledge of the relationship between the individual action and interaction of cattle. In addition, to solve the problem of insufficient quantity of labeled data, we pre-train the model based on self-supervised learning. Qualitative and quantitative evaluation evidences the performance of our framework as an effective method to recognize cattle interaction in real time.
CVB: A Video Dataset of Cattle Visual Behaviors

Ali Zia,Renuka Sharma,Reza Arablouei,Greg Bishop-Hurley,Jody McNally,Neil Bagnall,Vivien Rolland,Brano Kusy,Lars Petersson,Aaron Ingham

DOI: https://doi.org/10.48550/arXiv.2305.16555

2023-05-26

Computer Vision and Pattern Recognition

Abstract:Existing image/video datasets for cattle behavior recognition are mostly small, lack well-defined labels, or are collected in unrealistic controlled environments. This limits the utility of machine learning (ML) models learned from them. Therefore, we introduce a new dataset, called Cattle Visual Behaviors (CVB), that consists of 502 video clips, each fifteen seconds long, captured in natural lighting conditions, and annotated with eleven visually perceptible behaviors of grazing cattle. We use the Computer Vision Annotation Tool (CVAT) to collect our annotations. To make the procedure more efficient, we perform an initial detection and tracking of cattle in the videos using appropriate pre-trained models. The results are corrected by domain experts along with cattle behavior labeling in CVAT. The pre-hoc detection and tracking step significantly reduces the manual annotation time and effort. Moreover, we convert CVB to the atomic visual action (AVA) format and train and evaluate the popular SlowFast action recognition model on it. The associated preliminary results confirm that we can localize the cattle and recognize their frequently occurring behaviors with confidence. By creating and sharing CVB, our aim is to develop improved models capable of recognizing all important behaviors accurately and to assist other researchers and practitioners in developing and evaluating new ML models for cattle behavior classification using video data.
A Deep Learning-based Cow Behavior Recognition Scheme for Improving Cattle Behavior Modeling in Smart Farming

P Mohamed Shakeel,Burhanuddin bin Mohd Aboobaider,Lizawati Binti Salahuddin

DOI: https://doi.org/10.1016/j.iot.2022.100539

IF: 5.711

2022-04-01

Internet of Things

Abstract:Farming and animal husbandry applications are improvised with the implication of machine learning and artificial intelligence in recent years. The precise estimation, recommendations, and performances are the prime reason for the technology implication. Owing to the modern agricultural and animal cultures, this article introduces an innovative Behavior Recognition and Computation Scheme (BRCS) for predicting cow behaviors. The information from the swallowed microchip is processed based on the observed animal action that is used for the forecast. Considering the information to be rectilinear, the distractions and distribution patterns (data) are augmented in identifying and forecasting its behavior. The proposed scheme identifies the patterns using a deep recurrent learning paradigm recurrently. This pattern is distinguished for idle and non-idle observations for improving the prediction accuracy. Distinguished data patterns are mapped for the consecutive time and observation data in classifying abnormalities. The proposed scheme's performance is validated using the metrics accuracy, precision, computing time, and mean error.
Individual Cattle Identification Using a Deep Learning Based Framework

Yongliang Qiao,Daobilige Su,He Kong,Salah Sukkarieh,Sabrina Lomax,Cameron Clark

DOI: https://doi.org/10.1016/j.ifacol.2019.12.558

2019-01-01

Abstract:<p>Individual cattle identification is required for precision livestock farming. Current methods for individual cattle identification requires either visual, or unique radio frequency, ear tags. We propose a deep learning based framework to identify beef cattle using image sequences unifying the advantages of both CNN (Convolutional Neural Network) and LSTM (Long Short-Term Memory) network methods. A CNN network was used (Inception-V3) to extract features from a rear-view cattle video dataset and these extracted features were then used to train an LSTM model to capture temporal information and identify each individual animal. A total of 516 rear- view videos of 41 cattle at three time points separated by one month were collected. Our method achieved an accuracy of 88% and 91% for 15-frame and 20-frame video length, respectively. Our approach outperformed the framework that only uses CNN (identification accuracy 57%). Our framework will now be further improved using additional data before integrating the system into on-farm management processes.</p>
Deep learning image recognition of cow behavior and an open data set acquired near an automatic milking robot

Olli Koskela,Leonardo Santiago Benitez Pereira,Ilpo Pölönen,Ilmo Aronen,Iivari Kunttu

DOI: https://doi.org/10.23986/afsci.111665

2022-07-07

Agricultural and Food Science

Abstract:Production animals enjoying good health and well-being are more productive and have a higher output quality. Several technical solutions have been used to monitor the animals' welfare: those based on computer vision provide cost-efficient and scalable options. In this work, we performed a continuous two-month image acquisition of cows in front of an automatic milking station and divided the data into ten different classes related to the most important activities appearing in the images. The data consisted of almost 19 hours of video, equivalent to more than 1.7 million still images. Based on these imaged, we then implemented a convolutional neural network classifier to recognize the cows' behavior. The network was tested using cross-validation methodology and achieved an 86% precision rate and 85% recall rate in the classification. The data and the Python program code used in this study are made available. An image data set that directly resembles the harsh conditions inside a barn and can be used for deep learning purposes has not been previously made available.

food science & technology,agriculture, multidisciplinary
Research on Automatic Recognition of Dairy Cow Daily Behaviors Based on Deep Learning

Rongchuan Yu,Xiaoli Wei,Yan Liu,Fan Yang,Weizheng Shen,Zhixin Gu

DOI: https://doi.org/10.3390/ani14030458

2024-01-31

Animals

Abstract:Dairy cow behavior carries important health information. Timely and accurate detection of behaviors such as drinking, feeding, lying, and standing is meaningful for monitoring individual cows and herd management. In this study, a model called Res-DenseYOLO is proposed for accurately detecting the individual behavior of dairy cows living in cowsheds. Specifically, a dense module was integrated into the backbone network of YOLOv5 to strengthen feature extraction for actual cowshed environments. A CoordAtt attention mechanism and SioU loss function were added to enhance feature learning and training convergence. Multi-scale detection heads were designed to improve small target detection. The model was trained and tested on 5516 images collected from monitoring videos of a dairy cowshed. The experimental results showed that the performance of Res-DenseYOLO proposed in this paper is better than that of Fast-RCNN, SSD, YOLOv4, YOLOv7, and other detection models in terms of precision, recall, and mAP metrics. Specifically, Res-DenseYOLO achieved 94.7% precision, 91.2% recall, and 96.3% mAP, outperforming the baseline YOLOv5 model by 0.7%, 4.2%, and 3.7%, respectively. This research developed a useful solution for real-time and accurate detection of dairy cow behaviors with video monitoring only, providing valuable behavioral data for animal welfare and production management.

agriculture, dairy & animal science,veterinary sciences
AI-enhanced real-time cattle identification system through tracking across various environments

Su Larb Mon,Tsubasa Onizuka,Pyke Tin,Masaru Aikawa,Ikuo Kobayashi,Thi Thi Zin

DOI: https://doi.org/10.1038/s41598-024-68418-3

2024-08-01

Abstract:Video-based monitoring is essential nowadays in cattle farm management systems for automated evaluation of cow health, encompassing body condition scores, lameness detection, calving events, and other factors. In order to efficiently monitor the well-being of each individual animal, it is vital to automatically identify them in real time. Although there are various techniques available for cattle identification, a significant number of them depend on radio frequency or visible ear tags, which are prone to being lost or damaged. This can result in financial difficulties for farmers. Therefore, this paper presents a novel method for tracking and identifying the cattle with an RGB image-based camera. As a first step, to detect the cattle in the video, we employ the YOLOv8 (You Only Look Once) model. The sample data contains the raw video that was recorded with the cameras that were installed at above from the designated lane used by cattle after the milk production process and above from the rotating milking parlor. As a second step, the detected cattle are continuously tracked and assigned unique local IDs. The tracked images of each individual cattle are then stored in individual folders according to their respective IDs, facilitating the identification process. The images of each folder will be the features which are extracted using a feature extractor called VGG (Visual Geometry Group). After feature extraction task, as a final step, the SVM (Support Vector Machine) identifier for cattle identification will be used to get the identified ID of the cattle. The final ID of a cattle is determined based on the maximum identified output ID from the tracked images of that particular animal. The outcomes of this paper will act as proof of the concept for the use of combining VGG features with SVM is an effective and promising approach for an automatic cattle identification system.
Cow Behavior Recognition Based on Wearable Nose Rings

Wenhan Feng,Daoerji Fan,Huijuan Wu,Wenqiang Yuan

DOI: https://doi.org/10.3390/ani14081187

2024-04-15

Animals

Abstract:This study introduces a novel device designed to monitor dairy cow behavior, with a particular focus on feeding, rumination, and other behaviors. This study investigates the association between the cow behaviors and acceleration data collected using a three-axis, nose-mounted accelerometer, as well as the feasibility of improving the behavioral classification accuracy through machine learning. A total of 11 cows were used. We utilized three-axis acceleration sensors that were fixed to the cow's nose, and these devices provided detailed and unique data corresponding to their activity; in particular, a recorder was installed on each nasal device to obtain acceleration data, which were then used to calculate activity levels and changes. In addition, we visually observed the behavior of the cattle. The characteristic acceleration values during feeding, rumination, and other behavior were recorded; there were significant differences in the activity levels and changes between different behaviors. The results indicated that the nose ring device had the potential to accurately differentiate between eating and rumination behaviors, thus providing an effective method for the early detection of health problems and cattle management. The eating, rumination, and other behaviors of cows were classified with high accuracy using the machine learning technique, which can be used to calculate the activity levels and changes in cattle based on the data obtained from the nose-mounted, three-axis accelerometer.

agriculture, dairy & animal science,veterinary sciences
X3DFast model for classifying dairy cow behaviors based on a two-pathway architecture

Qiang Bai,Ronghua Gao,Rong Wang,Qifeng Li,Qinyang Yu,Chunjiang Zhao,Shuqin Li

DOI: https://doi.org/10.1038/s41598-023-45211-2

IF: 4.6

2023-11-22

Scientific Reports

Abstract:Abstract Behavior is one of the important factors reflecting the health status of dairy cows, and when dairy cows encounter health problems, they exhibit different behavioral characteristics. Therefore, identifying dairy cow behavior not only helps in assessing their physiological health and disease treatment but also improves cow welfare, which is very important for the development of animal husbandry. The method of relying on human eyes to observe the behavior of dairy cows has problems such as high labor costs, high labor intensity, and high fatigue rates. Therefore, it is necessary to explore more effective technical means to identify cow behaviors more quickly and accurately and improve the intelligence level of dairy cow farming. Automatic recognition of dairy cow behavior has become a key technology for diagnosing dairy cow diseases, improving farm economic benefits and reducing animal elimination rates. Recently, deep learning for automated dairy cow behavior identification has become a research focus. However, in complex farming environments, dairy cow behaviors are characterized by multiscale features due to large scenes and long data collection distances. Traditional behavior recognition models cannot accurately recognize similar behavior features of dairy cows, such as those with similar visual characteristics, i.e., standing and walking. The behavior recognition method based on 3D convolution solves the problem of small visual feature differences in behavior recognition. However, due to the large number of model parameters, long inference time, and simple data background, it cannot meet the demand for real-time recognition of dairy cow behaviors in complex breeding environments. To address this, we developed an effective yet lightweight model for fast and accurate dairy cow behavior feature learning from video data. We focused on four common behaviors: standing, walking, lying, and mounting. We recorded videos of dairy cow behaviors at a dairy farm containing over one hundred cows using surveillance cameras. A robust model was built using a complex background dataset. We proposed a two-pathway X3DFast model based on spatiotemporal behavior features. The X3D and fast pathways were laterally connected to integrate spatial and temporal features. The X3D pathway extracted spatial features. The fast pathway with R(2 + 1)D convolution decomposed spatiotemporal features and transferred effective spatial features to the X3D pathway. An action model further enhanced X3D spatial modeling. Experiments showed that X3DFast achieved 98.49% top-1 accuracy, outperforming similar methods in identifying the four behaviors. The method we proposed can effectively identify similar dairy cow behaviors while improving inference speed, providing technical support for subsequent dairy cow behavior recognition and daily behavior statistics.

multidisciplinary sciences
Development of a real-time cattle lameness detection system using a single side-view camera

Bo Bo Myint,Tsubasa Onizuka,Pyke Tin,Masaru Aikawa,Ikuo Kobayashi,Thi Thi Zin

DOI: https://doi.org/10.1038/s41598-024-64664-7

IF: 4.6

2024-06-15

Scientific Reports

Abstract:Recent advancements in machine learning and deep learning have revolutionized various computer vision applications, including object detection, tracking, and classification. This research investigates the application of deep learning for cattle lameness detection in dairy farming. Our study employs image processing techniques and deep learning methods for cattle detection, tracking, and lameness classification. We utilize two powerful object detection algorithms: Mask-RCNN from Detectron2 and the popular YOLOv8. Their performance is compared to identify the most effective approach for this application. Bounding boxes are drawn around detected cattle to assign unique local IDs, enabling individual tracking and isolation throughout the video sequence. Additionally, mask regions generated by the chosen detection algorithm provide valuable data for feature extraction, which is crucial for subsequent lameness classification. The extracted cattle mask region values serve as the basis for feature extraction, capturing relevant information indicative of lameness. These features, combined with the local IDs assigned during tracking, are used to compute a lameness score for each cattle. We explore the efficacy of various established machine learning algorithms, such as Support Vector Machines (SVM), AdaBoost and so on, in analyzing the extracted lameness features. Evaluation of the proposed system was conducted across three key domains: detection, tracking, and lameness classification. Notably, the detection module employing Detectron2 achieved an impressive accuracy of 98.98%. Similarly, the tracking module attained a high accuracy of 99.50%. In lameness classification, AdaBoost emerged as the most effective algorithm, yielding the highest overall average accuracy (77.9%). Other established machine learning algorithms, including Decision Trees (DT), Support Vector Machines (SVM), and Random Forests, also demonstrated promising performance (DT: 75.32%, SVM: 75.20%, Random Forest: 74.9%). The presented approach demonstrates the successful implementation for cattle lameness detection. The proposed system has the potential to revolutionize dairy farm management by enabling early lameness detection and facilitating effective monitoring of cattle health. Our findings contribute valuable insights into the application of advanced computer vision methods for livestock health management.

multidisciplinary sciences

Metals compositions of indoor PM2.5, health risk assessment, and birth outcomes in Lanzhou, China

Deep learning-based hierarchical cattle behavior recognition with spatio-temporal information

Deep learning-based multi-cattle tracking in crowded livestock farming using video

Video-based cattle identification and action recognition

AnimalFormer: Multimodal Vision Framework for Behavior-based Precision Livestock Farming

A New Method for Non-Destructive Identification and Tracking of Multi-Object Behaviors in Beef Cattle Based on Deep Learning

Video-Based Analysis of Cattle Behaviors: Improved Classification Using FlowEQ Transform

Dairy Cow rumination detection: A deep learning approach

Dynamic Serpentine Convolution with Attention Mechanism Enhancement for Beef Cattle Behavior Recognition

A new dataset for video-based cow behavior recognition

A cow structural model for video analytics of cow health

Real-Time Cattle Interaction Recognition via Triple-stream Network

CVB: A Video Dataset of Cattle Visual Behaviors

A Deep Learning-based Cow Behavior Recognition Scheme for Improving Cattle Behavior Modeling in Smart Farming

Individual Cattle Identification Using a Deep Learning Based Framework

Deep learning image recognition of cow behavior and an open data set acquired near an automatic milking robot

Research on Automatic Recognition of Dairy Cow Daily Behaviors Based on Deep Learning

AI-enhanced real-time cattle identification system through tracking across various environments

Cow Behavior Recognition Based on Wearable Nose Rings

X3DFast model for classifying dairy cow behaviors based on a two-pathway architecture

Development of a real-time cattle lameness detection system using a single side-view camera