The metabolism of glycine in experimental porphyria.

E. Dowdle,L. Eales,J. Mathias,E. Thomas

1961-11-25

Abstract:

What problem does this paper attempt to address?

Deep Learning and Machine Vision Approaches for Posture Detection of Individual Pigs

Abozar Nasirahmadi,Barbara Sturm,Sandra Edwards,Knut-Håkan Jeppsson,Anne-Charlotte Olsson,Simone Müller,Oliver Hensel

DOI: https://doi.org/10.3390/s19173738

IF: 3.9

2019-08-29

Sensors

Abstract:Posture detection targeted towards providing assessments for the monitoring of health and welfare of pigs has been of great interest to researchers from different disciplines. Existing studies applying machine vision techniques are mostly based on methods using three-dimensional imaging systems, or two-dimensional systems with the limitation of monitoring under controlled conditions. Thus, the main goal of this study was to determine whether a two-dimensional imaging system, along with deep learning approaches, could be utilized to detect the standing and lying (belly and side) postures of pigs under commercial farm conditions. Three deep learning-based detector methods, including faster regions with convolutional neural network features (Faster R-CNN), single shot multibox detector (SSD) and region-based fully convolutional network (R-FCN), combined with Inception V2, Residual Network (ResNet) and Inception ResNet V2 feature extractions of RGB images were proposed. Data from different commercial farms were used for training and validation of the proposed models. The experimental results demonstrated that the R-FCN ResNet101 method was able to detect lying and standing postures with higher average precision (AP) of 0.93, 0.95 and 0.92 for standing, lying on side and lying on belly postures, respectively and mean average precision (mAP) of more than 0.93.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Pig Postures Recognition Based On VGG19-GNN-SVM

Xiaonan Luo,Xiaoshu Zhu,Lele Wang,Fang Li

DOI: https://doi.org/10.1109/ICIST59754.2023.10367053

2023-12-08

Abstract:Animal health issues are increasingly important in modern society, as an animal's posture can reflect its emotional state and overall well-being. In recent years, machine vision technology has been applied to monitor the psychological and physiological health of animals. This study proposes a pig posture behavior recognition method based on the VGG19-GNN-SVM framework. The research utilizes depth cameras to collect data on pigs, which helps reduce the exposure of captured images. The study is primarily divided into two key steps. Firstly, the collected data set undergoes preprocessing, including the segmentation of target objects and watershed segmentation to obtain pig images. Subsequently, a series of features are extracted from the images, such as convex hull, convex hull perimeter, boundaries, depth distances between shoulder joints and hips, convex hull ratio, perimeter boundary, and convex hull area ratio, as well as the depth distance between the shoulders and hips and the ratio of depth distance between the shoulders. Secondly, the features obtained from the preprocessing stage are input into the improved pig posture recognition model (VGG 19-GNN-SVM), which is then trained and tested. The final results indicate that the model exhibits higher performance in accurately recognizing two specific postures, namely, the standing posture and the lateral lying posture. Compared to the other three models (CNN, SVM, and CNN-SVM), this model achieves a higher posture recognition accuracy of 0.9147. Furthermore, the error rate has been reduced to 12 %. It is particularly noteworthy that this model significantly outperforms the CNN-SVM model in terms of accuracy, demonstrating a noticeable improvement in performance.

Agricultural and Food Sciences,Computer Science
Pig-Posture Recognition Based on Computer Vision: Dataset and Exploration

Hongmin Shao,Jingyu Pu,Jiong Mu

DOI: https://doi.org/10.3390/ani11051295

2021-04-30

Animals

Abstract:Posture changes in pigs during growth are often precursors of disease. Monitoring pigs’ behavioral activities can allow us to detect pathological changes in pigs earlier and identify the factors threatening the health of pigs in advance. Pigs tend to be farmed on a large scale, and manual observation by keepers is time consuming and laborious. Therefore, the use of computers to monitor the growth processes of pigs in real time, and to recognize the duration and frequency of pigs’ postural changes over time, can prevent outbreaks of porcine diseases. The contributions of this article are as follows: (1) The first human-annotated pig-posture-identification dataset in the world was established, including 800 pictures of each of the four pig postures: standing, lying on the stomach, lying on the side, and exploring. (2) When using a deep separable convolutional network to classify pig postures, the accuracy was 92.45%. The results show that the method proposed in this paper achieves adequate pig-posture recognition in a piggery environment and may be suitable for livestock farm applications.

agriculture, dairy & animal science,veterinary sciences
Efficient Detection Method of Pig-Posture Behavior Based on Multiple Attention Mechanism

Li Huang,Lijia Xu,Yuchao Wang,Yingqi Peng,Zhiyong Zou,Peng Huang

DOI: https://doi.org/10.1155/2022/1759542

IF: 3.12

2022-07-18

Computational Intelligence and Neuroscience

Abstract:Due to the low detection precision and poor robustness, the traditional pig-posture and behavior detection method is difficult to apply in the complex pig captivity environment. In this regard, we designed the HE-Yolo (High-effect Yolo) model, which improves the Darknet-53 feature extraction network and integrates DAM (Dual attention mechanism) of channel attention mechanism and space attention mechanism, to recognize the posture behaviors of the enclosure pigs in real-time. First, the pig data set is clustered and optimized by the K-means algorithm to obtain a new anchor frame size. Second, the DSC (Depthwise separable convolution) and h-switch activation function are innovatively introduced into the Darknet-53 feature extraction network, and the C-Res (Contrary residual structure) unit is designed to build Darknet-A feature extraction network, so as to avoid network gradient explosion and ensure the integrity of feature information. Subsequently, DAM integrating the spatial attention mechanism and the channel attention mechanism is established, and it is further combined with the Incep-abate module to form DAB (Dual attention block), and HE-Yolo is finally built by Darknet-A and DAB. A total of 2912 images of 46 enclosure pigs are divided into the training set, the verification set, and the test set according to the ratio of 14 : 3:3, and the recognition performance of HE-Yolo is verified according to the parameters of the precision P, the recall R, the AP (i.e., the area of P-R curve) and the MAP (i.e., the average value of AP). The experiment results show that the AP values of HE-Yolo reach 99.25%, 98.41%, 94.43%, and 97.63%, respectively, in the recognition of four pig-posture behaviors of standing, sitting, prone and sidling of the test set. Compared with other models such as Yolo v3, SSD, and faster R–CNN, the mAP value of HE-Yolo is increased by 5.61%, 4.65%, and 0.57%, respectively, and the single-frame recognition time of HE-Yolo is only 0.045 s. In the recognition of images with foreign body occlusion and pig adhesion, the mAP values of HE-Yolo are increased by 4.04%, 4.94%, and 1.76%, respectively, while compared with other models. Under different lighting conditions, the mAP value of HE-Yolo is also higher than that of other models. The experimental results show that HE-Yolo can recognize the pig-posture behaviors with high precision, and it shows good generalization ability and luminance robustness, which provides technical support for the recognition of pig-posture behaviors and real-time monitoring of physiological health of the enclosure pigs.

mathematical & computational biology,neurosciences
Automatic Detection and Segmentation for Group-Housed Pigs Based on PigMS R-CNN

Shuqin Tu,Weijun Yuan,Yun Liang,Fan Wang,Hua Wan

DOI: https://doi.org/10.3390/s21093251

IF: 3.9

2021-05-07

Sensors

Abstract:Instance segmentation is an accurate and reliable method to segment adhesive pigs’ images, and is critical for providing health and welfare information on individual pigs, such as body condition score, live weight, and activity behaviors in group-housed pig environments. In this paper, a PigMS R-CNN framework based on mask scoring R-CNN (MS R-CNN) is explored to segment adhesive pig areas in group-pig images, to separate the identification and location of group-housed pigs. The PigMS R-CNN consists of three processes. First, a residual network of 101-layers, combined with the feature pyramid network (FPN), is used as a feature extraction network to obtain feature maps for input images. Then, according to these feature maps, the region candidate network generates the regions of interest (RoIs). Finally, for each RoI, we can obtain the location, classification, and segmentation results of detected pigs through the regression and category, and mask three branches from the PigMS R-CNN head network. To avoid target pigs being missed and error detections in overlapping or stuck areas of group-housed pigs, the PigMS R-CNN framework uses soft non-maximum suppression (soft-NMS) by replacing the traditional NMS to conduct post-processing selected operation of pigs. The MS R-CNN framework with traditional NMS obtains results with an F1 of 0.9228. By setting the soft-NMS threshold to 0.7 on PigMS R-CNN, detection of the target pigs achieves an F1 of 0.9374. The work explores a new instance segmentation method for adhesive group-housed pig images, which provides valuable exploration for vision-based, real-time automatic pig monitoring and welfare evaluation.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Posture Detection of Individual Pigs Based on Lightweight Convolution Neural Networks and Efficient Channel-Wise Attention

Yizhi Luo,Zhixiong Zeng,Huazhong Lu,Enli Lv

DOI: https://doi.org/10.3390/s21248369

IF: 3.9

2021-12-15

Sensors

Abstract:In this paper, a lightweight channel-wise attention model is proposed for the real-time detection of five representative pig postures: standing, lying on the belly, lying on the side, sitting, and mounting. An optimized compressed block with symmetrical structure is proposed based on model structure and parameter statistics, and the efficient channel attention modules are considered as a channel-wise mechanism to improve the model architecture.The results show that the algorithm’s average precision in detecting standing, lying on the belly, lying on the side, sitting, and mounting is 97.7%, 95.2%, 95.7%, 87.5%, and 84.1%, respectively, and the speed of inference is around 63 ms (CPU = i7, RAM = 8G) per postures image. Compared with state-of-the-art models (ResNet50, Darknet53, CSPDarknet53, MobileNetV3-Large, and MobileNetV3-Small), the proposed model has fewer model parameters and lower computation complexity. The statistical results of the postures (with continuous 24 h monitoring) show that some pigs will eat in the early morning, and the peak of the pig’s feeding appears after the input of new feed, which reflects the health of the pig herd for farmers.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Automatic recognition of lactating sow postures from depth images by deep learning detector

Chan Zheng,Xunmu Zhu,Xiaofan Yang,Lina Wang,Shuqin Tu,Yueju Xue

DOI: https://doi.org/10.1016/j.compag.2018.01.023

IF: 8.3

2018-04-01

Computers and Electronics in Agriculture

Abstract:The behaviors of livestock on farms are the primary representatives of animal welfare, health conditions and social interactions. Measuring behavior quantitatively in an automatic detection system on computer vision provides valuable behavioral information in an efficient and noninvasive way compared with manual observations or sensing techniques. Lactating sow postures, which are the crucial indicator of maternal evaluation, provide fundamental information for studying the maternal behavioral characteristics and regularities. We introduce a detector, Faster R-CNN, on deep learning framework to identify five postures (standing, sitting, sternal recumbency, ventral recumbency and lateral recumbency) and obtain sows accurate location in loose pens. The detection system consists of a Kinect v2 sensor that acquires depth images and a program that identifies sow postures and locates its bounding-boxes. The depth images of testing dataset of a sow were acquired at 5 frames per second in 24 h on the 15th day of postpartum, and training dataset were collected by some different sows. Since the identification performance from RGB images are impacted by the color and illumination variations caused by in-situ heat lamp and day-night cycle, we show that the automatic detection from depth images could avoid disturbances of the light. We find that the sow spent greater amount of time in recumbency (92.9% at night and 84.1% during the daytime) as compared with standing (0.4% at night and 10.5% during the daytime) and sitting (0.55% at night and 3.4% during the daytime). Statistically, the sow’s activity level is non-uniform in 24-h of a day, and her preferred lying positions is accordant with the pen’s floor design. The posture’s change frequency and average duration are presented. From the estimated general manner of posture change, we find that the sow takes more time in descending body than ascending, which could be a favorable indication of maternal ability with a slow-motion falling to avoid crushing piglets.

agriculture, multidisciplinary,computer science, interdisciplinary applications
A Deep-Learning-Based System for Pig Posture Classification: Enhancing Sustainable Smart Pigsty Management

Chanhui Jeon,Haram Kim,Dongsoo Kim

DOI: https://doi.org/10.3390/su16072888

IF: 3.9

2024-03-30

Sustainability

Abstract:This paper presents a deep-learning-based system for classifying pig postures, aiming to improve the management of sustainable smart pigsties. The classification of pig postures is a crucial concern for researchers investigating pigsty environments and for on-site pigsty managers. To address this issue, we developed a comprehensive system framework for pig posture classification within a pigsty. We collected image datasets from an open data sharing site operated by a public organization and systematically conducted the following steps: object detection, data labeling, image preprocessing, model development, and training. These processes were carried out using the acquired datasets to ensure comprehensive and effective training for our pig posture classification system. Subsequently, we analyzed and discussed the classification results using techniques such as Grad-CAM. As a result of visual analysis through Grad-CAM, it is possible to identify image features when posture is correctly classified or misclassified in a pig image. By referring to these results, it is expected that the accuracy of pig posture classification can be further improved. Through this analysis and discussion, we can identify which features of pig postures in images need to be emphasized to improve the accuracy of pig posture classification. The findings of this study are anticipated to significantly improve the accuracy of pig posture classification. In practical applications, the proposed pig posture classification system holds the potential to promptly detect abnormal situations in pigsties, leading to prompt responses. Ultimately, this can greatly contribute to increased productivity in pigsty operations, fostering efficiency enhancements in pigsty management.

environmental sciences,environmental studies,green & sustainable science & technology
[An autopsy case of acute encephalopathy associated with hypertrophy of the inferior olives].

M. Kurihara,K. Kumagai,S. Yagishita

1992-09-01

Abstract:We presented an autopsy case of a severely handicapped girl with sequelae of acute encephalopathy at 10 months old. The autopsy findings were diffuse leukomalacia in cerebral medulla, loss of nerve cells and marked gliosis in thalamus, leukomalacia with fibrous gliosis in central tegmental tracts, and marked fibrous gliosis of the cerebellar hemisphere. Purkinje cells were spared much more than granular cells. Hypertrophy of the nerve cells in the inferior olives were seen and the bundles of its efferent nerve fibers were thin. This case is worth reporting that she has suffered from brain damage about 8 years before, and the inferior olives are hypertrophic yet.
Research on the posture recognition method of suckling sow based on deep learning

Fang Li,Qiuju Xie,Weizhan Shi

DOI: https://doi.org/10.1109/ichci54629.2021.00030

2021-11-01

Abstract:The posture of the sow is one of the important evaluation indicators of its maternal behavior, so it has received extensive attention from breeding and breeding management. At present, the recognition of the sow's posture is mostly based on machine vision and three-axis acceleration sensors. However, when using machine vision technology to capture individual posture images of pigs in the rearing state, the efficiency of sow posture recognition is low due to factors such as light intensity, complexity of the environment in the pen, and location of the pigs. In this paper, 18 postpartum Dumin (Dulac × Min pigs) sow postures were collected for 8 days of video data, and the sow posture recognition model was established based on the Dual-Resnet34 method. Offline and online data enhancement methods are used to enhance the captured image and efficiently decouple the posture features to improve the efficiency of model training. A dual-channel residual network combined with a large convolution kernel is proposed to linearly determine the pig features, which improves the accuracy of the model. The results show that the model proposed in this paper has a positive rate of 99.68%, 99.99%, 99.06%,99.5%, and 99.99% for the 5 types of postures of lactating sows on the test set. And the overall recognition rate of various gestures of pigs reaches 99.5%, which is an increase of 0.42% compared to the single-channel Resnet34. Therefore, this method improves the recognition accuracy while ensuring the recognition efficiency, which can provide a technical reference for the automatic recognition of sow behavior.
Panoptic Instance Segmentation on Pigs

Johannes Brünger,Maria Gentz,Imke Traulsen,Reinhard Koch

DOI: https://doi.org/10.3390/s20133710

2020-05-21

Abstract:The behavioural research of pigs can be greatly simplified if automatic recognition systems are used. Especially systems based on computer vision have the advantage that they allow an evaluation without affecting the normal behaviour of the animals. In recent years, methods based on deep learning have been introduced and have shown pleasingly good results. Especially object and keypoint detectors have been used to detect the individual animals. Despite good results, bounding boxes and sparse keypoints do not trace the contours of the animals, resulting in a lot of information being lost. Therefore this work follows the relatively new definition of a panoptic segmentation and aims at the pixel accurate segmentation of the individual pigs. For this a framework of a neural network for semantic segmentation, different network heads and postprocessing methods is presented. With the resulting instance segmentation masks further information like the size or weight of the animals could be estimated. The method is tested on a specially created data set with 1000 hand-labeled images and achieves detection rates of around 95% (F1 Score) despite disturbances such as occlusions and dirty lenses.

Computer Vision and Pattern Recognition
Detection of Pig Movement and Aggression Using Deep Learning Approaches

Jiacheng Wei,Xi Tang,Jinxiu Liu,Zhiyan Zhang

DOI: https://doi.org/10.3390/ani13193074

2023-09-30

Abstract:Motion and aggressive behaviors in pigs provide important information for the study of social hierarchies in pigs and can be used as a selection indicator for pig health and aggression parameters. However, relying only on visual observation or surveillance video to record the number of aggressive acts is time-consuming, labor-intensive, and lasts for only a short period of time. Manual observation is too short compared to the growth cycle of pigs, and complete recording is impractical in large farms. In addition, due to the complex process of assessing the intensity of pig aggression, manual recording is highly influenced by human subjective vision. In order to efficiently record pig motion and aggressive behaviors as parameters for breeding selection and behavioral studies, the videos and pictures were collected from typical commercial farms, with each unit including 8~20 pigs in 7~25 m2 space; they were bred in stable social groups and a video was set up to record the whole day's activities. We proposed a deep learning-based recognition method for detecting and recognizing the movement and aggressive behaviors of pigs by recording and annotating head-to-head tapping, head-to-body tapping, neck biting, body biting, and ear biting during fighting. The method uses an improved EMA-YOLOv8 model and a target tracking algorithm to assign a unique digital identity code to each pig, while efficiently recognizing and recording pig motion and aggressive behaviors and tracking them, thus providing statistics on the speed and duration of pig motion. On the test dataset, the average precision of the model was 96.4%, indicating that the model has high accuracy in detecting a pig's identity and its fighting behaviors. The model detection results were highly correlated with the manual recording results (R2 of 0.9804 and 0.9856, respectively), indicating that the method has high accuracy and effectiveness. In summary, the method realized the detection and identification of motion duration and aggressive behavior of pigs under natural conditions, and provided reliable data and technical support for the study of the social hierarchy of pigs and the selection of pig health and aggression phenotypes.
DigiPig: First Developments of an Automated Monitoring System for Body, Head and Tail Detection in Intensive Pig Farming

Marko Ocepek,Anja Žnidar,Miha Lavrič,Dejan Škorjanc,Inger Lise Andersen

DOI: https://doi.org/10.3390/agriculture12010002

2021-12-21

Agriculture

Abstract:The goal of this study was to develop an automated monitoring system for the detection of pigs’ bodies, heads and tails. The aim in the first part of the study was to recognize individual pigs (in lying and standing positions) in groups and their body parts (head/ears, and tail) by using machine learning algorithms (feature pyramid network). In the second part of the study, the goal was to improve the detection of tail posture (tail straight and curled) during activity (standing/moving around) by the use of neural network analysis (YOLOv4). Our dataset (n = 583 images, 7579 pig posture) was annotated in Labelbox from 2D video recordings of groups (n = 12–15) of weaned pigs. The model recognized each individual pig’s body with a precision of 96% related to threshold intersection over union (IoU), whilst the precision for tails was 77% and for heads this was 66%, thereby already achieving human-level precision. The precision of pig detection in groups was the highest, while head and tail detection precision were lower. As the first study was relatively time-consuming, in the second part of the study, we performed a YOLOv4 neural network analysis using 30 annotated images of our dataset for detecting straight and curled tails. With this model, we were able to recognize tail postures with a high level of precision (90%).
Deep learning pose detection model for sow locomotion

Tauana Maria Carlos Guimarães de Paula,Rafael Vieira de Sousa,Marisol Parada Sarmiento,Ton Kramer,Edson José de Souza Sardinha,Leandro Sabei,Júlia Silvestrini Machado,Mirela Vilioti,Adroaldo José Zanella

DOI: https://doi.org/10.1038/s41598-024-62151-7

2024-07-16

Abstract:Lameness affects animal mobility, causing pain and discomfort. Lameness in early stages often goes undetected due to a lack of observation, precision, and reliability. Automated and non-invasive systems offer precision and detection ease and may improve animal welfare. This study was conducted to create a repository of images and videos of sows with different locomotion scores. Our goal is to develop a computer vision model for automatically identifying specific points on the sow's body. The automatic identification and ability to track specific body areas, will allow us to conduct kinematic studies with the aim of facilitating the detection of lameness using deep learning. The video database was collected on a pig farm with a scenario built to allow filming of sows in locomotion with different lameness scores. Two stereo cameras were used to record 2D videos images. Thirteen locomotion experts assessed the videos using the Locomotion Score System developed by Zinpro Corporation. From this annotated repository, computational models were trained and tested using the open-source deep learning-based animal pose tracking framework SLEAP (Social LEAP Estimates Animal Poses). The top-performing models were constructed using the LEAP architecture to accurately track 6 (lateral view) and 10 (dorsal view) skeleton keypoints. The architecture achieved average precisions values of 0.90 and 0.72, average distances of 6.83 and 11.37 in pixel, and similarities of 0.94 and 0.86 for the lateral and dorsal views, respectively. These computational models are proposed as a Precision Livestock Farming tool and method for identifying and estimating postures in pigs automatically and objectively. The 2D video image repository with different pig locomotion scores can be used as a tool for teaching and research. Based on our skeleton keypoint classification results, an automatic system could be developed. This could contribute to the objective assessment of locomotion scores in sows, improving their welfare.
A PCA-based frame selection method for applying CNN and LSTM to classify postural behaviour in sows

Meiqing Wang,Maciek oczak,Mona Larsen,Florian Bayer,Kristina Maschat,Johannes Baumgartner,Jean-Loup Rault,Tomas Norton

DOI: https://doi.org/10.1016/j.compag.2021.106351

IF: 8.3

2021-10-01

Computers and Electronics in Agriculture

Abstract:Posture and the rate of postural changes of farrowing and lactating sows are considered reliable indicators of environmental comfort and health status and are risk factors for piglet crushing. The objective of this study was to develop a combined deep learning and principle component analysis (PCA) based approach to classify different postural behaviours of sows in videos. Compared to previous studies of sow's postural behaviour classification based on deep learning, this study selects sequences of frames from the videos that distinguish different postural behaviours rather than using all frames for the classification. Videos were collected from 13 sows, and the recording started from 5 days before the expected date of farrowing until weaning. From the videos, 3100 videos without piglets and 1680 including piglets were manually selected. Then, these videos were augmented by using vertical mirroring and adding Gaussian noise, which resulted in 7200 and 4600 videos without and including piglets, respectively. Each video lasted 5 sec and included 1 out of 5 behavioural postures (sternal lying, lateral lying, sitting, standing, walking) labelled by one trained expert with extensive experience in sow's behaviour classification. Out of the total of 11,800 videos, 75% were randomly allocated as training set and the remaining 25% as validation set. To select motion-related frames, each video was first converted into a multidimensional matrix. Then, PCA was performed on the matrix and a number of component(s) were selected to represent the frame. After that, the frame Euclidean distances were computed based on the components and the frames over a certain distance threshold were selected to generate new videos. Since a different number of components and distance thresholds can affect the number of selected frames, a range of component numbers (1, 2, 3, 5, 10, 20, 50) and distance thresholds were further tested to find the optimal parameters. The best balance between accuracy and performance of the classification was obtained when using 10 components (87.98% of total variation). The best results were obtained when the threshold was set as one fourth of the largest distance between two successive frames. To classify different behaviours, the videos composed of the selected frames were trained and validated with convolutional neural network (CNN) and a long short-term memory (LSTM) models. Using the proposed method, postural behaviours could be classified with accuracies of 95.33% and 92.67% on videos without piglets and all data (including and not including piglets). Furthermore, 500 new videos were selected from the experiment and were used as test set. The final model was further tested on the test set and returned an accuracy of 90.60%, which indicated that the proposed method can be generalized on new data.

agriculture, multidisciplinary,computer science, interdisciplinary applications
Enhanced Camera-Based Individual Pig Detection and Tracking for Smart Pig Farms

Qinghua Guo,Yue Sun,Clemence Orsini,J. Elizabeth Bolhuis,Jakob de Vlieg,Piter Bijma,Peter H. N. de With

DOI: https://doi.org/10.1016/j.compag.2023.108009

IF: 8.3

2023-01-01

Computers and Electronics in Agriculture

Abstract:Negative social interactions are harmful for animal health and welfare. It is increasingly important to employ a continuous and effective monitoring system for detecting and tracking individual animals in large-scale farms. Such a system can provide timely alarms for farmers to intervene when damaging behavior occurs. Deep learning combined with camera-based monitoring is currently arising in agriculture. In this work, deep neural networks are employed to assist individual pig detection and tracking, which enables further analyzing behavior at the individual pig level. First, three state-of-the-art deep learning-based Multi-Object Tracking (MOT) methods are investigated, namely Joint Detection and Embedding (JDE), FairMOT, and YOLOv5s with DeepSORT. All models facilitate automated and continuous individual detection and tracking. Second, weighted-association algorithms are proposed for each MOT method, in order to optimize the object re-identification (re-ID), and improve the individual animal-tracking performance, especially for reducing the number of identity switches. The proposed weighted-association methods are evaluated on a large manually annotated pig dataset, and compared with the state-of-the-art methods. FairMOT with the proposed weighted association achieves the highest IDF1, the least number of identity switches, and the fastest execution rate. YOLOv5s with DeepSORT results in the highest MOTA and MOTP tracking metrics. These methods show high accuracy and robustness for individual pig tracking, and are promising candidates for continuous multi-object tracking for real use in commercial farms.
An Automatic Movement Monitoring Method for Group-Housed Pigs

Ziyuan Liang,Aijun Xu,Junhua Ye,Suyin Zhou,Xiaoxing Weng,Sian Bao

DOI: https://doi.org/10.3390/ani14202985

2024-10-16

Abstract:Continuous movement monitoring helps quickly identify pig abnormalities, enabling immediate action to enhance pig welfare. However, continuous and precise monitoring of daily pig movement on farms remains challenging. We present an approach to automatically and precisely monitor the movement of group-housed pigs. The instance segmentation model YOLOv8m-seg was applied to detect the presence of pigs. We then applied a spatial moment algorithm to quantitatively summarize each detected pig's contour as a corresponding center point. The agglomerative clustering (AC) algorithm was subsequently used to gather the pig center points of a single frame into one point representing the group-housed pigs' position, and the movement volume was obtained by calculating the displacements of the clustered group-housed pigs' center points of consecutive frames. We employed the method to monitor the movement of group-housed pigs from April to July 2023; more than 1500 h of top-down pig videos were recorded by a surveillance camera. The F1 scores of the trained YOLOv8m-seg model during training were greater than 90% across most confidence levels, and the model achieved an mAP50-95 of 0.96. The AC algorithm performs with an average extraction time of less than 1 millisecond; this method can run efficiently on commodity hardware.
GANPose: Pose estimation of grouped pigs using a generative adversarial network

Zehua Wang,Suyin Zhou,Ping Yin,Aijun Xu,Junhua Ye

DOI: https://doi.org/10.1016/j.compag.2023.108119

IF: 8.3

2023-08-09

Computers and Electronics in Agriculture

Abstract:Pose estimation as an effective method for behaviour detection has attracted wide attention in the field of animal health and welfare detection in recent years. Consequently, we can monitor individual pig behaviour changes over time, which will assist in the early detection of disease, allowing for earlier and more effective intervention. However, a real farming scenario with occlusions and opaque pig clustering may be a challenging computer vision problem. Inspired by human vision, we propose GANPose, a grouped pig pose estimation model based on a generative adversarial network (GAN). This model uses the adversarial game to induce the model to learn prior information about the pig's body structure and output a pose with a reasonable skeleton structure. In addition, we also established a new pig pose estimation dataset, which not only included the basic back keypoints but also small keypoints, such as leg, elbow, and tail, as well as challenging occluded keypoints. This work is the study to tackle the occlusion problem, with a finely tuned GAN structure. Experiments and quantitative results on our dataset show that GANPose can detect keypoints of herd pigs with 74.09 % mAP, and the accuracy of the percentage of correct keypoint (PCK) is 11.37 % higher than the benchmark for occluded keypoints, achieving excellent performance in a real pigsty environment.

agriculture, multidisciplinary,computer science, interdisciplinary applications
An Integrated Gather-and-Distribute Mechanism and Attention-Enhanced Deformable Convolution Model for Pig Behavior Recognition

Rui Mao,Dongzhen Shen,Ruiqi Wang,Yiming Cui,Yufan Hu,Mei Li,Meili Wang

DOI: https://doi.org/10.3390/ani14091316

2024-04-28

Animals

Abstract:The behavior of pigs is intricately tied to their health status, highlighting the critical importance of accurately recognizing pig behavior, particularly abnormal behavior, for effective health monitoring and management. This study addresses the challenge of accommodating frequent non-rigid deformations in pig behavior using deformable convolutional networks (DCN) to extract more comprehensive features by incorporating offsets during training. To overcome the inherent limitations of traditional DCN offset weight calculations, the study introduces the multi-path coordinate attention (MPCA) mechanism to enhance the optimization of the DCN offset weight calculation within the designed DCN-MPCA module, further integrated into the cross-scale cross-feature (C2f) module of the backbone network. This optimized C2f-DM module significantly enhances feature extraction capabilities. Additionally, a gather-and-distribute (GD) mechanism is employed in the neck to improve non-adjacent layer feature fusion in the YOLOv8 network. Consequently, the novel DM-GD-YOLO model proposed in this study is evaluated on a self-built dataset comprising 11,999 images obtained from an online monitoring platform focusing on pigs aged between 70 and 150 days. The results show that DM-GD-YOLO can simultaneously recognize four common behaviors and three abnormal behaviors, achieving a precision of 88.2%, recall of 92.2%, and mean average precision (mAP) of 95.3% with 6.0MB Parameters and 10.0G FLOPs. Overall, the model outperforms popular models such as Faster R-CNN, EfficientDet, YOLOv7, and YOLOv8 in monitoring pens with about 30 pigs, providing technical support for the intelligent management and welfare-focused breeding of pigs while advancing the transformation and modernization of the pig industry.

agriculture, dairy & animal science,veterinary sciences
Occlusion-Resistant instance segmentation of piglets in farrowing pens using center clustering network

Endai Huang,Axiu Mao,Junhui Hou,Yongjian Wu,Weitao Xu,Maria Camila Ceballos,Thomas D. Parsons,Kai Liu

DOI: https://doi.org/10.1016/j.compag.2023.107950

IF: 8.3

2023-05-28

Computers and Electronics in Agriculture

Abstract:Computer vision enables the development of new approaches to monitor the behavior, health, and welfare of animals. Instance segmentation is a high-precision method in computer vision for detecting individual animals of interest. This method can be used for in-depth analysis of animals, such as examining their subtle interactive behaviors, from videos and images. However, existing deep-learning-based instance segmentation methods have been mostly developed based on public datasets, which largely omit heavy occlusion problems; therefore, these methods have limitations in real-world applications involving object occlusions, such as farrowing pen systems used on pig farms in which the farrowing crates often impede the sow and piglets. In this paper, we adapt a Center Clustering Network originally designed for counting to achieve instance segmentation, dubbed as CClusnet-Inseg. Specifically, CClusnet-Inseg uses each pixel to predict object centers and trace these centers to form masks based on clustering results, which consists of a network for segmentation and center offset vector map, Density-Based Spatial Clustering of Applications with Noise (DBSCAN) algorithm, Centers-to-Mask (C2M), and Remain-Centers-to-Mask (RC2M) algorithms. In all, 4,600 images were extracted from six videos collected from three closed and three half-open farrowing crates to train and validate our method. CClusnet-Inseg achieves a mean average precision (mAP) of 84.1 and outperforms all other methods compared in this study. We conduct comprehensive ablation studies to demonstrate the advantages and effectiveness of core modules of our method. In addition, we apply CClusnet-Inseg to multi-object tracking for animal monitoring, and the predicted object center that is a conjunct output could serve as an occlusion-resistant representation of the location of an object.

agriculture, multidisciplinary,computer science, interdisciplinary applications

The metabolism of glycine in experimental porphyria.

Deep Learning and Machine Vision Approaches for Posture Detection of Individual Pigs

Pig Postures Recognition Based On VGG19-GNN-SVM

Pig-Posture Recognition Based on Computer Vision: Dataset and Exploration

Efficient Detection Method of Pig-Posture Behavior Based on Multiple Attention Mechanism

Automatic Detection and Segmentation for Group-Housed Pigs Based on PigMS R-CNN

Posture Detection of Individual Pigs Based on Lightweight Convolution Neural Networks and Efficient Channel-Wise Attention

Automatic recognition of lactating sow postures from depth images by deep learning detector

A Deep-Learning-Based System for Pig Posture Classification: Enhancing Sustainable Smart Pigsty Management

[An autopsy case of acute encephalopathy associated with hypertrophy of the inferior olives].

Research on the posture recognition method of suckling sow based on deep learning

Panoptic Instance Segmentation on Pigs

Detection of Pig Movement and Aggression Using Deep Learning Approaches

DigiPig: First Developments of an Automated Monitoring System for Body, Head and Tail Detection in Intensive Pig Farming

Deep learning pose detection model for sow locomotion

A PCA-based frame selection method for applying CNN and LSTM to classify postural behaviour in sows

Enhanced Camera-Based Individual Pig Detection and Tracking for Smart Pig Farms

An Automatic Movement Monitoring Method for Group-Housed Pigs

GANPose: Pose estimation of grouped pigs using a generative adversarial network

An Integrated Gather-and-Distribute Mechanism and Attention-Enhanced Deformable Convolution Model for Pig Behavior Recognition

Occlusion-Resistant instance segmentation of piglets in farrowing pens using center clustering network