Abstract:Automated monitoring of pigs for timely detection of changes in behavior and the onset of tail biting might enable farmers to take immediate management actions, and thus decrease health and welfare issues on-farm. Our goal was to develop computer vision-based methods to detect tail biting in pigs using a convolutional neural network (CNN) to extract spatial information, combined with secondary networks accounting for temporal information. Two secondary frameworks were utilized, being a long short-term memory (LSTM) network applied to sequences of image features (CNN-LSTM), and a CNN applied to image representations of sequences (CNN-CNN). To achieve our goal, this study aimed to answer the following questions: (a) Can the methods detect tail biting from video recordings of entire pens? (b) Can we utilize principal component analyses (PCA) to reduce the dimensionality of the feature vector and only use relevant principal components (PC)? (c) Is there potential to increase performance in optimizing the threshold for class separation of the predicted probabilities of the outcome? (d) What is the performance of the methods with respect to each other? The study utilized one-hour video recordings of 10 pens with pigs prior to weaning, containing a total of 208 tail-biting events of varying lengths. The pre-trained VGG-16 was used to extract spatial features from the data, which were subsequently pre-processed and divided into train/test sets before input to the LSTM/CNN. The performance of the methods regarding data pre-processing and model building was systematically compared using cross-validation. Final models were run with optimal settings and evaluated on an independent test-set. The proposed methods detected tail biting with a major-mean accuracy (MMA) of 71.3 and 64.7% for the CNN-LSTM and the CNN-CNN network, respectively. Applying PCA and using a limited number of PCs significantly increased the performance of both methods, while optimizing the threshold for class separation did result in a consistent but not significant increase of the performance. Both methods can detect tail biting from video data, but the CNN-LSTM was superior in generalizing when evaluated on new data, i.e., data not used for training the models, compared to the CNN-CNN method.

Automatic Recognition of Aggressive Behavior in Pigs Using a Kinect Depth Sensor

Detection of Aggressive Behaviours in Pigs Using a RealSence Depth Sensor

Detection of Pig Movement and Aggression Using Deep Learning Approaches

Efficient Aggressive Behavior Recognition of Pigs Based on Temporal Shift Module

Automatic Individual Pig Detection and Tracking in Pig Farms

Automatic Detection of Locomotor Play in Young Pigs: A Proof of Concept

A Computer Vision-Based Method for Spatial-Temporal Action Recognition of Tail-Biting Behaviour in Group-Housed Pigs

Enhanced Camera-Based Individual Pig Detection and Tracking for Smart Pig Farms

Detecting Animal Contacts—A Deep Learning-Based Pig Detection and Tracking Approach for the Quantification of Social Contacts

Pattern Mining-Based Pig Behavior Analysis for Health and Welfare Monitoring

Automatic individual pig detection and tracking in surveillance videos

Tracking and Behavior Analysis of Group-Housed Pigs Based on a Multi-Object Tracking Approach

Automated Video Behavior Recognition of Pigs Using Two-Stream Convolutional Networks

An Integrated Gather-and-Distribute Mechanism and Attention-Enhanced Deformable Convolution Model for Pig Behavior Recognition

An Automatic Movement Monitoring Method for Group-Housed Pigs

Automatic monitoring and detection of tail-biting behavior in groups of pigs using video-based deep learning methods

Where's Your Head At? Detecting the Orientation and Position of Pigs with Rotated Bounding Boxes

GAN-Based Video Denoising with Attention Mechanism for Field-Applicable Pig Detection System

DigiPig: First Developments of an Automated Monitoring System for Body, Head and Tail Detection in Intensive Pig Farming

Efficient Pig Counting in Crowds with Keypoints Tracking and Spatial-aware Temporal Response Filtering

YOLOv5-KCB: A New Method for Individual Pig Detection Using Optimized K-Means, CA Attention Mechanism and a Bi-Directional Feature Pyramid Network