Abstract:Posture and the rate of postural changes of farrowing and lactating sows are considered reliable indicators of environmental comfort and health status and are risk factors for piglet crushing. The objective of this study was to develop a combined deep learning and principle component analysis (PCA) based approach to classify different postural behaviours of sows in videos. Compared to previous studies of sow's postural behaviour classification based on deep learning, this study selects sequences of frames from the videos that distinguish different postural behaviours rather than using all frames for the classification. Videos were collected from 13 sows, and the recording started from 5 days before the expected date of farrowing until weaning. From the videos, 3100 videos without piglets and 1680 including piglets were manually selected. Then, these videos were augmented by using vertical mirroring and adding Gaussian noise, which resulted in 7200 and 4600 videos without and including piglets, respectively. Each video lasted 5 sec and included 1 out of 5 behavioural postures (sternal lying, lateral lying, sitting, standing, walking) labelled by one trained expert with extensive experience in sow's behaviour classification. Out of the total of 11,800 videos, 75% were randomly allocated as training set and the remaining 25% as validation set. To select motion-related frames, each video was first converted into a multidimensional matrix. Then, PCA was performed on the matrix and a number of component(s) were selected to represent the frame. After that, the frame Euclidean distances were computed based on the components and the frames over a certain distance threshold were selected to generate new videos. Since a different number of components and distance thresholds can affect the number of selected frames, a range of component numbers (1, 2, 3, 5, 10, 20, 50) and distance thresholds were further tested to find the optimal parameters. The best balance between accuracy and performance of the classification was obtained when using 10 components (87.98% of total variation). The best results were obtained when the threshold was set as one fourth of the largest distance between two successive frames. To classify different behaviours, the videos composed of the selected frames were trained and validated with convolutional neural network (CNN) and a long short-term memory (LSTM) models. Using the proposed method, postural behaviours could be classified with accuracies of 95.33% and 92.67% on videos without piglets and all data (including and not including piglets). Furthermore, 500 new videos were selected from the experiment and were used as test set. The final model was further tested on the test set and returned an accuracy of 90.60%, which indicated that the proposed method can be generalized on new data.

Research on the posture recognition method of suckling sow based on deep learning

Automatic recognition of lactating sow postures from depth images by deep learning detector

Pig Postures Recognition Based On VGG19-GNN-SVM

Behavior Recognition and Maternal Ability Evaluation for Sows Based on Triaxial Acceleration and Video Sensors

Pig-Posture Recognition Based on Computer Vision: Dataset and Exploration

Deep Learning and Machine Vision Approaches for Posture Detection of Individual Pigs

Automatic detection of sow posture and estrus based on convolutional neural network

Sow Posture Analysis and Estrus Prediction Using Closed-Circuit Television Cameras

Behaviors Detection of Pregnant Sows Based on Deep Learning

A PCA-based frame selection method for applying CNN and LSTM to classify postural behaviour in sows

Efficient Detection Method of Pig-Posture Behavior Based on Multiple Attention Mechanism

Posture Detection of Individual Pigs Based on Lightweight Convolution Neural Networks and Efficient Channel-Wise Attention

Analysis of pig posture detection in group-housed pigs using deep learning-based mask scoring instance segmentation

A Deep-Learning-Based System for Pig Posture Classification: Enhancing Sustainable Smart Pigsty Management

A deep learning-based approach for feeding behavior recognition of weanling pigs

Deep learning pose detection model for sow locomotion

An Integrated Gather-and-Distribute Mechanism and Attention-Enhanced Deformable Convolution Model for Pig Behavior Recognition

Detection of Pig Movement and Aggression Using Deep Learning Approaches

Automated Video Behavior Recognition of Pigs Using Two-Stream Convolutional Networks

Towards automatic farrowing monitoring-A Noisy Student approach for improving detection performance of newborn piglets

Multicow pose estimation based on keypoint extraction