Abstract:In the pig farming environment, complex factors such as pig adhesion, occlusion, and changes in body posture pose significant challenges for segmenting multiple target pigs. To address these challenges, this study collected video data using a horizontal angle of view and a non-fixed lens. Specifically, a total of 45 pigs aged 20-105 days in 8 pens were selected as research subjects, resulting in 1917 labeled images. These images were divided into 959 for training, 192 for validation, and 766 for testing. The grouped attention module was employed in the feature pyramid network to fuse the feature maps from deep and shallow layers. The grouped attention module consists of a channel attention branch and a spatial attention branch. The channel attention branch effectively models dependencies between channels to enhance feature mapping between related channels and improve semantic feature representation. The spatial attention branch establishes pixel-level dependencies by applying the response values of all pixels in a single-channel feature map to the target pixel. It further guides the original feature map to filter spatial location information and generate context-related outputs. The grouped attention, along with data augmentation strategies, was incorporated into the Mask R-CNN and Cascade Mask R-CNN task networks to explore their impact on pig segmentation. The experiments showed that introducing data augmentation strategies improved the segmentation performance of the model to a certain extent. Taking Mask-RCNN as an example, under the same experimental conditions, the introduction of data augmentation strategies resulted in improvements of 1.5%, 0.7%, 0.4%, and 0.5% in metrics AP50, AP75, APL, and AP, respectively. Furthermore, our grouped attention module achieved the best performance. For example, compared to the existing attention module CBAM, taking Mask R-CNN as an example, in terms of the metric AP50, AP75, APL, and AP, the grouped attention outperformed 1.0%, 0.3%, 1.1%, and 1.2%, respectively. We further studied the impact of the number of groups in the grouped attention on the final segmentation results. Additionally, visualizations of predictions on third-party data collected using a top-down data acquisition method, which was not involved in the model training, demonstrated that the proposed model in this paper still achieved good segmentation results, proving the transferability and robustness of the grouped attention. Through comprehensive analysis, we found that grouped attention is beneficial for achieving high-precision segmentation of individual pigs in different scenes, ages, and time periods. The research results can provide references for subsequent applications such as pig identification and behavior analysis in mobile settings.

Recognition of Aggressive Behavior of Group-Housed Pigs Based on CNN-GRU Hybrid Model with Spatio-Temporal Attention Mechanism

Efficient Aggressive Behavior Recognition of Pigs Based on Temporal Shift Module

Detection of Pig Movement and Aggression Using Deep Learning Approaches

An Integrated Gather-and-Distribute Mechanism and Attention-Enhanced Deformable Convolution Model for Pig Behavior Recognition

Automated Video Behavior Recognition of Pigs Using Two-Stream Convolutional Networks

A Computer Vision-Based Method for Spatial-Temporal Action Recognition of Tail-Biting Behaviour in Group-Housed Pigs

Pig aggression classification using CNN, Transformers and Recurrent Networks

Detection of Aggressive Behaviours in Pigs Using a RealSence Depth Sensor

Spatio-Temporal-Based Identification of Aggressive Behavior in Group Sheep

Automatic Recognition of Aggressive Behavior in Pigs Using a Kinect Depth Sensor

An Automatic Movement Monitoring Method for Group-Housed Pigs

A Spatiotemporal Convolutional Network for Multi-Behavior Recognition of Pigs

Feeding behavior recognition for group-housed pigs with the Faster R-CNN

An Image Detection Model for Aggressive Behavior of Group Sheep

Efficient Detection Method of Pig-Posture Behavior Based on Multiple Attention Mechanism

Tracking and Behavior Analysis of Group-Housed Pigs Based on a Multi-Object Tracking Approach

A Recognition Method for Aggressive Chicken Behavior Based on Machine Learning

Automatic monitoring and detection of tail-biting behavior in groups of pigs using video-based deep learning methods

Attention-Guided Instance Segmentation for Group-Raised Pigs

Deep learning-based hierarchical cattle behavior recognition with spatio-temporal information

Top-view recognition of individual group-housed pig based on Isomap and SVM