Abstract:Abstract Precision livestock farming applies integrated sensors and information technology to provide individualized animal care in a timely manner. A computer vision system, a non-intrusive and cost-efficient sensor technology, may be useful for monitoring animals to support farm management decisions. While the advancement in camera sensors provides a great opportunity for producers to improve animal health and welfare sustainably, the limited availability of user-friendly image data processing software tools substantially hinders the implementation of computer vision in livestock production systems. The objective of this study was to develop ShinyAnimalCV, which is a Shiny-based interactive animal computer vision web application. This software tool offers a user-friendly graphical user interface for object detection and three-dimensional visualization. The object detection module employs the Mask-RCNN to precisely segment the masks (regions) of the focal animals from two-dimensional images. A Python-based computer vision library OpenCV was used to draw minimum bounding boxes covering the segmented masks for object detection. The three-dimensional visualization module takes the depth map file captured from a top-view three-dimensional camera as an input, which contains the numerical distances between the camera and the objects (animals and background). The depth map file was first converted to a heatmap image, followed by identifying and segmenting the animal from the background using the Mask-RCNN model. The object detection module returns detection results, including the detected animal’s location, class/type, and morphological traits (e.g., body length and width). The visualization module generates a segmented mask to extract the height of the animal from the depth map file, which can be used to interactively visualize the three-dimensional surface of the animal and estimate its morphological traits, including length, width, height, and volume. By integrating these two modules into R Shiny, we deployed ShinyAnimalCV on a cloud server with pre-trained Mask-RCNN models using pig and cattle data to allow users to upload custom data and perform object detection and three-dimensional surface visualization. The features extracted by ShinyAnimalCV are expected to be useful for performing animal identification, feed intake monitoring, body weight predictions, and body condition score estimations. We conclude that the newly developed ShinyAnimalCV could facilitate the application of computer vision in the animal science community.

PET: An Eye-tracking Dataset for Animal-centric PASCAL Object Classes

Categorizing the Visual Environment and Analyzing the Visual Attention of Dogs

CatFLW: Cat Facial Landmarks in the Wild Dataset

An Easily Compatible Eye-tracking System for Freely-moving Small Animals

EgoPet: Egomotion and Interaction Data from an Animal's Perspective

PetFace: A Large-Scale Dataset and Benchmark for Animal Identification

Eye Tracking for Everyone

Gaze-in-wild: A dataset for studying eye and head coordination in everyday activities

AnimalWeb: A Large-Scale Hierarchical Dataset of Annotated Animal Faces

Training pet dogs for eye-tracking and awake fMRI

Automated Detection of Cat Facial Landmarks

DogFLW: Dog Facial Landmarks in the Wild Dataset

OMEG: Oulu Multi-Pose Eye Gaze Dataset.

Efficient Egocentric Visual Perception Combining Eye-tracking, a Software Retina and Deep Learning

Measuring sensitivity to eye gaze cues in naturalistic scenes: Presenting the eye gaze FoCuS database

Gaze2AOI: Open Source Deep-learning Based System for Automatic Area of Interest Annotation with Eye Tracking Data

AlphaTracker: A Multi-Animal Tracking and Behavioral Analysis Tool

Open-set Pets Facial Recognition Using Deep Learning and Statistical Learning

306 Shinyanimalcv: Interactive Web Application for Object Detection and Three-Dimensional Visualization of Animals Using Computer Vision

A Task-Driven Eye Tracking Dataset for Visual Attention Analysis