Abstract:Behavioral analysis of macaques provides important experimental evidence in the field of neuroscience. In recent years, video-based automatic animal behavior analysis has received widespread attention. However, methods capable of extracting and analyzing daily movement trajectories of macaques in their daily living cages remain underdeveloped, with previous approaches usually requiring specific environments to reduce interference from occlusion or environmental change. Here, we introduce a novel method, called MonkeyTrail, which satisfies the above requirements by frequently generating virtual empty backgrounds and using background subtraction to accurately obtain the foreground of moving animals. The empty background is generated by combining the frame difference method (FDM) and deep learning-based model (YOLOv5). The entire setup can be operated with low-cost hardware and can be applied to the daily living environments of individually caged macaques. To test MonkeyTrail performance, we labeled a dataset containing >8 000 video frames with the bounding boxes of macaques under various conditions as ground-truth. Results showed that the tracking accuracy and stability of MonkeyTrail exceeded that of two deep learning-based methods (YOLOv5 and Single-Shot MultiBox Detector), traditional frame difference method, and naive background subtraction method. Using MonkeyTrail to analyze long-term surveillance video recordings, we successfully assessed changes in animal behavior in terms of movement amount and spatial preference. Thus, these findings demonstrate that MonkeyTrail enables low-cost, large-scale daily behavioral analysis of macaques.

MacAction: Realistic 3D macaque body animation based on multi-camera markerless motion capture

MacaquePose: A Novel “In the Wild” Macaque Monkey Pose Dataset for Markerless Motion Capture

MonkeyTrail: A Scalable Video-Based Method for Tracking Macaque Movement Trajectory in Daily Living Cages.

MonkeyPosekit: Automated Markerless 2D Pose Estimation of Monkey

A Real-time Multi-Subject Three Dimensional Pose Tracking System for Analyzing Social Behaviors of Non-human Primates

A Naturalistic Dynamic Monkey Head Avatar Elicits Species-Typical Reactions and Overcomes the Uncanny Valley

Real-time Expressive Avatar Animation Generation Based on Monocular Videos.

Expressive Whole-Body 3D Gaussian Avatar

DeepLabCut: markerless pose estimation of user-defined body parts with deep learning

AvatarPoser: Articulated Full-Body Pose Tracking from Sparse Motion Sensing

AvatarPose: Avatar-guided 3D Pose Estimation of Close Human Interaction from Sparse Multi-view Videos

Towards smarter animated embodied agents

Letters: Avatar motion control by natural body movement via camera

Physics-based Motion Retargeting from Sparse Inputs

Towards Accurate Markerless Human Shape and Pose Estimation over Time

General Automatic Human Shape and Motion Capture Using Volumetric Contour Cues

AvatarWild: Fully Controllable Head Avatars in the Wild

Active vision in freely moving marmosets using head-mounted eye tracking

Markerless Body Motion Capturing for 3D Character Animation based on Multi-view Cameras

Deep-Learning-Based Motion Capture Technology in Film and Television Animation Production

RAM-Avatar: Real-time Photo-Realistic Avatar from Monocular Videos with Full-body Control