Abstract:Studying animal behaviour allows us to understand how different species and individuals navigate their physical and social worlds. Video coding of behaviour is considered a gold standard: allowing researchers to extract rich nuanced behavioural datasets, validate their reliability, and for research to be replicated. However, in practice, videos are only useful if data can be efficiently extracted. Manually locating relevant footage in 10,000 s of hours is extremely time-consuming, as is the manual coding of animal behaviour, which requires extensive training to achieve reliability. Machine learning approaches are used to automate the recognition of patterns within data, considerably reducing the time taken to extract data and improving reliability. However, tracking visual information to recognise nuanced behaviour is a challenging problem and, to date, the tracking and pose-estimation tools used to detect behaviour are typically applied where the visual environment is highly controlled. Animal behaviour researchers are interested in applying these tools to the study of wild animals, but it is not clear to what extent doing so is currently possible, or which tools are most suited to particular problems. To address this gap in knowledge, we describe the new tools available in this rapidly evolving landscape, suggest guidance for tool selection, provide a worked demonstration of the use of machine learning to track movement in video data of wild apes, and make our base models available for use. We use a pose-estimation tool, DeepLabCut, to demonstrate successful training of two pilot models of an extremely challenging pose estimate and tracking problem: multi-animal wild forest-living chimpanzees and bonobos across behavioural contexts from hand-held video footage. With DeepWild we show that, without requiring specific expertise in machine learning, pose estimation and movement tracking of free-living wild primates in visually complex environments is an attainable goal for behavioural researchers.

WildPose: A Long-Range 3D Wildlife Motion Capture System

Motion Parameters Measurement of User-Defined Key Points Using 3D Pose Estimation

Peering into the world of wild passerines with 3D-SOCS: synchronized video capture and posture estimation

3D-POP -- An automated annotation approach to facilitate markerless 2D-3D tracking of freely moving birds with marker-based motion capture

DeepWild: Application of the pose estimation tool DeepLabCut for behaviour tracking in wild chimpanzees and bonobos

3D for the people: multi-camera motion capture in the field with consumer-grade cameras and open source software

A Real-time Multi-Subject Three Dimensional Pose Tracking System for Analyzing Social Behaviors of Non-human Primates

Protocol to record and analyze primate leaping in three dimensions in the wild

Three-dimensional Surface Motion Capture of Multiple Freely Moving Pigs Using MAMMAL.

Movement-Based Estimation and Visualization of Space Use in 3D for Wildlife Ecology and Conservation

Whole-Herd Elephant Pose Estimation from Drone Data for Collective Behavior Analysis

ConservationBots: Autonomous aerial robot for fast robust wildlife tracking in complex terrains

Towards Long-term Robotics in the Wild

3D Human Reconstruction in the Wild with Collaborative Aerial Cameras

Social Behavior Atlas: A computational framework for tracking and mapping 3D close interactions of free-moving animals

BuckTales : A multi-UAV dataset for multi-object tracking and re-identification of wild antelopes

Multi-animal 3D Social Pose Estimation, Identification and Behaviour Embedding with a Few-Shot Learning Framework

ZooBuilder: 2D and 3D Pose Estimation for Quadrupeds Using Synthetic Data

Automatically identifying, counting, and describing wild animals in camera-trap images with deep learning

Benchmarking Monocular 3D Dog Pose Estimation Using In-The-Wild Motion Capture Data

High-resolution, non-invasive animal tracking and reconstruction of local environment in aquatic ecosystems