Abstract:Developments in automated animal behavioural analysis software are increasing the efficiency of data collection and improving the standardization of behavioural measurements. There are now several open-source tools for tracking laboratory animals, but often these are only accurate under limited conditions (e.g. uniform lighting and background, uncluttered scenes, unobstructed focal animal). Tracking fish presents a particular challenge for these tools because movement at the water's surface introduces significant noise. Partial occlusion of the focal animal can also be troublesome, particularly when tracking the whole organism. But identifying the position of an animal is only part of the task -- analysing the movement of the animal relative to their environment and experimental context is often what provides information about their behaviour. Therefore, the automated detection of physical objects and boundaries would also be beneficial, but this feature is not commonly incorporated into existing tracking software. Here we describe a video processing method that uses a range of computer vision algorithms (e.g. object detector and tracker, optical flow, parallel plane homology) and computational geometry techniques (e.g. Voronoi tessellation) to analyse the movement behaviour of fish in response to experimental stimuli. A behavioural experiment, which involved tracking a fish's trajectory through a field of obstacles, motivated our development of a set of tools that: (1) measure an animal's trajectory, (2) record obstacle position, and (3) detect when the fish passed through 'virtual gates' between adjacent obstacles and/or the aquarium wall. We have introduced a novel Detect+Track approach that significantly enhances the accuracy and robustness of animal tracking, overcoming some of the limitations of existing tools and providing a more reliable solution for complex experimental conditions. Our workflow is divided into several discrete steps, and provides a set of modular software building blocks that can be adapted to analyse other experimental designs. A detailed tutorial is provided, together with all the data and code required to reproduce our results.

Pixying Behavior: A Versatile Real-Time and Post Hoc Automated Optical Tracking Method for Freely Moving and Head Fixed Animals

DeepBhvTracking: A Novel Behavior Tracking Method for Laboratory Animals Based on Deep Learning

Real-time Follow-Up Head Tracking in Dynamic Complex Environments

A Head-Mounted Multi-Camera System for Electrophysiology and Behavior in Freely-Moving Mice

An Easily Compatible Eye-tracking System for Freely-moving Small Animals

Real-Time Selective Markerless Tracking of Forepaws of Head Fixed Mice Using Deep Neural Networks

ezTrack: An open-source video analysis pipeline for the investigation of animal behavior

Multi-camera Realtime 3D Tracking of Multiple Flying Animals

Detect+Track: Robust and flexible software tools for improved tracking and behavioural analysis of fish

High-Precision, Three-Dimensional Tracking of Mouse Whisker Movements with Optical Motion Capture Technology

RpiBeh: a multi-purpose open-source solution for real-time tracking and behavior-driven closed-loop interventions in rodent neuroethology

PrecisionTrack: Reliable Tracking of Large Groups of Animals Interacting in Complex Environments Over Extended Periods

Visual Tracking of Small Animals in Cluttered Natural Environments Using a Freely Moving Camera

AlphaTracker: A Multi-Animal Tracking and Behavioral Analysis Tool

Real-Time Closed-Loop Feedback in Behavioral Time Scales Using DeepLabCut

Millisecond insect tracking system

Image-free real-time 3-D tracking of a fast-moving object using dual-pixel detection

High-resolution in vivo kinematic tracking with injectable fluorescent nanoparticles

A semi-automated method for quantifying optokinetic reflex tracking acuity

Tracking and Behavior Analysis of Group-Housed Pigs Based on a Multi-Object Tracking Approach

A Real-time Multi-Subject Three Dimensional Pose Tracking System for Analyzing Social Behaviors of Non-human Primates