Abstract:Developments in automated animal behavioural analysis software are increasing the efficiency of data collection and improving the standardization of behavioural measurements. There are now several open-source tools for tracking laboratory animals, but often these are only accurate under limited conditions (e.g. uniform lighting and background, uncluttered scenes, unobstructed focal animal). Tracking fish presents a particular challenge for these tools because movement at the water's surface introduces significant noise. Partial occlusion of the focal animal can also be troublesome, particularly when tracking the whole organism. But identifying the position of an animal is only part of the task -- analysing the movement of the animal relative to their environment and experimental context is often what provides information about their behaviour. Therefore, the automated detection of physical objects and boundaries would also be beneficial, but this feature is not commonly incorporated into existing tracking software. Here we describe a video processing method that uses a range of computer vision algorithms (e.g. object detector and tracker, optical flow, parallel plane homology) and computational geometry techniques (e.g. Voronoi tessellation) to analyse the movement behaviour of fish in response to experimental stimuli. A behavioural experiment, which involved tracking a fish's trajectory through a field of obstacles, motivated our development of a set of tools that: (1) measure an animal's trajectory, (2) record obstacle position, and (3) detect when the fish passed through 'virtual gates' between adjacent obstacles and/or the aquarium wall. We have introduced a novel Detect+Track approach that significantly enhances the accuracy and robustness of animal tracking, overcoming some of the limitations of existing tools and providing a more reliable solution for complex experimental conditions. Our workflow is divided into several discrete steps, and provides a set of modular software building blocks that can be adapted to analyse other experimental designs. A detailed tutorial is provided, together with all the data and code required to reproduce our results.

Recent Advances of Target Tracking Applications in Aquaculture with Emphasis on Fish

A Robust Underwater Multiclass Fish-School Tracking Algorithm

A Survey of Fish Tracking Techniques Based on Computer Vision

A Review of Computer Vision Technologies for Fish Tracking

Multi-class Fish Stock Statistics Technology Based on Object Classification and Tracking Algorithm

Closed-Loop Tracking-by-Detection for ROV-Based Multiple Fish Tracking

Modified Motion Influence Map and Recurrent Neural Network-Based Monitoring of the Local Unusual Behaviors for Fish School in Intensive Aquaculture.

Fish Tracking, Counting, and Behaviour Analysis in Digital Aquaculture: A Comprehensive Review

FishTrack: Multi-object Tracking Method for Fish Using Spatiotemporal Information Fusion

Fish Trajectory Extraction Based on Object Detection

Aquatic Toxic Analysis by Monitoring Fish Behavior Using Computer Vision: A Recent Progress

A Real Time Video Object Tracking Method for Fish

Fish Target Detection and Speed Estimation Method Based on Computer Vision

Computer Vision Models in Intelligent Aquaculture with Emphasis on Fish Detection and Behavior Analysis: A Review

Application of Deep Learning-Based Object Detection Techniques in Fish Aquaculture: A Review

FishMOT: A Simple and Effective Method for Fish Tracking Based on IoU Matching

Recent advances of deep learning algorithms for aquacultural machine vision systems with emphasis on fish

Real-Time Underwater Fish Tracking Based on Adaptive Multi-Appearance Model

SiamFCA: A new fish single object tracking method based on siamese network with coordinate attention in aquaculture

A Multi-Target Tracking Platform for Zebrafish Based on Deep Neural Network

Detect+Track: Robust and flexible software tools for improved tracking and behavioural analysis of fish