Abstract:Tracking the fish is a key step in analyzing fish behavior, evaluating their health levels, and warning of abnormal water quality, so it is of significant importance for intelligent monitoring in fish farming. However, multi-object tracking for fish is a very challenging task due to foam occlusion in the factory tank, high individual similarity, and fast-paced motion of fish. To address the above issues, an online multi-fish tracking model called FishTrack is proposed with 3 branches of target detection, track prediction, and re-identification, which establishes the motion model and appearance model for fish simultaneously, thus achieving the online multi-fish tracking. It is a complete Encoder-Decoder structure and the Pyramid Vision Transformer (PVT) is adopted as the backbone network to extract multi-level features. Then an Encoder is specially designed to encode the historical information of the positions of fish, and automatically update its spatiotemporal information in an autoregressive fashion, to perform the fusion of the spatiotemporal information of fish targets and avoid manual selection of spatiotemporal features. Finally, a parallel dual-Decoder is used to decode the motion and appearance features of fish to reduce the interference of the two optimization directions during the joint model training. The motion cues are first used in linear assignment to reduce the interference of occlusion and deformation issues, and when the motion model fails to track, the appearance cues can recover the identity to deal with long occlusion. The experiments on the established multiple fish tracking dataset showed that the higher order tracking accuracy (HOTA) reached 71.4%, the multi-object tracking accuracy (MOTA) reached 94.8%, the most tracked ratio (MT) reached 93.3%, and the identification F1 score (IDF1) reached 82.5%. The results show that FishTrack can solve the problem of tracking accuracy decrease caused by foam occlusion and fish deformation, and save the inference time by sharing features, increasing the robustness of online multi-fish tracking in factory farming.

Multi-target Tracking of Zebrafish based on Particle Filter

Automated Planar Tracking the Waving Bodies of Multiple Zebrafish Swimming in Shallow Water

Zebrafishtracker3D: A 3D skeleton tracking algorithm for multiple zebrafish based on particle matching

Closed-Loop Tracking-by-Detection for ROV-Based Multiple Fish Tracking

Detection and Tracking of an Underwater Target Using the Combination of A Particle Filter and Track-Before-Detect

A Multi-Target Tracking Platform for Zebrafish Based on Deep Neural Network

A Robust Underwater Multiclass Fish-School Tracking Algorithm

LEARNING-BASED ZEBRAFISH DETECTION AND TRACKING

Automatic Multiple Zebrafish Tracking Based on Improved HOG Features

Zebrafishtracker: A Multi-Zebrafish Tracking Algorithm Can Effectively Solve Cross Occlusion.

Tracking Multiple Zebrafish Larvae Using YOLOv5 and DeepSORT

Exploring the use of deep learning models for accurate tracking of 3D zebrafish trajectories

A fast and effective algorithm to track fish school

FishTrack: Multi-object Tracking Method for Fish Using Spatiotemporal Information Fusion

Fish Trajectory Extraction Based on Object Detection

Automatic Tracking Of Multiple Zebrafish Larvae With Resilience Against Segmentation Errors

An Underwater Multisensor Multitarget Tracking Algorithm Based on Particle Filter

Feature Point Based 3D Tracking of Multiple Fish from Multi-View Images

Tracking Undulatory Body Motion Of Multiple Fish Based On Midline Dynamics Modeling

Improving 3D Zebrafish Tracking with Multi-View Data Fusion and Global Association

DanioSense: Automated High-Throughput Quantification of Zebrafish Larvae Group Movement