Abstract:Tracking the fish is a key step in analyzing fish behavior, evaluating their health levels, and warning of abnormal water quality, so it is of significant importance for intelligent monitoring in fish farming. However, multi-object tracking for fish is a very challenging task due to foam occlusion in the factory tank, high individual similarity, and fast-paced motion of fish. To address the above issues, an online multi-fish tracking model called FishTrack is proposed with 3 branches of target detection, track prediction, and re-identification, which establishes the motion model and appearance model for fish simultaneously, thus achieving the online multi-fish tracking. It is a complete Encoder-Decoder structure and the Pyramid Vision Transformer (PVT) is adopted as the backbone network to extract multi-level features. Then an Encoder is specially designed to encode the historical information of the positions of fish, and automatically update its spatiotemporal information in an autoregressive fashion, to perform the fusion of the spatiotemporal information of fish targets and avoid manual selection of spatiotemporal features. Finally, a parallel dual-Decoder is used to decode the motion and appearance features of fish to reduce the interference of the two optimization directions during the joint model training. The motion cues are first used in linear assignment to reduce the interference of occlusion and deformation issues, and when the motion model fails to track, the appearance cues can recover the identity to deal with long occlusion. The experiments on the established multiple fish tracking dataset showed that the higher order tracking accuracy (HOTA) reached 71.4%, the multi-object tracking accuracy (MOTA) reached 94.8%, the most tracked ratio (MT) reached 93.3%, and the identification F1 score (IDF1) reached 82.5%. The results show that FishTrack can solve the problem of tracking accuracy decrease caused by foam occlusion and fish deformation, and save the inference time by sharing features, increasing the robustness of online multi-fish tracking in factory farming.

A Few Samples Underwater Fish Tracking Method Based on Semi-supervised and Attention Mechanism

A Robust Underwater Multiclass Fish-School Tracking Algorithm

Fish Keypoints Detection for Ecology Monitoring Based on Underwater Visual Intelligence

Research on Underwater Small Target Detection Algorithm Based on Improved YOLOv3

Modified Motion Influence Map and Recurrent Neural Network-Based Monitoring of the Local Unusual Behaviors for Fish School in Intensive Aquaculture.

Research on A Binocular Fish Dimension Measurement Method Based on Instance Segmentation and Fish Tracking

Multi-class Fish Stock Statistics Technology Based on Object Classification and Tracking Algorithm

A Real Time Video Object Tracking Method for Fish

Closed-Loop Tracking-by-Detection for ROV-Based Multiple Fish Tracking

Recent Advances of Target Tracking Applications in Aquaculture with Emphasis on Fish

A Fish Detection and Tracking Method Based on Improved Interframe Difference and YOLO-CTS

FishMOT: A Simple and Effective Method for Fish Tracking Based on IoU Matching

Fish Behavior Tracking Algorithm Based on Multi-Domain Deep Convolutional Neural Network

Fish-Finder: A Robust Small Target Detection Method for Aquaculture Fish in Low-Quality Underwater Images.

An Algorithm for Tracking Multiple Fish Based on Biological Water Quality Monitoring

SiamFCA: A new fish single object tracking method based on siamese network with coordinate attention in aquaculture

Online 3D Behavioral Tracking of Aquatic Model Organism with a Dual-Camera System

Real-Time Underwater Fish Tracking Based on Adaptive Multi-Appearance Model

FishTrack: Multi-object Tracking Method for Fish Using Spatiotemporal Information Fusion

A CNN-Based Semi-supervised Self-training Method for Robust Underwater Fish Recognition

A video object segmentation-based fish individual recognition method for underwater complex environments