Abstract:The tracking of various fish species plays a profoundly significant role in understanding the behavior of individual fish and their groups. Present tracking methods suffer from issues of low accuracy or poor robustness. In order to address these concerns, this paper proposes a novel tracking approach, named FishMOT (Fish Multiple Object Tracking). This method combines object detection techniques with the IoU matching algorithm, thereby achieving efficient, precise, and robust fish detection and tracking. Diverging from other approaches, this method eliminates the need for multiple feature extractions and identity assignments for each individual, instead directly utilizing the output results of the detector for tracking, thereby significantly reducing computational time and storage space. Furthermore, this method imposes minimal requirements on factors such as video quality and variations in individual appearance. As long as the detector can accurately locate and identify fish, effective tracking can be achieved. This approach enhances robustness and generalizability. Moreover, the algorithm employed in this method addresses the issue of missed detections without relying on complex feature matching or graph optimization algorithms. This contributes to improved accuracy and reliability. Experimental trials were conducted in the open-source video dataset provided by idtracker.ai, and comparisons were made with state-of-the-art detector-based multi-object tracking methods. Additionally, comparisons were made with idtracker.ai and TRex, two tools that demonstrate exceptional performance in the field of animal tracking. The experimental results demonstrate that the proposed method outperforms other approaches in various evaluation metrics, exhibiting faster speed and lower memory requirements. The source codes and pre-trained models are available at: https://github.com/gakkistar/FishMOT

Robust Tracking of Fish Schools Using CNN for Head Identification

A Robust Underwater Multiclass Fish-School Tracking Algorithm

Closed-Loop Tracking-by-Detection for ROV-Based Multiple Fish Tracking

Multi-class Fish Stock Statistics Technology Based on Object Classification and Tracking Algorithm

Modified Motion Influence Map and Recurrent Neural Network-Based Monitoring of the Local Unusual Behaviors for Fish School in Intensive Aquaculture.

An Effective and Robust Method for Tracking Multiple Fish in Video Image Based on Fish Head Detection

Fish Trajectory Extraction Based on Object Detection

An Automatic Detection and Statistical Method for Underwater Fish Based on Foreground Region Convolution Network (FR-CNN)

Online Fish Tracking with Portable Smart Device for Ocean Observatory Network

Research on A Binocular Fish Dimension Measurement Method Based on Instance Segmentation and Fish Tracking

Embedded Online Fish Detection and Tracking System Via YOLOv3 and Parallel Correlation Filter

Fish Keypoints Detection for Ecology Monitoring Based on Underwater Visual Intelligence

Accurate Fish Detection under Marine Background Noise Based on the Retinex Enhancement Algorithm and CNN

Automatically Detect and Track Multiple Fish Swimming in Shallow Water with Frequent Occlusion.

Tracking Undulatory Body Motion Of Multiple Fish Based On Midline Dynamics Modeling

A Fish Detection and Tracking Method Based on Improved Interframe Difference and YOLO-CTS

3D Tracking Swimming Fish School with Learned Kinematic Model Using LSTM Network.

Zebrafish Tracking Using Convolutional Neural Networks

Visual Tracking of Multiple Robotic Fish for Cooperative Control

FishMOT: A Simple and Effective Method for Fish Tracking Based on IoU Matching

Feature Point Based 3D Tracking of Multiple Fish from Multi-View Images