Abstract:Zebrafish are ideal model organisms for various fields of biological research, including genetics, neural transmission patterns, disease and drug testing, and heart disease studies, because of their unique ability to regenerate cardiac muscle. Tracking zebrafish trajectories is essential for understanding their behavior, physiological states, and disease associations. While 2D tracking methods are limited, 3D tracking provides more accurate descriptions of their movements, leading to a comprehensive understanding of their behavior. In this study, we used deep learning models to track the 3D movements of zebrafish. Videos were captured by two custom-made cameras, and 21,360 images were labeled for the dataset. The YOLOv7 model was trained using hyperparameter tuning, with the top- and side-view camera models trained using the v7x.pt and v7.pt weights, respectively, over 300 iterations with 10,680 data points each. The models achieved impressive results, with an accuracy of 98.7% and a recall of 98.1% based on the test set. The collected data were also used to generate dynamic 3D trajectories. Based on a test set with 3,632 3D coordinates, the final model detected 173.11% more coordinates than the initial model. Compared to the ground truth, the maximum and minimum errors decreased by 97.39% and 86.36%, respectively, and the average error decreased by 90.5%.This study presents a feasible 3D tracking method for zebrafish trajectories. The results can be used for further analysis of movement-related behavioral data, contributing to experimental research utilizing zebrafish.

Tracking Undulatory Body Motion Of Multiple Fish Based On Midline Dynamics Modeling

Closed-Loop Tracking-by-Detection for ROV-Based Multiple Fish Tracking

Automated Planar Tracking the Waving Bodies of Multiple Zebrafish Swimming in Shallow Water

A Robust Underwater Multiclass Fish-School Tracking Algorithm

Online Fish Tracking with Portable Smart Device for Ocean Observatory Network

An Effective and Robust Method for Tracking Multiple Fish in Video Image Based on Fish Head Detection

Tracking Full-Body Motion of Multiple Fish with Midline Subspace Constrained Multicue Optimization

Motion Control For A Multi-Joint Robotic Fish With The Pectoral Fins Assistance

3D Tracking Swimming Fish School with Learned Kinematic Model Using LSTM Network.

Motion Control of a Multi-Joint Robotic Fish Based on Biomimetic Learning

Bionic Artificial Lateral Line Underwater Localization Based on the Neural Network Method

Multi-class Fish Stock Statistics Technology Based on Object Classification and Tracking Algorithm

Robust Tracking of Fish Schools Using CNN for Head Identification

Fish Trajectory Extraction Based on Object Detection

LEARNING-BASED ZEBRAFISH DETECTION AND TRACKING

Automatically Detect and Track Multiple Fish Swimming in Shallow Water with Frequent Occlusion.

Exploring the use of deep learning models for accurate tracking of 3D zebrafish trajectories

Underwater Fish Tracking for Moving Cameras based on Deformable Multiple Kernels

Multi-target Tracking of Zebrafish based on Particle Filter

Simultaneous Measurement of the Position and Body Deformation of A Swimming Fish by A Video Tracking System

Visual Tracking of Multiple Robotic Fish for Cooperative Control