Abstract:The study of fish behavior lays an important foundation for comprehending of fish migration routes,improving fishing efficiency and the protection of fishery resources.A large number of data are necessary in the study,such as stress response,cluster,migration and other measured data.However,getting these data is a time-consuming process.As fish behavior is often recorded in the form of video and a stereo camera recording system is popularly used for measurement and observation in the laboratory study,how to extract the data of fish behavior efficiently from the video has been a major problem in the study of fish behavior.By far fish 3D coordinate is usually calculated by hand,or by self made software which turns an importing fish 2D coordinate into a 3D one.In order to improve fish behavior data extraction efficiency,this paper presents an automated 3D fish tracking method based on a single video camera.A waterproof mirror was set above the experimental aquaria to simulate a camera shooting from the top,which provided a way to use a single camera for 3D imaging.We extract the data of fish behavior automatically by 3D fish tracking method which is divided into four parts: distortion calibration of single camera system,transfer formula between image coordinate to world coordinate,the automated tracking algorithm of fish movement and the automated output of fish behavior 2D and 3D data.Tests find out that while the distance between the camera and the aquaria is 1.5 m,the distortion calibration result shows the pixel error is much more acceptable which is about 0.1 pixels.As the camera tilted slightly during the experiment,the shape of the aquaria in the images changed.So based on the processing of Free-Form Deformation,the deformation of images is rectified during coordinate transform process.Then we implemented the algorithm of Interacting Multiple Model Joint Probabilistic Data Association(IMMJPDA) to automatically track fishes in 3D and output fish behavior data.The result of 6 Hemigrammus rhodostomus tracking experiment shows that: IMMJPDA algorithm can deal with the key issues during fish tracking system,which enables the method to extract individual fish from video images,construct their tracks,output 3D positions and speeds,and finally generate a complete 3D movement track drawing for fish behavior analysis.In a dense clutter situation JPDA requires a fairly large amount of computation to evaluate the joint probabilities.We combined Nearest Neighbor algorithm and JPDA algorithm to reduce the computational burden.

LEARNING-BASED ZEBRAFISH DETECTION AND TRACKING

Automated Planar Tracking the Waving Bodies of Multiple Zebrafish Swimming in Shallow Water

A Robust Underwater Multiclass Fish-School Tracking Algorithm

Closed-Loop Tracking-by-Detection for ROV-Based Multiple Fish Tracking

Multi-target Tracking of Zebrafish based on Particle Filter

Modified Motion Influence Map and Recurrent Neural Network-Based Monitoring of the Local Unusual Behaviors for Fish School in Intensive Aquaculture.

Fish Keypoints Detection for Ecology Monitoring Based on Underwater Visual Intelligence

Exploring the use of deep learning models for accurate tracking of 3D zebrafish trajectories

Zebrafishtracker3D: A 3D skeleton tracking algorithm for multiple zebrafish based on particle matching

Multi-class Fish Stock Statistics Technology Based on Object Classification and Tracking Algorithm

Tracking Undulatory Body Motion Of Multiple Fish Based On Midline Dynamics Modeling

Fish Trajectory Extraction Based on Object Detection

An Effective and Robust Method for Tracking Multiple Fish in Video Image Based on Fish Head Detection

Automatic Tracking Of Multiple Zebrafish Larvae With Resilience Against Segmentation Errors

Detect+Track: Robust and flexible software tools for improved tracking and behavioural analysis of fish

Automatically Detect and Track Multiple Fish Swimming in Shallow Water with Frequent Occlusion.

Preliminary studies on an automated 3D fish tracking method based on a single video camera

Visual Tracking of Multiple Robotic Fish for Cooperative Control

Improving 3D Zebrafish Tracking with Multi-View Data Fusion and Global Association

Zebrafish Tracking Using Convolutional Neural Networks

Robust Tracking of Fish Schools Using CNN for Head Identification