Abstract:The study of fish behavior lays an important foundation for comprehending of fish migration routes,improving fishing efficiency and the protection of fishery resources.A large number of data are necessary in the study,such as stress response,cluster,migration and other measured data.However,getting these data is a time-consuming process.As fish behavior is often recorded in the form of video and a stereo camera recording system is popularly used for measurement and observation in the laboratory study,how to extract the data of fish behavior efficiently from the video has been a major problem in the study of fish behavior.By far fish 3D coordinate is usually calculated by hand,or by self made software which turns an importing fish 2D coordinate into a 3D one.In order to improve fish behavior data extraction efficiency,this paper presents an automated 3D fish tracking method based on a single video camera.A waterproof mirror was set above the experimental aquaria to simulate a camera shooting from the top,which provided a way to use a single camera for 3D imaging.We extract the data of fish behavior automatically by 3D fish tracking method which is divided into four parts: distortion calibration of single camera system,transfer formula between image coordinate to world coordinate,the automated tracking algorithm of fish movement and the automated output of fish behavior 2D and 3D data.Tests find out that while the distance between the camera and the aquaria is 1.5 m,the distortion calibration result shows the pixel error is much more acceptable which is about 0.1 pixels.As the camera tilted slightly during the experiment,the shape of the aquaria in the images changed.So based on the processing of Free-Form Deformation,the deformation of images is rectified during coordinate transform process.Then we implemented the algorithm of Interacting Multiple Model Joint Probabilistic Data Association(IMMJPDA) to automatically track fishes in 3D and output fish behavior data.The result of 6 Hemigrammus rhodostomus tracking experiment shows that: IMMJPDA algorithm can deal with the key issues during fish tracking system,which enables the method to extract individual fish from video images,construct their tracks,output 3D positions and speeds,and finally generate a complete 3D movement track drawing for fish behavior analysis.In a dense clutter situation JPDA requires a fairly large amount of computation to evaluate the joint probabilities.We combined Nearest Neighbor algorithm and JPDA algorithm to reduce the computational burden.

Three-dimensional computer graphic animations for studying social approach behaviour in medaka fish: Effects of systematic manipulation of morphological and motion cues

Attraction of posture and motion-trajectory elements of conspecific biological motion in medaka fish

Spatial Behavioral Characteristics and Statistics-Based Kinetic Energy Modeling in Special Behaviors Detection of a Shoal of Fish in a Recirculating Aquaculture System.

The virtual lover: variable and easily guided 3D fish animations as an innovative tool in mate-choice experiments with sailfin mollies-II. Validation

Assessment of behaviour in groups of zebrafish (Danio rerio) using an intelligent software monitoring tool, the chromatic fish analyser

Characterizing medaka visual features using a high-throughput optomotor response assay

Molecular basis of social competence in medaka fish

Fish Can Save Energy Via Proprioceptive Sensing.

Chemical and Visual Cues as Modulators of the Stress Response to Social Isolation in the Marine Medaka, Oryzias melastigma

Behavioral effects of visual stimuli in adult zebrafish using a novel eight-tank imaging system

An assistive computer vision tool to automatically detect changes in fish behavior in response to ambient odor

Can red sea bream Pagrus major learn about feeding and avoidance through the observation of conspecific behavior in video playback?

Preliminary studies on an automated 3D fish tracking method based on a single video camera

A novel 3D method of locomotor analysis in adult zebrafish: Implications for automated detection of CNS drug-evoked phenotypes

Interspecies Behavioral Variability of Medaka Fish Assessed by Comparative Phenomics

Divergent Visuomotor Strategies in Teleosts: Neural Circuit Mechanisms in Zebrafish and Danionella cerebrum

Simulating The Individual Behavior Of Fish In Group For Computer Animation

Altering Fish Behavior by Sensing Swarm Patterns of Fish in an Artificial Aquatic Environment Using an Interactive Robotic Fish

Research on Behavior Route Selection from a Cognitive Prospective in Computer Animation

Real-time Fish Animation Generation by Monocular Camera

First application of one‐class support vector machine algorithms for detecting abnormal behavior of marine medaka Oryzias javanicus exposed to the harmful alga Karenia mikimotoi