Abstract:Collective animal behavior occurs in groups and swarms at almost every biological scale, from single-celled organisms to the largest animals on Earth. The intriguing mysteries behind these group behaviors have attracted many scholars, and while it is known that models can reproduce qualitative features of such complex behaviors, this requires data from real animals to demonstrate, and obtaining data on the exact features of these groups is tricky. In this paper, we propose the Hidden Markov Unscented Tracker (HMUT), which combines the state prediction capability of HMM and the high-precision nonlinear processing capability of UKF. This prediction-driven tracking mechanism enables HMUT to quickly adjust tracking strategies when facing sudden changes in target motion direction or rapid changes in speed, reducing the risk of tracking loss. Videos of fruit fly swarm movement in an enclosed environment are captured using stereo cameras. For the captured fruit fly images, the thresholded AKAZE algorithm is first used to detect the positions of individual fruit flies in the images, and the motion of the fruit flies is modeled using a multidimensional hidden Markov model (HMM). Tracking is then performed using the Unscented Kalman Filter algorithm to obtain the flight trajectories of the fruit flies in two camera views. Finally, 3D reconstruction of the trajectories in both views is achieved through polar coordinate constraints, resulting in 3D motion data of the fruit flies. Additionally, the efficiency and accuracy of the proposed algorithm are evaluated by simulating fruit fly swarm movement using the Boids algorithm. Finally, based on the tracked fruit fly flight data, behavioral characteristics of the fruit flies are analyzed from two perspectives. The first is a statistical analysis of the differences between the two behaviors. The second dimension involves clustering trajectory similarity using the DTW method based on fruit fly flight trajectories, further analyzing the similarity within clusters and differences between clusters.

Acquiring 3D motion trajectories of large numbers of swarming animals

Automated 3D trajectory measuring of large numbers of moving particles

Reconstructing 3D Motion Trajectory of Large Swarm of Flying Objects

Distributed Swarm Trajectory Optimization for Formation Flight in Dense Environments

Automatic 3D Tracking System for Large Swarm of Moving Objects

Automatic trajectory measurement of large numbers of crowded objects

A Novel Method For Tracking Individuals Of Fruit Fly Swarms Flying In A Laboratory Flight Arena

Tracking the 3D Position and Orientation of Flying Swarms with Learned Kinematic Pattern Using LSTM Network.

Comparative analysis of tracking and behavioral patterns between wild-type and genetically modified fruit flies using computer vision and statistical methods

Modeling Three-Dimensional Bait Ball Collective Motion.

Reconstructing 3D Motion Trajectories of Particle Swarms by Global Correspondence Selection.

Estimating Orientation in Tracking Individuals of Flying Swarms

Swarm behavior tracking based on a deep vision algorithm

Watching Swarm Dynamics from Above: A Framework for Advanced Object Tracking in Drone Videos

3d Tracking Targets Via Kinematic Model Weighted Particle Filter

An Effective and Scalable Approach for Swarm-on-Swarm Air Combat Decision

Automatically Detect and Track Multiple Fish Swimming in Shallow Water with Frequent Occlusion.

Multi-camera Realtime 3D Tracking of Multiple Flying Animals

Intelligent Control of Swarm Robotics Employing Biomimetic Deep Learning

FASTSWARM: A Data-driven FrAmework for Real-time Flying InSecT SWARM Simulation

Inherent Noise-Aware Insect Swarm Simulation