Abstract:Collective animal behavior occurs in groups and swarms at almost every biological scale, from single-celled organisms to the largest animals on Earth. The intriguing mysteries behind these group behaviors have attracted many scholars, and while it is known that models can reproduce qualitative features of such complex behaviors, this requires data from real animals to demonstrate, and obtaining data on the exact features of these groups is tricky. In this paper, we propose the Hidden Markov Unscented Tracker (HMUT), which combines the state prediction capability of HMM and the high-precision nonlinear processing capability of UKF. This prediction-driven tracking mechanism enables HMUT to quickly adjust tracking strategies when facing sudden changes in target motion direction or rapid changes in speed, reducing the risk of tracking loss. Videos of fruit fly swarm movement in an enclosed environment are captured using stereo cameras. For the captured fruit fly images, the thresholded AKAZE algorithm is first used to detect the positions of individual fruit flies in the images, and the motion of the fruit flies is modeled using a multidimensional hidden Markov model (HMM). Tracking is then performed using the Unscented Kalman Filter algorithm to obtain the flight trajectories of the fruit flies in two camera views. Finally, 3D reconstruction of the trajectories in both views is achieved through polar coordinate constraints, resulting in 3D motion data of the fruit flies. Additionally, the efficiency and accuracy of the proposed algorithm are evaluated by simulating fruit fly swarm movement using the Boids algorithm. Finally, based on the tracked fruit fly flight data, behavioral characteristics of the fruit flies are analyzed from two perspectives. The first is a statistical analysis of the differences between the two behaviors. The second dimension involves clustering trajectory similarity using the DTW method based on fruit fly flight trajectories, further analyzing the similarity within clusters and differences between clusters.

Improved Tracking Strategy with CamShift Algorithm

Fast-Tracker 2.0: Improving Autonomy of Aerial Tracking with Active Vision and Human Location Regression.

A Novel Method For Tracking Individuals Of Fruit Fly Swarms Flying In A Laboratory Flight Arena

2D Tracking Algorithm Performance Testing Based on Three- Dimensional Visual Platform

Automatic Camshift tracking algorithm based on fuzzy inference background difference combining with twice searching

Real-time and Precise Insect Flight Control System Based on Virtual Reality

Adaptive Trajectory Tracking Algorithm for The Aerospace Vehicle Based on Improved T-MPSP

Target Tracking in Robot Water Polo Game

High speed long-term visual object tracking algorithm for real robot systems

A Novel Optical and Magnetic Hybrid System for Tracking Flying Insects

Comparative analysis of tracking and behavioral patterns between wild-type and genetically modified fruit flies using computer vision and statistical methods

FlightTrackAI: a robust convolutional neural network-based tool for tracking the flight behaviour of Aedes aegypti mosquitoes

A Comparative Study of Object Trackers for Infrared Flying Bird Tracking

Swarm behavior tracking based on a deep vision algorithm

A Tracking System Based on 2-DOF Motion Platform for Flight Simulator

Multi-camera Realtime 3D Tracking of Multiple Flying Animals

FlyTracker: Motion Tracking and Obstacle Detection for Drones Using Event Cameras.

An Improved Target Tracking Algorithm Based on Extended Kalman Filter for UAV

[Implementation of Eye Movement Tracking System Based on Camshift Algorithm].

FlyDetector—Automated Monitoring Platform for the Visual–Motor Coordination of Honeybees in a Dynamic Obstacle Scene Using Digital Paradigm

Research on Video Object Tracking Based on Improved Camshift Algorithm