Abstract:Collective animal behavior occurs in groups and swarms at almost every biological scale, from single-celled organisms to the largest animals on Earth. The intriguing mysteries behind these group behaviors have attracted many scholars, and while it is known that models can reproduce qualitative features of such complex behaviors, this requires data from real animals to demonstrate, and obtaining data on the exact features of these groups is tricky. In this paper, we propose the Hidden Markov Unscented Tracker (HMUT), which combines the state prediction capability of HMM and the high-precision nonlinear processing capability of UKF. This prediction-driven tracking mechanism enables HMUT to quickly adjust tracking strategies when facing sudden changes in target motion direction or rapid changes in speed, reducing the risk of tracking loss. Videos of fruit fly swarm movement in an enclosed environment are captured using stereo cameras. For the captured fruit fly images, the thresholded AKAZE algorithm is first used to detect the positions of individual fruit flies in the images, and the motion of the fruit flies is modeled using a multidimensional hidden Markov model (HMM). Tracking is then performed using the Unscented Kalman Filter algorithm to obtain the flight trajectories of the fruit flies in two camera views. Finally, 3D reconstruction of the trajectories in both views is achieved through polar coordinate constraints, resulting in 3D motion data of the fruit flies. Additionally, the efficiency and accuracy of the proposed algorithm are evaluated by simulating fruit fly swarm movement using the Boids algorithm. Finally, based on the tracked fruit fly flight data, behavioral characteristics of the fruit flies are analyzed from two perspectives. The first is a statistical analysis of the differences between the two behaviors. The second dimension involves clustering trajectory similarity using the DTW method based on fruit fly flight trajectories, further analyzing the similarity within clusters and differences between clusters.

A series of methods incorporating deep learning and computer vision techniques in the study of fruit fly (Diptera: Tephritidae) regurgitation

Research Progress on Drosophila Visual Cognition in China

Comparative analysis of tracking and behavioral patterns between wild-type and genetically modified fruit flies using computer vision and statistical methods

Enhancing Fruit Fly Detection in Complex Backgrounds Using Transformer Architecture with Step Attention Mechanism

A Novel Method For Tracking Individuals Of Fruit Fly Swarms Flying In A Laboratory Flight Arena

Research on Recognition of Fly Species Based on Improved RetinaNet and CBAM

Automatic analysis of segmentwise locomotion details of Drosophila larva

Application of Deep Learning in Image Recognition of Citrus Pests

Kiwifruit Counting Using Kiwidetector and Kiwitracker

Estimating Orientation of Flying Fruit Flies

A High-Throughput Detection Method for Invasive Fruit Fly (diptera: Tephritidae) Species Based on Microfluidic Dynamic Array

Learning Sparse Representations for Fruit-Fly Gene Expression Pattern Image Annotation and Retrieval

Deep learning for automated detection of Drosophila suzukii: potential for UAV-based monitoring

Attention LSTM U-Net model for Drosophila melanogaster heart tube segmentation in optical coherence microscopy images

A fly inspired solution to looming detection for collision avoidance

Drosophila-Vision-Inspired Motion Perception Model and Its Application in Saliency Detection

Remote fruit fly detection using computer vision and machine learning-based electronic trap

Application of Modern Computer Technology in Classical Genetics Lab Course--development of a Mobile, Lightweight and High-Precision Batch Identification System for Genetic Traits of Drosophila.

Fruit Disease Classification and Localization Using Region Based Regression

Research on Landmark Extraction Technology in Identification of Fruit Flies (diptera: Tephritidae).

Modeling Drosophila vision neural pathways to detect weak moving targets from cluttered backgrounds