Abstract:Individual insects flying in crowded assemblies perform complex aerial maneuvers by sensing and feeding back neighbor measurements to small changes in their wing motions. To understand the individual feedback rules that permit these fast, adaptive behaviors in group flight, both experimental preparations inducing crowded flight and high-speed tracking systems capable of tracking both body motions and more subtle wing motion changes for multiple insects in simultaneous flight are needed. This measurement capability extends tracking beyond the previous focus on individual insects to multiple insects. This paper describes an experimental preparation that induces crowded insect flight in more naturalistic conditions (a laboratory-outdoor transition tunnel) and directly compares the resulting flight performance to traditional flight enclosures. Measurements are made possible via the introduction of a multi-agent high speed insect tracker called Hi-VISTA, which provides a capability to track wing and body motions of multiple insects using high speed cameras (9000-12 500 fps). Processing steps consist of automatic background identification, data association, hull reconstruction, segmentation, and feature measurement. To improve the biological relevance of laboratory experiments and develop a platform for interaction studies, this paper applies the Hi-VISTA measurement system toApis melliferaforagers habituated to transit flights through the transparent transition environment. Binary statistical analysis (Welch's t-test, Cohen's d effect size) of 95 flight trajectories is presented, quantifying the differences between flights in an unobstructed environment and in a confined tunnel volume. The results indicate that body pitch angle, heading rate, flapping frequency, and vertical speed (heave) are each affected by confinement, and other flight variables show minor or statistically insignificant changes. These results form a baseline as swarm tracking and analysis begins to isolate the effects of neighbors from environmental enclosures, and improve the connection of high speed insect laboratory experiments to outdoor field experiments.

High-resolution outdoor videography of insects using Fast Lock-On tracking

High Resolution Outdoor Videography of Insects Using Fast Lock-On Tracking

Millisecond insect tracking system

Note: High-speed optical tracking of a flying insect

Target Detection and Localization for Flapping-Wing Robots Based on Biological Eagle-Eye Vision

Multi-camera Realtime 3D Tracking of Multiple Flying Animals

FlyDetector—Automated Monitoring Platform for the Visual–Motor Coordination of Honeybees in a Dynamic Obstacle Scene Using Digital Paradigm

A Novel Optical and Magnetic Hybrid System for Tracking Flying Insects

3D-Printed Fluorescence Hyperspectral Lidar for Monitoring Tagged Insects

Towards high-throughput 3D insect capture for species discovery and diagnostics

High-resolution and High-Speed 3D Tracking of Microrobots Using a Fluorescent Light Field Microscope

FLIVVER: Fly Lobula Inspired Visual Velocity Estimation & Ranging

Spatial Monitoring and Insect Behavioural Analysis Using Computer Vision for Precision Pollination

Watching Swarm Dynamics from Above: A Framework for Advanced Object Tracking in Drone Videos

High speed visual insect swarm tracker (Hi-VISTA) used to identify the effects of confinement on individual insect flight

Optical tracking and laser-induced mortality of insects during flight

Large-scale 3D Imaging of Insects with Natural Color.

Motion Informed Object Detection of Small Insects in Time-lapse Camera Recordings

Recording butterfly movements from a UAV

High-performance drosophila movement tracking

FlyTracker: Motion Tracking and Obstacle Detection for Drones Using Event Cameras.