Abstract:1- Wild and managed honey bees, crucial pollinators for both agriculture and natural ecosystems, face challenges due to industrial agriculture and urbanization. Understanding how bee colonies utilize the landscape for foraging is essential for managing human-bee conflicts and protecting these pollinators to sustain their vital pollination services. To understand how the bees utilize their surroundings, researchers often decode bee waggle dances, which honey bee workers use to communicate navigational information of desirable food and nesting sites to their nest mates. This process is carried out manually, which is time-consuming, prone to human error and requires specialized skills. 2- We address this problem by introducing a novel deep learning-based pipeline that automatically detects and measures waggle runs, the core movement of the waggle dance, under natural recording conditions for the first time. We combined the capabilities of the action detector YOWOv2 and the DeepSORT tracking method, with the Principal Component Analysis to extract dancing bee bounding boxes and the angles and durations within waggle runs. 3- The presented pipeline works fully automatically with videos taken from wild Apis dorsata colonies in its natural environment, and can be used for any honey bee species. Comparison of our pipeline with analyses made by human experts revealed that our procedure was able to detect 93\% of waggle runs on the testing dataset, with a run duration Root Mean Squared Error (RMSE) of less than a second, and a run angle RMSE of 0.14 radians. We also assessed the generalizability of our pipeline to previously unseen recording conditions, successfully detecting 50% of waggle runs performed by Apis mellifera bees from a colony managed in Tokyo, Japan. In parallel, we discovered the most appropriate values of the model's hyperparameters for this task. 4- Our study demonstrates that a deep learning-based pipeline can successfully and automatically analyze the waggle runs of Apis dorsata in natural conditions and generalize to other bee species. This approach enables precise measurement of direction and duration, enabling the study of bee foraging behavior on an unprecedented scale compared to traditional manual methods contributing to preserving biodiversity and ecosystem services.

Honey Bee Dance Modeling in Real-time using Machine Learning

Automatic detection and decoding of honey bee waggle dances

Unraveling Honey Bee's Waggle Dances in Natural Conditions with Video-Based Deep Learning

Social signal learning of the waggle dance in honey bees

Dancing Honey bee Robot Elicits Dance-Following and Recruits Foragers

Shape-and-behavior encoded tracking of bee dances

Machine learning models identify gene predictors of waggle dance behaviour in honeybees

A Bio-inspired Model for Bee Simulations

Individual honey bee tracking in a beehive environment using deep learning and Kalman filter

Markerless tracking of an entire honey bee colony

Semi-Supervised Audio Representation Learning for Modeling Beehive Strengths

IntelliBeeHive: An Automated Honey Bee, Pollen, and Varroa Destructor Monitoring System

Representation and Computation Method for Bumblebee’s Abdomen Movements

Smooth 3D Trajectory Segmentation for Flying Insects

Identifying foraging spatial cues in beehive sound activity using machine learning methods

System design for inferring colony-level pollination activity through miniature bee-mounted sensors

Tracking all members of a honey bee colony over their lifetime

Analysis of antennal responses to motion stimuli in the honey bee by automated tracking using DeepLabCut

Swarm behavior tracking based on a deep vision algorithm

Autonomous tracking of honey bee behaviors over long-term periods with cooperating robots

Identify The Beehive Sound Using Deep Learning