Abstract:Many animals detect other individuals effortlessly. In Drosophila, previous studies have examined sensory processing during social interactions using simple blobs as visual stimulation; however, whether and how flies extract higher-order features from conspecifics to guide behavior remains elusive. Arguing that this should be reflected in sensorimotor relations, we developed unbiased machine learning tools for natural behavior quantification and applied these tools, which may prove broadly useful, to study interacting pairs. By transforming motor patterns with female-centered reference frames, we established circling, where heading and traveling directions intersect, as a unique pattern of social interaction during courtship. We found circling to be highly visual, with males exhibiting view-tuned motor patterns. Interestingly, males select specific wing and leg actions based on the positions and motions of the females' heads and tails. Using system identification, we derived visuomotor transformation functions indicating history-dependent action selection, with distance predicting action initiation and angular position predicting wing choices and locomotion directions. Integration of vision with somatosensation further boosts these sensorimotor relations. Essentially comprised of orchestrated wing and leg maneuvers that are more variable in the light, circling induces mutually synchronized conspecific responses stronger than wing extension alone. Finally, we found that actions depend on integrating spatiotemporally structured features with goals. Altogether, we identified a series of sensorimotor relations during circling, implying that during courtship, flies detect complex spatiotemporally structured features of conspecifics, laying the foundation for a mechanistic understanding of conspecific recognition in Drosophila.

Recognition of Drosophila Courtship Behavior Based on Feature Selection Ensemble Leaning

Behavioral signatures of structured feature detection during courtship in Drosophila

Automated Monitoring and Analysis of Social Behavior in Drosophila

An automatic system for recognizing fly courtship patterns via an image processing method

Computer-Aided Automated Detection of Gene-Controlled Social Actions of Drosophila

Automatic analysis of segmentwise locomotion details of Drosophila larva

Multi-feature fusion CNNs for Drosophila embryo of interest detection

Application of Modern Computer Technology in Classical Genetics Lab Course--development of a Mobile, Lightweight and High-Precision Batch Identification System for Genetic Traits of Drosophila.

Leg-tracking and Automated Behavioural Classification in Drosophila

Machine learning ensemble with image processing for pest identification and classification in field crops

Automatic stage identification of Drosophila egg chamber based on DAPI images

Leg-tracking and automated behavioral classification in Drosophila

Analyzing animal behavior via classifying each video frame using convolutional neural networks

RECOGNING INSECTS OF MOTH SPECIES BASED ON DISCRIMINATIVE LOCAL BINARY PATTERN FEATURES

Social Behavioral Phenotyping of Drosophila with a2D-3D Hybrid CNN Framework

Deep Learning Based Features Extraction for Facial Gender Classification Using Ensemble of Machine Learning Technique

Insect recognition based on complementary features from multiple views

Application of Spatio-Temporal Context and Convolution Neural Network (CNN) in Grooming Behavior of Bactrocera minax (Diptera: Trypetidae) Detection and Statistics

Insect Recognition Based on Complex Frequency Domain Transform and Multi-feature Fusion

High-performance drosophila movement tracking

Research on Insect Identification Based on Pattern Recognition Technology