Abstract:Animal vocal communication is a broad and multi-disciplinary field of research. Studying various aspects of communication can provide key elements for understanding animal behavior, evolution, and cognition. Given the large amount of acoustic data accumulated from automated recorders, for which manual annotation and analysis is impractical, there is a growing need to develop algorithms and automatic methods for analyzing and identifying animal sounds. In this study we developed an automatic detection and analysis system based on audio signal processing algorithms and deep learning that is capable of processing and analyzing large volumes of data without human bias. We selected the White Spectacled Bulbul ( Pycnonotus xanthopygos ) as our bird model because it has a complex vocal communication system with a large repertoire which is used by both sexes, year-round. It is a common, widespread passerine in Israel, which is relatively easy to locate and record in a broad range of habitats. Like many passerines, the Bulbul’s vocal communication consists of two primary hierarchies of utterances, syllables and words . To extract each of these units’ characteristics, the fundamental frequency contour was modeled using a low degree Legendre polynomial, enabling it to capture the different patterns of variation from different vocalizations, so that each pattern could be effectively expressed using very few coefficients. In addition, a mel-spectrogram was computed for each unit, and several features were extracted both in the time-domain (e.g., zero-crossing rate and energy) and frequency-domain (e.g., spectral centroid and spectral flatness). We applied both linear and non-linear dimensionality reduction algorithms on feature vectors and validated the findings that were obtained manually, namely by listening and examining the spectrograms visually. Using these algorithms, we show that the Bulbul has a complex vocabulary of more than 30 words, that there are multiple syllables that are combined in different words, and that a particular syllable can appear in several words. Using our system, researchers will be able to analyze hundreds of hours of audio recordings, to obtain objective evaluation of repertoires, and to identify different vocal units and distinguish between them, thus gaining a broad perspective on bird vocal communication.

Individual Identification of Birds with Complex Songs: the Case of Green-Backed Flycatchers Ficedula Elisae

Individual Identification on the Basis of the Songs of the Asian Stubtail (urosphena Squameiceps)

Acoustic Identification Of Individuals Within Large Avian Populations: A Case Study Of The Brownish-Flanked Bush Warbler, South-Central China

Identification of Vocal Individuality in Male Cuckoos Using Different Analytical Techniques

Individual Variation in Brownish-Flanked Bush Warbler Songs

Parting self from others: Individual and self-recognition in birds

Recognition of bird species with birdsong records using machine learning methods

[Two Distinct Parts Within the Song of Phoenicurus Auroreus, and Individual Identification on the Basis of the Song].

Same data, different results? Evaluating machine learning approaches for individual identification in animal vocalisations

A Small Vocal Repertoire During the Breeding Season Expresses Complex Behavioral Motivations and Individual Signature in the Common Coot

Examining the Effectiveness of Discriminant Function Analysis and Cluster Analysis in Species Identification of Male Field Crickets Based on Their Calling Songs

Strong individual distinctiveness across the vocal repertoire of a colonial seabird, the little auk, Alle alle

Young Eurasian Scops Owls produce individually distinctive vocalizations

An Analysis of Humpback Whale Songs for Individual Classification

Gender identification using acoustic analysis in birds without external sexual dimorphism

Deep learning-based methods for individual recognition in small birds

Identification, Analysis and Characterization of Base Units of Bird Vocal Communication: The White Spectacled Bulbul (Pycnonotus xanthopygos) as a Case Study

Individual identification in acoustic recordings

Acoustic Difference of Narcissus Flycatcher Complex

Responses in adult pied flycatcher males depend on playback song similarity to local population

Comparative genomics of two Empidonax flycatchers reveal candidate genes for bird song production.