Abstract:Animal vocal communication is a broad and multi-disciplinary field of research. Studying various aspects of communication can provide key elements for understanding animal behavior, evolution, and cognition. Given the large amount of acoustic data accumulated from automated recorders, for which manual annotation and analysis is impractical, there is a growing need to develop algorithms and automatic methods for analyzing and identifying animal sounds. In this study we developed an automatic detection and analysis system based on audio signal processing algorithms and deep learning that is capable of processing and analyzing large volumes of data without human bias. We selected the White Spectacled Bulbul ( Pycnonotus xanthopygos ) as our bird model because it has a complex vocal communication system with a large repertoire which is used by both sexes, year-round. It is a common, widespread passerine in Israel, which is relatively easy to locate and record in a broad range of habitats. Like many passerines, the Bulbul’s vocal communication consists of two primary hierarchies of utterances, syllables and words . To extract each of these units’ characteristics, the fundamental frequency contour was modeled using a low degree Legendre polynomial, enabling it to capture the different patterns of variation from different vocalizations, so that each pattern could be effectively expressed using very few coefficients. In addition, a mel-spectrogram was computed for each unit, and several features were extracted both in the time-domain (e.g., zero-crossing rate and energy) and frequency-domain (e.g., spectral centroid and spectral flatness). We applied both linear and non-linear dimensionality reduction algorithms on feature vectors and validated the findings that were obtained manually, namely by listening and examining the spectrograms visually. Using these algorithms, we show that the Bulbul has a complex vocabulary of more than 30 words, that there are multiple syllables that are combined in different words, and that a particular syllable can appear in several words. Using our system, researchers will be able to analyze hundreds of hours of audio recordings, to obtain objective evaluation of repertoires, and to identify different vocal units and distinguish between them, thus gaining a broad perspective on bird vocal communication.

Dugong chirp type classification based on fundamental contour extraction and hierarchical cluster analysis

Analyzing and Classifying Fish Vocalization in the East China Sea Coastal Area

Study on Echo Features and Classification Methods of Fish Species.

Application to the Call of Southern Right Whale

Unsupervised classification of graded animal vocalisations using fuzzy clustering

Three types of pulsed signal trains emitted by Indo-Pacific humpback dolphins (Sousa chinensis) in Beibu Gulf, South China Sea

A classification method of marine mammal calls based on two-channel fusion network

Acoustic bird species classification under low SNR and small-scale dataset conditions

Automated Call Detection for Acoustic Surveys with Structured Calls of Varying Length

Deep embedded clustering of coral reef bioacoustics

Automated detection of Bornean white-bearded gibbon (Hylobates albibarbis) vocalizations using an open-source framework for deep learning

Identification, Analysis and Characterization of Base Units of Bird Vocal Communication: The White Spectacled Bulbul (Pycnonotus xanthopygos) as a Case Study

Classification of birdsong spectrograms based on DR-ACGAN and dynamic convolution

Whistle signal variations among three Indo-Pacific humpback dolphin populations in the South China Sea: a combined effect of the Qiongzhou Strait's geographical barrier function and local ambient noise?

Advanced Framework for Animal Sound Classification With Features Optimization

Automated detection of Bornean white-bearded gibbon (Hylobates albibarbis) vocalisations using an open-source framework for deep learning

Development of deep neural networks for marine mammal call detection using an open-source, user friendly tool

Using Deep Learning to Classify Environmental Sounds in the Habitat of Western Black-Crested Gibbons

Using deep learning to track time × frequency whistle contours of toothed whales without human-annotated training data

Utilizing DeepSqueak for automatic detection and classification of mammalian vocalizations: a case study on primate vocalizations

Machine learning with taxonomic family delimitation aids in the classification of ephemeral beaked whale events in passive acoustic monitoring