Abstract:Passive acoustic monitoring – an approach that utilizes autonomous acoustic recording units – allows for non-invasive monitoring of individuals, assuming that it is possible to acoustically distinguish individuals. However, identifying effective analytical approaches for individual identification remains a challenge. Our study investigates how the use of different feature representations impacts our ability to distinguish between individual female Northern grey gibbons ( Hylobates funereus ). We broadcast pre-recorded calls from twelve gibbon females and re-recorded the calls at varying distances (directly under the tree to ~400 m away) using autonomous recording units. We evaluated the effectiveness of using different automated feature extraction approaches to classify gibbon calls: Mel-frequency cepstral coefficients (MFCCs), embeddings from three pre-trained neural networks (BirdNET, VGGish, and Wav2Vec2), and four commonly used acoustic indices. We used a supervised classification approach (random forest) to classify calls to the respective female and compared two unsupervised clustering approaches (affinity propagation clustering and hierarchical density-based spatial clustering) to evaluate which features were most effective for distinguishing female calls without using class labels. We used MFCCs as a baseline as previous work has shown they can be used to distinguish high-quality calls of individual gibbon females. Human annotators could only identify calls in spectrograms from recordings 10 dB), while the remaining features did not perform well. Contrary to our expectations, we found that MFCCs outperformed all other features for the unsupervised clustering tasks at closer distances and none of the features performed well at farther distances. The ability to acoustically discriminate animals under noisy conditions and from low signal-to-noise ratio calls has important implications for monitoring populations of endangered animals, such as gibbons. Focusing only on high signal-to-noise ratio calls for individual discrimination may not be possible for rare sounds, and future work should focus on developing effective approaches of feature extraction that can perform well across noisy, real-world conditions with a limited number of training samples.

Automated detection of gibbon calls from passive acoustic monitoring data using convolutional neural networks in the "torch for R" ecosystem

Automated Call Detection for Acoustic Surveys with Structured Calls of Varying Length

Benchmarking automated detection and classification approaches for monitoring of endangered species: a case study on gibbons from Cambodia

Automated detection of Bornean white-bearded gibbon (Hylobates albibarbis) vocalizations using an open-source framework for deep learning

Automated detection of Bornean white-bearded gibbon (Hylobates albibarbis) vocalisations using an open-source framework for deep learning

A workflow for the automated detection and classification of female gibbon calls from long-term acoustic recordings

Methods for processing and analyzing passive acoustic monitoring data: An example of song recognition in western black-crested gibbons

Using Deep Learning to Classify Environmental Sounds in the Habitat of Western Black-Crested Gibbons

Automatic Sound Event Detection and Classification of Great Ape Calls Using Neural Networks

An integrated passive acoustic monitoring and deep learning pipeline for black‐and‐white ruffed lemurs (Varecia variegata) in Ranomafana National Park, Madagascar

Compensating class imbalance for acoustic chimpanzee detection with convolutional recurrent neural networks

Mel-frequency cepstral coefficients outperform embeddings from pre-trained convolutional neural networks under noisy conditions for discrimination tasks of individual gibbons

GIBBONFINDR: An R package for the detection and classification of acoustic signals

Learning to rumble: Automated elephant call classification, detection and endpointing using deep architectures

Classification of animal sounds in a hyperdiverse rainforest using Convolutional Neural Networks

Automatic standardized processing and identification of tropical bat calls using deep learning approaches

Applying Deep Neural Network to Automatic Recognition of Giant Panda Vocalizations

Automated detection of dolphin whistles with convolutional networks and transfer learning

Development of deep neural networks for marine mammal call detection using an open-source, user friendly tool

Automatic Detection and Compression for Passive Acoustic Monitoring of the African Forest Elephant

Efficient Speech Detection in Environmental Audio Using Acoustic Recognition and Knowledge Distillation