Abstract:When recorders are used to survey acoustically conspicuous species, identification calls of the target species in recordings is essential for estimating density and abundance. We investigate how well deep neural networks identify vocalisations consisting of phrases of varying lengths, each containing a variable number of syllables. We use recordings of Hainan gibbon Nomascus hainanus vocalisations to develop and test the methods. We propose two methods for exploiting the two-level structure of such data. The first combines convolutional neural network (CNN) models with a hidden Markov model (HMM) and the second uses a convolutional recurrent neural network (CRNN). Both models learn acoustic features of syllables via a CNN and temporal correlations of syllables into phrases either via an HMM or recurrent network. We compare their performance to commonly used CNNs LeNet and VGGNet, and support vector machine (SVM). We also propose a dynamic programming method to evaluate how well phrases are predicted. This is useful for evaluating performance when vocalisations are labelled by phrases, not syllables. Our methods perform substantially better than the commonly used methods when applied to the gibbon acoustic recordings. The CRNN has an F-score of 90% on phrase prediction, which is 18% higher than the best of the SVM or LeNet and VGGNet methods. HMM post-processing raised the F-score of these last three methods to as much as 87%. The number of phrases is overestimated by CNNs and SVM, leading to error rates between 49% and 54%. With HMM, these error rates can be reduced to 0.4% at the lowest. Similarly, the error rate of CRNN's prediction is no more than 0.5%. CRNNs are better at identifying phrases of varying lengths composed of a varying number of syllables than simpler CNN or SVM models. We find a CRNN model to be best at this task, with a CNN combined with an HMM performing almost as well. We recommend that these kinds of models are used for species whose vocalisations are structured into phrases of varying lengths.

Audio-based automatic mating success prediction of giant pandas

Analyzing the pregnancy status of giant pandas with hierarchical behavioral information

Symbiotic microbiota and odor ensure mating in time for giant pandas

Scent communication behavior by giant pandas

Reproductive Strategy Inferred from Major Histocompatibility Complex-Based Inter-Individual, Sperm-Egg, and Mother-Fetus Recognitions in Giant Pandas (ailuropoda Melanoleuca)

Seasonal and reproductive variation in chemical constituents of scent signals in wild giant pandas

A study on giant panda recognition based on images of a large proportion of captive pandas

Automated Call Detection for Acoustic Surveys with Structured Calls of Varying Length

Using Deep Learning to Classify Environmental Sounds in the Habitat of Western Black-Crested Gibbons

Methods for processing and analyzing passive acoustic monitoring data: An example of song recognition in western black-crested gibbons

Automatic Identification of Pangolin Behavior Using Deep Learning Based on Temporal Relative Attention Mechanism

Towards Automated Animal Density Estimation with Acoustic Spatial Capture-Recapture

In the songs of Hainan gibbons: Automated individual dynamic monitoring from acoustic recordings

Automatic Sound Event Detection and Classification of Great Ape Calls Using Neural Networks

Natural mating ability is associated with gut microbiota composition and function in captive male giant pandas

Characterizing the metabolome and microbiome at giant panda scent marking sites during the mating season

Giant panda behaviour recognition using images

Automated detection of Bornean white-bearded gibbon (Hylobates albibarbis) vocalizations using an open-source framework for deep learning

Automatic detection and classification of marmoset vocalizations using deep and recurrent neural networks.

Automated detection of Bornean white-bearded gibbon (Hylobates albibarbis) vocalisations using an open-source framework for deep learning

Y-CHROMOSOME MICRODISSECTION AND Y-LINKED GENES IDENTIFICATION OF THE GIANT PANDA (AILUROPODA MELANOLEUCA)