Abstract:When recorders are used to survey acoustically conspicuous species, identification calls of the target species in recordings is essential for estimating density and abundance. We investigate how well deep neural networks identify vocalisations consisting of phrases of varying lengths, each containing a variable number of syllables. We use recordings of Hainan gibbon Nomascus hainanus vocalisations to develop and test the methods. We propose two methods for exploiting the two-level structure of such data. The first combines convolutional neural network (CNN) models with a hidden Markov model (HMM) and the second uses a convolutional recurrent neural network (CRNN). Both models learn acoustic features of syllables via a CNN and temporal correlations of syllables into phrases either via an HMM or recurrent network. We compare their performance to commonly used CNNs LeNet and VGGNet, and support vector machine (SVM). We also propose a dynamic programming method to evaluate how well phrases are predicted. This is useful for evaluating performance when vocalisations are labelled by phrases, not syllables. Our methods perform substantially better than the commonly used methods when applied to the gibbon acoustic recordings. The CRNN has an F-score of 90% on phrase prediction, which is 18% higher than the best of the SVM or LeNet and VGGNet methods. HMM post-processing raised the F-score of these last three methods to as much as 87%. The number of phrases is overestimated by CNNs and SVM, leading to error rates between 49% and 54%. With HMM, these error rates can be reduced to 0.4% at the lowest. Similarly, the error rate of CRNN's prediction is no more than 0.5%. CRNNs are better at identifying phrases of varying lengths composed of a varying number of syllables than simpler CNN or SVM models. We find a CRNN model to be best at this task, with a CNN combined with an HMM performing almost as well. We recommend that these kinds of models are used for species whose vocalisations are structured into phrases of varying lengths.

Convolutional Neural Network for Detecting Odontocete Echolocation Clicks

Acoustic Image Target Detection Method Based on the Fusion of RepVGG-ECA and YOLOv5

Automated Call Detection for Acoustic Surveys with Structured Calls of Varying Length

An Auditory Convolutional Neural Network for Underwater Acoustic Target Timbre Feature Extraction and Recognition

The passive recording of the click trains of a beluga whale (Delphinapterus leucas) and the subsequent creation of a bio-inspired echolocation model

An Underwater Wideband Sound Source Localization Method Based on Light Neural Network Structure

Low Frequency Ultrasonic Voice Activity Detection Using Convolutional Neural Networks.

Performance of a Deep Neural Network at Detecting North Atlantic Right Whale Upcalls

Bayesian detection and tracking of odontocetes in 3-D from their echolocation clicks

A Neural Network-based Howling Detection Method for Real-Time Communication Applications

A multi-branch convolutional neural network for snoring detection based on audio

Development of deep neural networks for marine mammal call detection using an open-source, user friendly tool

A multi-view CNN-based acoustic classification system for automatic animal species identification

A Portable Terminal for Acoustic Monitoring and Online Recognition of Bats with CNN-LSTM

Deep Machine Learning Techniques for the Detection and Classification of Sperm Whale Bioacoustics

Acoustic spatial patterns recognition based on convolutional neural network and acoustic visualization

Underwater Acoustic Signal Noise Reduction Based on a Fully Convolutional Encoder-Decoder Neural Network

Towards the topology of autoencoder of calls versus clicks of marine mammal

An archive of odontocete sounds for automatic call recognition

Review of Cetacean's click detection algorithms

Adaptive iterative transfer learning for effective snapping shrimp sound detection