Abstract:When recorders are used to survey acoustically conspicuous species, identification calls of the target species in recordings is essential for estimating density and abundance. We investigate how well deep neural networks identify vocalisations consisting of phrases of varying lengths, each containing a variable number of syllables. We use recordings of Hainan gibbon Nomascus hainanus vocalisations to develop and test the methods. We propose two methods for exploiting the two-level structure of such data. The first combines convolutional neural network (CNN) models with a hidden Markov model (HMM) and the second uses a convolutional recurrent neural network (CRNN). Both models learn acoustic features of syllables via a CNN and temporal correlations of syllables into phrases either via an HMM or recurrent network. We compare their performance to commonly used CNNs LeNet and VGGNet, and support vector machine (SVM). We also propose a dynamic programming method to evaluate how well phrases are predicted. This is useful for evaluating performance when vocalisations are labelled by phrases, not syllables. Our methods perform substantially better than the commonly used methods when applied to the gibbon acoustic recordings. The CRNN has an F-score of 90% on phrase prediction, which is 18% higher than the best of the SVM or LeNet and VGGNet methods. HMM post-processing raised the F-score of these last three methods to as much as 87%. The number of phrases is overestimated by CNNs and SVM, leading to error rates between 49% and 54%. With HMM, these error rates can be reduced to 0.4% at the lowest. Similarly, the error rate of CRNN's prediction is no more than 0.5%. CRNNs are better at identifying phrases of varying lengths composed of a varying number of syllables than simpler CNN or SVM models. We find a CRNN model to be best at this task, with a CNN combined with an HMM performing almost as well. We recommend that these kinds of models are used for species whose vocalisations are structured into phrases of varying lengths.

Spatial Attention Deep Convolution Neural Network for Call Recognition of Marine Mammal

A classification method of marine mammal calls based on two-channel fusion network

Acoustic Image Target Detection Method Based on the Fusion of RepVGG-ECA and YOLOv5

Automated Call Detection for Acoustic Surveys with Structured Calls of Varying Length

Underwater Acoustic Target Recognition Method Based on Feature Fusion and Residual CNN

An attention-based multi-scale convolution network for intelligent underwater acoustic signal recognition

A Novel AMSS-FFN for Underwater Multisource Localization Using Artificial Lateral Line.

Marine Biological Image Recognition Based on Deep Convolutional Neural Network

Underwater target recognition based on adaptive multi-feature fusion network

Development of deep neural networks for marine mammal call detection using an open-source, user friendly tool

A Novel Deep-Learning Method with Channel Attention Mechanism for Underwater Target Recognition

Large-Scale Whale Call Classification Using Deep Convolutional Neural Network Architectures

A Deep Convolutional Neural Network Inspired by Auditory Perception for Underwater Acoustic Target Recognition

An Auditory Convolutional Neural Network for Underwater Acoustic Target Timbre Feature Extraction and Recognition

Trans-CNN: A Transfer Learning Based Approach for Dolphin Sound Recognition

Performance of a Deep Neural Network at Detecting North Atlantic Right Whale Upcalls

Underwater acoustic signal classification based on a spatial–temporal fusion neural network

Underwater acoustic target recognition based on convolutional neural network and multi-feature fusion

Underwater Acoustic Target Recognition Based on Data Augmentation and Residual CNN

Multi-Features Fusion for Underwater Acoustic Target Recognition Based on Convolution Recurrent Neural Networks

FDCNet: Filtering Deep Convolutional Network for Marine Organism Classification.