Abstract:When recorders are used to survey acoustically conspicuous species, identification calls of the target species in recordings is essential for estimating density and abundance. We investigate how well deep neural networks identify vocalisations consisting of phrases of varying lengths, each containing a variable number of syllables. We use recordings of Hainan gibbon Nomascus hainanus vocalisations to develop and test the methods. We propose two methods for exploiting the two-level structure of such data. The first combines convolutional neural network (CNN) models with a hidden Markov model (HMM) and the second uses a convolutional recurrent neural network (CRNN). Both models learn acoustic features of syllables via a CNN and temporal correlations of syllables into phrases either via an HMM or recurrent network. We compare their performance to commonly used CNNs LeNet and VGGNet, and support vector machine (SVM). We also propose a dynamic programming method to evaluate how well phrases are predicted. This is useful for evaluating performance when vocalisations are labelled by phrases, not syllables. Our methods perform substantially better than the commonly used methods when applied to the gibbon acoustic recordings. The CRNN has an F-score of 90% on phrase prediction, which is 18% higher than the best of the SVM or LeNet and VGGNet methods. HMM post-processing raised the F-score of these last three methods to as much as 87%. The number of phrases is overestimated by CNNs and SVM, leading to error rates between 49% and 54%. With HMM, these error rates can be reduced to 0.4% at the lowest. Similarly, the error rate of CRNN's prediction is no more than 0.5%. CRNNs are better at identifying phrases of varying lengths composed of a varying number of syllables than simpler CNN or SVM models. We find a CRNN model to be best at this task, with a CNN combined with an HMM performing almost as well. We recommend that these kinds of models are used for species whose vocalisations are structured into phrases of varying lengths.

0526 Deep Convolutional Neural Network for Groaning and Snoring Sounds Classification

A multi-branch convolutional neural network for snoring detection based on audio

Automatic Respiratory Sound Classification Via Multi-Branch Temporal Convolutional Network

Analysis and Identification of Nocturnal Groaning Syndrome Based on Multimodal Data

Snoring Sound Recognition Using Multi-Channel Spectrograms

who is snoring? snore based user recognition

A Bag of Wavelet Features for Snore Sound Classification

Automated sleep apnea detection in snoring signal using long short-term memory neural networks

Automatic System for Obstructive Sleep Apnea Events Detection Using Convolutional Neural Network

Coherent Feature Extraction with Swarm Intelligence Based Hybrid Adaboost Weighted ELM Classification for Snoring Sound Classification

Automated Call Detection for Acoustic Surveys with Structured Calls of Varying Length

Automatic Sleep Stage Classification Using Nasal Pressure Decoding Based on a Multi-Kernel Convolutional BiLSTM Network

Obstructive Sleep Apnea Detection Based on Sleep Sounds Via Deep Learning.

An audio-semantic multimodal model for automatic obstructive sleep Apnea-Hypopnea Syndrome classification via multi-feature analysis of snoring sounds

Classification of Snoring Sound-Related Signals Based on MLP.

Sleep Sound Classification Using ANC-Enabled Earbuds.

Sleep Apnea Detection Based on Snoring Sound Analysis Using DS-MS neural network

An efficient deep model for children sleep apnea detection using snoring signals

SiCRNN: A Siamese Approach for Sleep Apnea Identification via Tracheal Microphone Signals

Multiclass classification of obstructive sleep apnea/hypopnea based on a convolutional neural network from a single-lead electrocardiogram

Convolution- and Attention-Based Neural Network for Automated Sleep Stage Classification