Abstract:Soundscape ecologists aim to study the acoustic characteristics of an area that reflects natural processes [Schafer, 1977]. These sounds can be interpreted as biological (biophony), geophysical (geophony), and human-produced (anthrophony) [Pijanowski et al., 2011]. A common task is to use sounds to identify species based on the frequency content of a given signal. This signal can be further converted into spectrograms enabling other types of analysis to automate the identification of species. Based on the promising results of deep learning methods, such as Convolution Neural Networks (CNNs) in image classification, here we propose the use of a pre-trained VGG16 CNN architecture to identify two nocturnal avian species, namely Antrostomus rufus and Megascops choliba, commonly encountered in Brazilian forests. Monitoring the abundance of these species is important to ecologists to develop conservation programmes, detect environmental disturbances and assess the impact of human action. Specialists recorded sounds in 16-bit wave files at a sampling rate of 44Hz and classified the presence of these species. With the classified wave files, we created additional classes to visualise the performance of the VGG16 CNN architecture for detecting both species. We end up with six categories containing 60 seconds of audio of species vocalisation combinations and background only sounds. We produced spectrograms using the information from each RGB channel, only one channel (grey-scale), and applied the histogram equalisation technique to the grey-scale images. A comparison of the system performance using histogram equalised images and unmodified images was made. Histogram equalisation improves the contrast, and so the visibility to the human observer. Investigating the effect of histogram equalisation on the performance of the CNN was a feature of this study. Moreover, to show the practical application of our work, we created 51 minutes of audio, which contains more noise than the presence of both species (a scenario commonly encountered in field surveys). Our results showed that the trained VGG16 CNN produced, after 8000 epochs, a training accuracy of 100% for the three approaches. The test accuracy was 80.64%, 75.26%, and 67.74% for the RGB, grey-scaled, and histogram equalised approaches. The method’s accuracy on the synthetic audio file of 51 minutes was 92.15%. This accuracy level reveals the potential of CNN architectures in automating species detection and identification by sound using passive monitoring. Our results suggest that using coloured images to represent the spectrogram better generalises the classification than grey-scale and histogram equalised images. This study might develop future avian monitoring programmes based on passive sound recording, which significantly enhances sampling size without increasing cost.

Assessing the potential of BirdNET to infer European bird communities from large-scale ecoacoustic data

BirdNET is as good as experts for acoustic bird monitoring in a European city

A post‐processing framework for assessing BirdNET identification accuracy and community composition

Artificial intelligence (BirdNET) supplements manual methods to maximize bird species richness from acoustic datasets generated from regional monitoring

Living Together, Singing Together: Revealing Similar Patterns of Vocal Activity in Two Tropical Songbirds Applying BirdNET

Automatic acoustic detection of birds through deep learning: the first Bird Audio Detection challenge

Guidelines for appropriate use of BirdNET scores and other detector outputs

NBM: an Open Dataset for the Acoustic Monitoring of Nocturnal Migratory Birds in Europe

A ready-to use workflow for automated, sound-based bird identification and localization

Deep Networks tag the location of bird vocalisations on audio spectrograms

Aggregated time‐series features boost species‐specific differentiation of true and false positives in passive acoustic monitoring of bird assemblages

Bioacoustic classification of avian calls from raw sound waveforms with an open-source deep learning architecture

Western Mediterranean wetlands bird species classification: evaluating small-footprint deep learning approaches on a new annotated dataset

Wavelet Filters for Automated Recognition of Birdsong in Long‐time Field Recordings

Multi-Index Ecoacoustics Analysis for Terrestrial Soundscapes: A New Semi-Automated Approach Using Time-Series Motif Discovery and Random Forest Classification

Acoustic animal identification using unsupervised learning

Acoustic detection rate can outperform traditional survey approaches in estimating relative densities of breeding waders

Deep learning for detection of bird vocalisations

BatNet: a deep learning‐based tool for automated bat species identification from camera trap images

A machine vision system for avian song classification with CNN’s

Automated Bioacoustic Monitoring for South African Bird Species on Unlabeled Data