Abstract:Audio recordings have emerged as a pivotal tool in field observations, enriching environmental monitoring in both the spatial and temporal dimensions. However, the richness and complexity of these recordings pose significant challenges, primarily when extracting specific sound clips from long recordings owing to the presence of ambient noise and other irrelevant sounds. Traditional methods, such as manual extraction or a sliding window over audio segments, hinder practical bioacoustic applications. Therefore, we propose a framework that begins with a robust segmentation method for extracting sound clips that potentially contain deer vocalizations. This segmentation method relies on acoustic anomaly detection and can markedly improve computational efficiency, facilitating deployment in environments with limited resources. Subsequently, the isolated clips were classified into deer and non-deer categories using machine learning models. Our investigation assessed three state-of-the-art deep learning models, ResNet50, MobileNetV2, and EfficientNet-B2, considering various hyperparameter configurations to optimize the performance. We utilized 3842 clips from two sites, Oze National Park and Taki, for training and testing. The outcomes demonstrated that all models exhibited comparable performances, with median accuracies of 98.3 % and 92.9 % during the validation and testing stages, respectively. However, no single model outperformed the others across all the evaluation metrics. For instance, ResNet50 in different configurations led to the best accuracy, F1 score, precision, and specificity, whereas MobileNetV2 had the best recall. Therefore, we adopted a consensus-based ensemble scoring system in which an audio clip was classified as a deer call when at least two of three models concurred in their classification to enhance the reliability of our classifications. Our findings demonstrated that the Ensemble approach significantly enhanced the classification performance, achieving an accuracy of 99.2 % in the test stage. The proposed approach was successfully deployed during the deer rutting seasons in Oze and Taki in 2019 and 2021, respectively. We gained invaluable insights into deer behavior by analyzing deer calls' frequency, timing, and duration. Additionally, the spatial distribution of deer calls in Taki enabled us to detect a breach in the city's protective fencing and an association between the spatial patterns of deer calls and crop damage in the two fields. We aimed to draw a comprehensive picture of deer activity, which has significant implications for both conservation efforts and understanding animal behavior in various habitats. The insights gathered from this research contribute to the scientific understanding of deer behavior and serve as a foundation for future studies and conservation initiatives. By incorporating advanced machine learning models into environmental monitoring, we have paved the way for more data-driven approaches in wildlife research.

Automated detection of Bornean white-bearded gibbon (Hylobates albibarbis) vocalisations using an open-source framework for deep learning

Automated detection of Bornean white-bearded gibbon (Hylobates albibarbis) vocalizations using an open-source framework for deep learning

Automated detection of gibbon calls from passive acoustic monitoring data using convolutional neural networks in the "torch for R" ecosystem

A workflow for the automated detection and classification of female gibbon calls from long-term acoustic recordings

Automated Call Detection for Acoustic Surveys with Structured Calls of Varying Length

Using Deep Learning to Classify Environmental Sounds in the Habitat of Western Black-Crested Gibbons

Methods for processing and analyzing passive acoustic monitoring data: An example of song recognition in western black-crested gibbons

Benchmarking automated detection and classification approaches for monitoring of endangered species: a case study on gibbons from Cambodia

Automatic Sound Event Detection and Classification of Great Ape Calls Using Neural Networks

Mel-frequency cepstral coefficients outperform embeddings from pre-trained convolutional neural networks under noisy conditions for discrimination tasks of individual gibbons

In the songs of Hainan gibbons: Automated individual dynamic monitoring from acoustic recordings

Ensemble deep learning and anomaly detection framework for automatic audio classification: Insights into deer vocalizations

GIBBONFINDR: An R package for the detection and classification of acoustic signals

Automatic Detection and Compression for Passive Acoustic Monitoring of the African Forest Elephant

An integrated passive acoustic monitoring and deep learning pipeline for black‐and‐white ruffed lemurs (Varecia variegata) in Ranomafana National Park, Madagascar

Deep learning in marine bioacoustics: a benchmark for baleen whale detection

Learning to rumble: Automated elephant call classification, detection and endpointing using deep architectures

Utilizing DeepSqueak for automatic detection and classification of mammalian vocalizations: a case study on primate vocalizations

Pairing a user‐friendly machine‐learning animal sound detector with passive acoustic surveys for occupancy modeling of an endangered primate

Introducing a Central African Primate Vocalisation Dataset for Automated Species Classification

Development of deep neural networks for marine mammal call detection using an open-source, user friendly tool