Abstract:Automatic detection and classification of animal sounds has many applications in biodiversity monitoring and animal behaviour. In the past twenty years, the volume of digitised wildlife sound available has massively increased, and automatic classification through deep learning now shows strong results. However, bioacoustics is not a single task but a vast range of small-scale tasks (such as individual ID, call type, emotional indication) with wide variety in data characteristics, and most bioacoustic tasks do not come with strongly-labelled training data. The standard paradigm of supervised learning, focussed on a single large-scale dataset and/or a generic pre-trained algorithm, is insufficient. In this work we recast bioacoustic sound event detection within the AI framework of few-shot learning. We adapt this framework to sound event detection, such that a system can be given the annotated start/end times of as few as 5 events, and can then detect events in long-duration audio -- even when the sound category was not known at the time of algorithm training. We introduce a collection of open datasets designed to strongly test a system's ability to perform few-shot sound event detections, and we present the results of a public contest to address the task. We show that prototypical networks are a strong-performing method, when enhanced with adaptations for general characteristics of animal sounds. We demonstrate that widely-varying sound event durations are an important factor in performance, as well as non-stationarity, i.e. gradual changes in conditions throughout the duration of a recording. For fine-grained bioacoustic recognition tasks without massive annotated training data, our results demonstrate that few-shot sound event detection is a powerful new method, strongly outperforming traditional signal-processing detection methods in the fully automated scenario.

Frame-Level Embedding Learning for Few-shot Bioacoustic Event Detection

Few-Shot Bioacoustic Event Detection with Frame-Level Embedding Learning System

Multitask frame-level learning for few-shot sound event detection

Reshaping Bioacoustics Event Detection: Leveraging Few-Shot Learning (FSL) with Transductive Inference and Data Augmentation

Few-shot bioacoustic event detection at the DCASE 2022 challenge

Few-shot bioacoustic event detection at the DCASE 2023 challenge

Mind the Domain Gap: a Systematic Analysis on Bioacoustic Sound Event Detection

Pretraining Representations for Bioacoustic Few-shot Detection using Supervised Contrastive Learning

Frame Pairwise Distance Loss for Weakly-supervised Sound Event Detection

Learning Frame Level Attention for Environmental Sound Classification

Few-shot Bioacoustic Event Detection with Machine Learning Methods

Coarse-to-Fine Few-Shot Defect Recognition with Dynamic Weighting and Joint Metric

Regularized Contrastive Pre-training for Few-shot Bioacoustic Sound Detection

Few-shot Defect Recognition of Metal Surfaces Via Attention-Embedding and Self-Supervised Learning

Fully Few-shot Class-incremental Audio Classification Using Expandable Dual-embedding Extractor

Proposal-based Few-shot Sound Event Detection for Speech and Environmental Sounds with Perceivers

Learning to Detect Novel and Fine-Grained Acoustic Sequences Using Pretrained Audio Representations

Joint framework with deep feature distillation and adaptive focal loss for weakly supervised audio tagging and acoustic event detection

Multi frame size feature extraction for acoustic event detection

Task-Adaptive Embedding Learning with Dynamic Kernel Fusion for Few-Shot Remote Sensing Scene Classification

Learning to detect an animal sound from five examples