Abstract:Whistle contour extraction aims to derive animal whistles from time-frequency spectrograms as polylines. For toothed whales, whistle extraction results can serve as the basis for analyzing animal abundance, species identity, and social activities. During the last few decades, as long-term recording systems have become affordable, automated whistle extraction algorithms were proposed to process large volumes of recording data. Recently, a deep learning-based method demonstrated superior performance in extracting whistles under varying noise conditions. However, training such networks requires a large amount of labor-intensive annotation, which is not available for many species. To overcome this limitation, we present a framework of stage-wise generative adversarial networks (GANs), which compile new whistle data suitable for deep model training via three stages: generation of background noise in the spectrogram, generation of whistle contours, and generation of whistle signals. By separating the generation of different components in the samples, our framework composes visually promising whistle data and labels even when few expert annotated data are available. Regardless of the amount of human-annotated data, the proposed data augmentation framework leads to a consistent improvement in performance of the whistle extraction model, with a maximum increase of 1.69 in the whistle extraction mean F1-score. Our stage-wise GAN also surpasses one single GAN in improving whistle extraction models with augmented data. The data and code will be available at <a class="link-external link-https" href="https://github.com/Paul-LiPu/CompositeGAN" rel="external noopener nofollow">this https URL</a>\_WhistleAugment.

Robust unsupervised Tursiops aduncus whistle-event detection using gammatone multi-channel Savitzky-Golay based whistle enhancement

Robust unsupervised <i>Tursiops aduncus</i> whistle enhancement based on complete ensembled empirical optimal envelope local mean decomposition with adaptive noise

Automated Classification of Tursiops Aduncus Whistles Based on a Depth-Wise Separable Convolutional Neural Network and Data Augmentation.

A Novel Tracker of Adaptive Directional Ridge Separation and Prediction for Detecting Whistles

Automatic Segmentation and Identification of Whistles Produced by Dolphins.

Unsupervised Beluga Whistle End-Point Detection under Burst Pulse Interferences

Detection method for whistles of bottlenose dolphin(tursiops truncatus) based on spectrogram processing

Dolphin Whistle Signal Enhancement Using Nonconvex Time-Frequency Regularized Overlapping Group Shrinkage in Warm Shallow Water

Overlapping Whistle-and-Click Separation for Whale Signals

Covert Underwater Acoustic Channel-sensing Technique Using Marine Mammal Whistles

Automatic detection of estuarine dolphin whistles in spectrogram images

Sparse Representation Based on Tunable Q-Factor Wavelet Transform for Whale Click and Whistle Extraction

Learning Stage-wise GANs for Whistle Extraction in Time-Frequency Spectrograms

Automatic classification of delphinids based on the representative frequencies of whistles

Application of Wavelet Transform for the Detection of Cetacean Acoustic Signals

Using deep learning to track time × frequency whistle contours of toothed whales without human-annotated training data

Whale Vocalization Classification Using Feature Extraction With Resonance Sparse Signal Decomposition And Ridge Extraction

Spectral Entropy Based Dolphin Whistle Detection Algorithm and Its Possible Application for Biologically Inspired Communication

The Acoustical Features Analysis of Indo-Pacific Humpback Dolphins’ Whistle and Modeling Research

WhistleGAN for Biomimetic Underwater Acoustic Covert Communication

Classification of Whale Call Signals Based on the Improved YOLOv5 Model