Abstract:Whale vocal calls contain valuable information and abundant characteristics that are important for classification of whale sub-populations and related biological research. In this study, an effective data-driven approach based on pre-trained Convolutional Neural Networks (CNN) using multi-scale waveforms and time-frequency feature representations is developed in order to perform the classification of whale calls from a large open-source dataset recorded by sensors carried by whales. Specifically, the classification is carried out through a transfer learning approach by using pre-trained state-of-the-art CNN models in the field of computer vision. 1D raw waveforms and 2D log-mel features of the whale-call data are respectively used as the input of CNN models. For raw waveform input, windows are applied to capture multiple sketches of a whale-call clip at different time scales and stack the features from different sketches for classification. When using the log-mel features, the delta and delta-delta features are also calculated to produce a 3-channel feature representation for analysis. In the training, a 4-fold cross-validation technique is employed to reduce the overfitting effect, while the Mix-up technique is also applied to implement data augmentation in order to further improve the system performance. The results show that the proposed method can improve the accuracies by more than 20% in percentage for the classification into 16 whale pods compared with the baseline method using groups of 2D shape descriptors of spectrograms and the Fisher discriminant scores on the same dataset. Moreover, it is shown that classifications based on log-mel features have higher accuracies than those based directly on raw waveforms. The phylogeny graph is also produced to significantly illustrate the relationships among the whale sub-populations.

Automated Classification of Tursiops Aduncus Whistles Based on a Depth-Wise Separable Convolutional Neural Network and Data Augmentation.

Automated Classification of Dolphin Whistles Based on the Convolutional Neural Network

Classification of Cetacean Whistles Based on Convolutional Neural Network.

Robust unsupervised Tursiops aduncus whistle-event detection using gammatone multi-channel Savitzky-Golay based whistle enhancement

Robust unsupervised <i>Tursiops aduncus</i> whistle enhancement based on complete ensembled empirical optimal envelope local mean decomposition with adaptive noise

Automatic Segmentation and Identification of Whistles Produced by Dolphins.

Classification of Whale Call Signals Based on the Improved YOLOv5 Model

Automatic classification of delphinids based on the representative frequencies of whistles

A Novel Tracker of Adaptive Directional Ridge Separation and Prediction for Detecting Whistles

Dolphin Whistle Signal Enhancement Using Nonconvex Time-Frequency Regularized Overlapping Group Shrinkage in Warm Shallow Water

Whale Vocalization Classification Using Feature Extraction With Resonance Sparse Signal Decomposition And Ridge Extraction

Using deep learning to track time × frequency whistle contours of toothed whales without human-annotated training data

Marine Mammal Species Classification Using Convolutional Neural Networks and a Novel Acoustic Representation

Data augmentation for the classification of North Atlantic right whales upcalls

Large-Scale Whale-Call Classification by Transfer Learning on Multi-Scale Waveforms and Time-Frequency Features

Application to the Call of Southern Right Whale

Design of Classification System of Whales Sound Signal

The Acoustical Features Analysis of Indo-Pacific Humpback Dolphins’ Whistle and Modeling Research

Automated detection of dolphin whistles with convolutional networks and transfer learning

Learning Stage-wise GANs for Whistle Extraction in Time-Frequency Spectrograms

Covert Underwater Acoustic Channel-sensing Technique Using Marine Mammal Whistles