Abstract:Whale vocal calls contain valuable information and abundant characteristics that are important for classification of whale sub-populations and related biological research. In this study, an effective data-driven approach based on pre-trained Convolutional Neural Networks (CNN) using multi-scale waveforms and time-frequency feature representations is developed in order to perform the classification of whale calls from a large open-source dataset recorded by sensors carried by whales. Specifically, the classification is carried out through a transfer learning approach by using pre-trained state-of-the-art CNN models in the field of computer vision. 1D raw waveforms and 2D log-mel features of the whale-call data are respectively used as the input of CNN models. For raw waveform input, windows are applied to capture multiple sketches of a whale-call clip at different time scales and stack the features from different sketches for classification. When using the log-mel features, the delta and delta-delta features are also calculated to produce a 3-channel feature representation for analysis. In the training, a 4-fold cross-validation technique is employed to reduce the overfitting effect, while the Mix-up technique is also applied to implement data augmentation in order to further improve the system performance. The results show that the proposed method can improve the accuracies by more than 20% in percentage for the classification into 16 whale pods compared with the baseline method using groups of 2D shape descriptors of spectrograms and the Fisher discriminant scores on the same dataset. Moreover, it is shown that classifications based on log-mel features have higher accuracies than those based directly on raw waveforms. The phylogeny graph is also produced to significantly illustrate the relationships among the whale sub-populations.

Classification of Whale Call Signals Based on the Improved YOLOv5 Model

Acoustic Image Target Detection Method Based on the Fusion of RepVGG-ECA and YOLOv5

Research on Underwater Small Target Detection Algorithm Based on Improved YOLOv3

Fish Detection and Classification Based on Improved ViT

MDM-YOLO: Research on Object Detection Algorithm Based on Improved YOLOv4 for Marine Organisms.

Application to the Call of Southern Right Whale

Large-Scale Whale-Call Classification by Transfer Learning on Multi-Scale Waveforms and Time-Frequency Features

Design of Classification System of Whales Sound Signal

A YOLOv5s Algorithm Model Applied to Underwater Object Detection

Underwater Target Detection Based on Improved Yolov5

Ship Object Detection and Classification Based on Improved YOLOv5

Underwater Target Detection by Side-Scan Sonar Based on Yolov7-Attention

Classification of Cetacean Whistles Based on Convolutional Neural Network.

An Improved YOLOv5 Underwater Detector Based on an Attention Mechanism and Multi-Branch Reparameterization Module

A classification method of marine mammal calls based on two-channel fusion network

Whale Vocalization Classification Using Feature Extraction With Resonance Sparse Signal Decomposition And Ridge Extraction

Underwater target recognition algorithm based on improved convolutional neural network: YOLOV5-Improved

Optical Remote Sensing Ship Recognition and Classification Based on Improved YOLOv5

Underwater Target Detection Algorithm Based on Improved YOLOv5

Large-Scale Whale Call Classification Using Deep Convolutional Neural Network Architectures

Automated Classification of Tursiops Aduncus Whistles Based on a Depth-Wise Separable Convolutional Neural Network and Data Augmentation.