Abstract:Underwater acoustic cameras are high potential devices for many applications in ecology, notably for fisheries management and monitoring. However how to extract such data into high value information without a time-consuming entire dataset reading by an operator is still a challenge. Moreover the analysis of acoustic imaging, due to its low signal-to-noise ratio, is a perfect training ground for experimenting with new approaches, especially concerning Deep Learning techniques. We present hereby a novel approach that takes advantage of both CNN (Convolutional Neural Network) and classical CV (Computer Vision) techniques, able to detect a generic class ''fish'' in acoustic video streams. The pipeline pre-treats the acoustic images to extract 2 features, in order to localise the signals and improve the detection performances. To ensure the performances from an ecological point of view, we propose also a two-step validation, one to validate the results of the trainings and one to test the method on a real-world scenario. The YOLOv3-based model was trained with data of fish from multiple species recorded by the two common acoustic cameras, DIDSON and ARIS, including species of high ecological interest, as Atlantic salmon or European eels. The model we developed provides satisfying results detecting almost 80% of fish and minimizing the false positive rate, however the model is much less efficient for eel detections on ARIS videos. The first CNN pipeline for fish monitoring exploiting video data from two models of acoustic cameras satisfies most of the required features. Many challenges are still present, such as the automation of fish species identification through a multiclass model. 1 However the results point a new solution for dealing with complex data, such as sonar data, which can also be reapplied in other cases where the signal-to-noise ratio is a challenge.

Convolutional neural networks for passive monitoring of a shallow water environment using a single sensor

Passive ship detection and classification using hybrid cepstrums and deep compound autoencoders

Underwater Target Classification at Greater Depths Using Deep Neural Network with Joint Multiple‐domain Feature

Continual Learning of Range-Dependent Transmission Loss for Underwater Acoustic using Conditional Convolutional Neural Net

Design of a Deep Learning-Based Underwater Acoustic Sensor Transceiver

Source Depth Estimation Using Spectral Transformations and Convolutional Neural Network in a Deep-Sea Environment.

Detection of underwater acoustic target using beamforming and neural network in shallow water

Underwater Target Recognition Using a Lightweight Asymmetric Convolutional Neural Network

Underwater Acoustic Target Recognition Method Based on Feature Fusion and Residual CNN

Combining Denoising Autoencoders and Dynamic Programming for Acoustic Detection and Tracking of Underwater Moving Targets

A parallel convolutional neural network-transformer model for underwater target recognition based on multimodal feature learning

Remote Passive Acoustic Signal Detection Using Multi-Scale Correlation Networks and Network Spectrum Distance in Marine Environment.

Deep learning for source localization and seabed classification under dynamic oceanographic environments using explosive sound signals

Deep neural network for learning wave scattering and interference of underwater acoustics

A deep neural network for multi-species fish detection using multiple acoustic cameras

A passive sonar based underwater acoustic channel model for improved search and rescue operations in deep sea

Passive tracking of underwater acoustic targets based on multi-beam LOFAR and deep learning

Underwater Reverberation Suppression Via Attention and Cepstrum Analysis-Guided Network

Expendable Conductivity–Temperature–Depth-Assisted Fast Underwater Sound Speed Estimation by Convolutional Neural Network with Reduced Fully Connected Layers

Underwater Acoustic Target Classification Based on Dense Convolutional Neural Network

Real-time Estimation of Underwater Sound Speed Profiles with a Data Fusion Convolutional Neural Network Model