A Deep Learning-based Framework for the Detection of Schools of Herring in Echograms

Alireza Rezvanifar,Tunai Porto Marques,Melissa Cote,Alexandra Branzan Albu,Alex Slonimer,Thomas Tolhurst,Kaan Ersahin,Todd Mudge,Stephane Gauthier

DOI: https://doi.org/10.48550/arXiv.1910.08215

2019-10-18

Abstract:Tracking the abundance of underwater species is crucial for understanding the effects of climate change on marine ecosystems. Biologists typically monitor underwater sites with echosounders and visualize data as 2D images (echograms); they interpret these data manually or semi-automatically, which is time-consuming and prone to inconsistencies. This paper proposes a deep learning framework for the automatic detection of schools of herring from echograms. Experiments demonstrated that our approach outperforms a traditional machine learning algorithm using hand-crafted features. Our framework could easily be expanded to detect more species of interest to sustainable fisheries.

Machine Learning,Computer Vision and Pattern Recognition,Image and Video Processing

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to improve the efficiency and accuracy of underwater species abundance monitoring through automatic detection methods, especially for the detection of schools of herring in echograms. Specifically: 1. **Limitations of Manual or Semi - automatic Analysis**: Currently, biologists mainly rely on manual or semi - automatic methods to interpret echogram data, which are time - consuming and prone to inconsistent results. 2. **Need for Automatic Detection**: In order to process and interpret a large amount of echogram data more efficiently and reduce the errors caused by human intervention, researchers have proposed a deep - learning - based framework to automatically detect schools of herring in echograms. 3. **Improvement of Existing Methods**: Traditional methods usually use hand - crafted features combined with classical machine - learning algorithms for classification, while this paper proposes a new deep - learning framework, aiming to surpass existing methods and provide higher accuracy and robustness. ### Specific Objectives - **Improve Data Processing and Interpretation Efficiency**: Reduce processing time, required manpower and result inconsistency through an automated process. - **Support Research on the Impact of Climate Change**: Provide a reliable tool for studying the impact of climate change on marine ecosystems. - **Expand to Other Species**: This framework is not limited to schools of herring, but can also be extended to other underwater species that can be monitored by sonar, such as krill, salmon, etc. ### Main Contributions 1. **Proposed a Novel Application of Deep - Learning Technology**: For detecting fish, especially schools of herring, from echograms, surpassing the few existing related works. 2. **Automated Sonar Data Analysis**: Reduced processing time and manpower requirements, while improving the consistency and reliability of results. Through these improvements, this framework can help scientists process and analyze a large amount of sonar data more efficiently, thus better understanding the dynamic changes of underwater ecosystems and their responses to environmental factors.

A Deep Learning-based Framework for the Detection of Schools of Herring in Echograms

A Robust Underwater Multiclass Fish-School Tracking Algorithm

Fish Detection and Classification Based on Improved ViT

Automated Detection, Classification and Counting of Fish in Fish Passages With Deep Learning

Developing a hybrid model with multiview learning for acoustic classification of Atlantic herring schools

A deep neural network for multi-species fish detection using multiple acoustic cameras

Fish Trajectory Extraction Based on Object Detection

A Feature-Enhanced and Adaptive Routing Framework for Fish School Detection On AUVs for Degraded Underwater Imaging Environments

A high-density fish school segmentation framework for biomass statistics in a deep-sea cage

A Feature Learning and Object Recognition Framework for Underwater Fish Images

A Deep Framework for Eddy Detection and Tracking From Satellite Sea Surface Height Data

Fish detection and species classification in underwater environments using deep learning with temporal information

Automatic Recognition of Fish Behavior with a Fusion of RGB and Optical Flow Data Based on Deep Learning

AcousticIA, a deep neural network for multi-species fish detection using multiple models of acoustic cameras

Underwater Backscatter Recognition Using Deep Fuzzy Extreme Convolutional Neural Network Optimized via Hunger Games Search

Fish Monitoring from Low-Contrast Underwater Images

Advanced deep learning framework for underwater object detection with multibeam forward-looking sonar

Applications of Deep Learning in Fish Habitat Monitoring: A Tutorial and Survey

A Deep Learning Approach for Object Detection of Rockfish in Challenging Underwater Environments

Accelerating Species Recognition and Labelling of Fish From Underwater Video With Machine-Assisted Deep Learning

Deep learning with self-supervision and uncertainty regularization to count fish in underwater images