Abstract:The Ocean Aware project, led by Innovasea and funded through Canada's Ocean Supercluster, is developing a fish passage observation platform to monitor fish without the use of traditional tags. This will provide an alternative to standard tracking technology, such as acoustic telemetry fish tracking, which are often not appropriate for tracking at-risk fish species protected by legislation. Rather, the observation platform uses a combination of sensors including acoustic devices, visual and active sonar, and optical cameras. This will enable more in-depth scientific research and better support regulatory monitoring of at-risk fish species in fish passages or marine energy sites. Analysis of this data will require a robust and accurate method to automatically detect fish, count fish, and classify them by species in real-time using both sonar and optical cameras. To meet this need, we developed and tested an automated real-time deep learning framework combining state of the art convolutional neural networks and Kalman filters. First, we showed that an adaptation of the widely used YOLO machine learning model can accurately detect and classify eight species of fish from a public high resolution DIDSON imaging sonar dataset captured from the Ocqueoc River in Michigan, USA. Although there has been extensive research in the literature identifying particular fish such as eel vs. non-eel and seal vs. fish, to our knowledge this is the first successful application of deep learning for classifying multiple fish species with high resolution imaging sonar. Second, we integrated the Norfair object tracking framework to track and count fish using a public video dataset captured by optical cameras from the Wells Dam fish ladder on the Columbia River in Washington State, USA. Our results demonstrate that deep learning models can indeed be used to detect, classify species, and track fish using both high resolution imaging sonar and underwater video from a fish ladder. This work is a first step toward developing a fully implemented system which can accurately detect, classify and generate insights about fish in a wide variety of fish passage environments and conditions with data collected from multiple types of sensors.

Machine Learning for Automated Detection of Migrating Adult Eels from ARIS Sonar Images

Deep Learning for Automated Detection and Identification of Migrating American Eel Anguilla Rostrata from Imaging Sonar Data.

Automated Detection, Classification and Counting of Fish in Fish Passages With Deep Learning

Behaviour of endangered European eels in proximity to a dam during downstream migration: Novel insights using high accuracy 3D acoustic telemetry

A Novel Detection Method for Underwater Moving Targets by Measuring Their ELF Emissions with Inductive Sensors.

Intelligent Detection for Artificial Lateral Line of Bio-Inspired Robotic Fish Using EMD and SVMs

Classification and Mosaicking of Side Scan Sonar Image

A video monitoring and computational system for estimating migratory juvenile fish abundance in river systems

Improving Fishing Pattern Detection from Satellite AIS Using Data Mining and Machine Learning

Automatic detection of fish and tracking of movement for ecology

A deep neural network for multi-species fish detection using multiple acoustic cameras

Deep-Learning-Based detection of recreational vessels in an estuarine soundscape in the May River, South Carolina, USA

Intelligent Detection of Underwater Fish Speed Characteristics Based on Deep Learning

AcousticIA, a deep neural network for multi-species fish detection using multiple models of acoustic cameras

Upstream migration of fishes downstream of an under-construction hydroelectric dam and implications for the operation of fish passage facilities

Machine Vision Approach for Monitoring and Quantifying Fish School Migration

Computer-Simulated Virtual Image Datasets to Train Machine Learning Models for Non-Invasive Fish Detection in Recirculating Aquaculture

Detecting Free-Ranging River Dolphin Using Deep Learning Based Algorithms

Detection of an Internal Solitary Wave by the Underwater Vehicle Based on Machine Learning

Fish Detection Using Deep Learning.

Research on Detection of Floating Objects in River and Lake Based on AI Intelligent Image Recognition