Abstract:The Ocean Aware project, led by Innovasea and funded through Canada's Ocean Supercluster, is developing a fish passage observation platform to monitor fish without the use of traditional tags. This will provide an alternative to standard tracking technology, such as acoustic telemetry fish tracking, which are often not appropriate for tracking at-risk fish species protected by legislation. Rather, the observation platform uses a combination of sensors including acoustic devices, visual and active sonar, and optical cameras. This will enable more in-depth scientific research and better support regulatory monitoring of at-risk fish species in fish passages or marine energy sites. Analysis of this data will require a robust and accurate method to automatically detect fish, count fish, and classify them by species in real-time using both sonar and optical cameras. To meet this need, we developed and tested an automated real-time deep learning framework combining state of the art convolutional neural networks and Kalman filters. First, we showed that an adaptation of the widely used YOLO machine learning model can accurately detect and classify eight species of fish from a public high resolution DIDSON imaging sonar dataset captured from the Ocqueoc River in Michigan, USA. Although there has been extensive research in the literature identifying particular fish such as eel vs. non-eel and seal vs. fish, to our knowledge this is the first successful application of deep learning for classifying multiple fish species with high resolution imaging sonar. Second, we integrated the Norfair object tracking framework to track and count fish using a public video dataset captured by optical cameras from the Wells Dam fish ladder on the Columbia River in Washington State, USA. Our results demonstrate that deep learning models can indeed be used to detect, classify species, and track fish using both high resolution imaging sonar and underwater video from a fish ladder. This work is a first step toward developing a fully implemented system which can accurately detect, classify and generate insights about fish in a wide variety of fish passage environments and conditions with data collected from multiple types of sensors.

FinSecure: Utilizing IoT Sensors for Formaldehyde Detection and Fish Freshness Detection for Enhancing Safety in Fish Consumption Using Machine Learning and Deep Learning

Online Fish Tracking with Portable Smart Device for Ocean Observatory Network

IoT-Based Environmental Control System for Fish Farms with Sensor Integration and Machine Learning Decision Support

Intelligent Fisheries: Cognitive Solutions for Improving Aquaculture Commercial Efficiency Through Enhanced Biomass Estimation and Early Disease Detection

Detection of fish freshness using artificial intelligence methods

Pattern detection and prediction using deep learning for intelligent decision support to identify fish behaviour in aquaculture

Smart System for Freshwater Pisciculture(Ornamental Fish Farming)

Automated Detection, Classification and Counting of Fish in Fish Passages With Deep Learning

Internet of Things-Driven Precision in Fish Farming: A Deep Dive into Automated Temperature, Oxygen, and pH Regulation

IoT Based Smart Betta Fish Monitoring system with fish fatality prediction.

An Optimal Internet of Things-Driven Intelligent Decision-Making System for Real-Time Fishpond Water Quality Monitoring and Species Survival

Sustainable IoT Solution for Freshwater Aquaculture Management

An advanced Bangladeshi local fish classification system based on the combination of deep learning and the internet of things (IoT)

A Machine Learning Approach for Early Detection of Fish Diseases by Analyzing Water Quality

IoT based Smart Aquaculture Monitoring System for Fish Tank Management

Improved accuracy in IoT-Based water quality monitoring for aquaculture tanks using low-cost sensors: Asian seabass fish farming

Supervised learning-based artificial senses for non-destructive fish quality classification

Integration of lanthanide MOFs/methylcellulose-based fluorescent sensor arrays and deep learning for fish freshness monitoring

IoT based Smart Water Quality Prediction for Biofloc Aquaculture

Fish quality evaluation by sensor and machine learning: A mechanistic review

A Deep CNN-Based Salinity and Freshwater Fish Identification and Classification Using Deep Learning and Machine Learning