Abstract:Assessing the health of fish populations relies on determining the length of fish in sample species subsets, in conjunction with other key ecosystem markers; thereby, inferring overall health of communities. Despite attempts to use artificial intelligence (AI) to measure fish, most measurement remains a manual process, often necessitating fish being removed from the water. Overcoming this limitation and potentially harmful intervention by measuring fish without disturbance in their natural habitat would greatly enhance and expedite the process. Stereo baited remote underwater video systems (stereo-BRUVS) are widely used as a non-invasive, stressless method for manually counting and measuring fish in aquaculture, fisheries and conservation management. However, the application of deep learning (DL) to stereo-BRUVS image processing is showing encouraging progress towards replacing the manual and labour-intensive task of precisely locating the heads and tails of fish with computer-vision-based algorithms. Here, we present a generalised, semi-automated method for measuring the length of fish using DL with near-human accuracy for numerous species of fish. Additionally, we combine the DL method with a highly precise stereo-BRUVS calibration method, which uses calibration cubes to ensure precision within a few millimetres in calculated lengths. In a human versus DL comparison of accuracy, we show that, although DL commonly slightly over-estimates or under-estimates length, with enough repeated measurements, the two values average and converge to the same length, demonstrated by a Pearson correlation coefficient (r) of 0.99 for n=3954 measurement in 'out-of-sample' test data. We demonstrate, through the inclusion of visual examples of stereo-BRUVS scenes, the accuracy of this approach. The head-to-tail measurement method presented here builds on, and advances, previously published object detection for stereo-BRUVS. Furthermore, by replacing the manual process of four careful mouse clicks on the screen to precisely locate the head and tail of a fish in two images, with two fast clicks anywhere on that fish in those two images, a significant reduction in image processing and analysis time is expected. By reducing analysis times, more images can be processed; thereby, increasing the amount of data available for environmental reporting and decision making.

Computer vision in aquaculture: a case study of juvenile fish counting

Multi-detector and Motion Prediction-Based High-Speed Non-Intrusive Fingerling Counting Method

Improved Accuracy for Automated Counting of a Fish in Baited Underwater Videos for Stock Assessment

Multi-class Fish Stock Statistics Technology Based on Object Classification and Tracking Algorithm

Automatic Counting Algorithm of Fry Based on Machine Vision System

Automated Fish Counting System Based on Instance Segmentation in Aquaculture

Computer-Simulated Virtual Image Datasets to Train Machine Learning Models for Non-Invasive Fish Detection in Recirculating Aquaculture

Automatic Fish Population Counting by Machine Vision and a Hybrid Deep Neural Network Model

Deep learning with self-supervision and uncertainty regularization to count fish in underwater images

Accelerating Species Recognition and Labelling of Fish From Underwater Video With Machine-Assisted Deep Learning

FishNet: Deep Neural Networks for Low-Cost Fish Stock Estimation

Real-time nondestructive fish behavior detecting in mixed polyculture system using deep-learning and low-cost devices

Computer Vision Models in Intelligent Aquaculture with Emphasis on Fish Detection and Behavior Analysis: A Review

Generalised deep learning model for semi-automated length measurement of fish in stereo-BRUVS

An Automatic Detection and Counting Method for Fish Lateral Line Scales of Underwater Fish Based on Improved YOLOv5

Assessing fish abundance from underwater video using deep neural networks

Intelligent Fisheries: Cognitive Solutions for Improving Aquaculture Commercial Efficiency Through Enhanced Biomass Estimation and Early Disease Detection

A deep neural network for multi-species fish detection using multiple acoustic cameras

Machine learning-based understanding of aquatic animal behaviour in high-turbidity waters

Automatic Counting Method of Fry Based on Computer Vision

An Automatic Recognition Method for Fish Species and Length Using an Underwater Stereo Vision System