Abstract:Assessing the health of fish populations relies on determining the length of fish in sample species subsets, in conjunction with other key ecosystem markers; thereby, inferring overall health of communities. Despite attempts to use artificial intelligence (AI) to measure fish, most measurement remains a manual process, often necessitating fish being removed from the water. Overcoming this limitation and potentially harmful intervention by measuring fish without disturbance in their natural habitat would greatly enhance and expedite the process. Stereo baited remote underwater video systems (stereo-BRUVS) are widely used as a non-invasive, stressless method for manually counting and measuring fish in aquaculture, fisheries and conservation management. However, the application of deep learning (DL) to stereo-BRUVS image processing is showing encouraging progress towards replacing the manual and labour-intensive task of precisely locating the heads and tails of fish with computer-vision-based algorithms. Here, we present a generalised, semi-automated method for measuring the length of fish using DL with near-human accuracy for numerous species of fish. Additionally, we combine the DL method with a highly precise stereo-BRUVS calibration method, which uses calibration cubes to ensure precision within a few millimetres in calculated lengths. In a human versus DL comparison of accuracy, we show that, although DL commonly slightly over-estimates or under-estimates length, with enough repeated measurements, the two values average and converge to the same length, demonstrated by a Pearson correlation coefficient (r) of 0.99 for n=3954 measurement in 'out-of-sample' test data. We demonstrate, through the inclusion of visual examples of stereo-BRUVS scenes, the accuracy of this approach. The head-to-tail measurement method presented here builds on, and advances, previously published object detection for stereo-BRUVS. Furthermore, by replacing the manual process of four careful mouse clicks on the screen to precisely locate the head and tail of a fish in two images, with two fast clicks anywhere on that fish in those two images, a significant reduction in image processing and analysis time is expected. By reducing analysis times, more images can be processed; thereby, increasing the amount of data available for environmental reporting and decision making.

PSII-6 Deep Learning image segmentation for extraction of body measurements and prediction of body weight in Nile tilapia

Deep Learning image segmentation for extraction of fish body measurements and prediction of body weight and carcass traits in Nile tilapia

Feature Fusion of Body Surface and Motion-Based Instance Segmentation for High-Density Fish in Industrial Aquaculture

Estimation of Injection Site in Turbot Based on Image Segmentation

Multi-Scale Fish Segmentation Refinement and Missing Shape Recovery

Stereo Vison and Mask-RCNN Segmentation Based 3D Points Cloud Matching for Fish Dimension Measurement

A Method for Estimating the Injection Position of Turbot (scophthalmus Maximus) Using Semantic Segmentation

Computer vision system using deep learning to predict rib and loin yield in the fish Colossoma macropomum.

Real-time Tilapia Fillet Defect Segmentation on Edge Device for Robotic Trimming

Coarse-To-Fine Segmentation Refinement and Missing Shape Recovery for Halibut Fish

Automatic Weight Estimation of Harvested Fish from Images

Non-Intrusive Fish Weight Estimation in Turbid Water Using Deep Learning and Regression Models

Non-Invasive Fish Biometrics for Enhancing Precision and Understanding of Aquaculture Farming through Statistical Morphology Analysis and Machine Learning

Accurate Segmentation of Tilapia Fish Body Parts Based on Deeplabv3+ for Advancing Phenotyping Applications

Identifying geographically differentiated features of Ethopian Nile tilapia (Oreochromis niloticus) morphology with machine learning

Deep Convolutional Neural Networks for Fish Weight Prediction from Images

Simultaneous, vision-based fish instance segmentation, species classification and size regression

Generalised deep learning model for semi-automated length measurement of fish in stereo-BRUVS

Automatic measurement of fish from images using convolutional neural networks

Automated Measurement of Ovary Development in Atlantic Salmon Using Deep Learning

FishNet: Deep Neural Networks for Low-Cost Fish Stock Estimation