Abstract:With the burgeoning global demand for seafood, potential solutions like aquaculture are increasingly significant, provided they address issues like pollution and food security challenges in a sustainable manner. However, significant obstacles such as disease outbreaks and inaccurate biomass estimation underscore the need for optimized solutions. This paper proposes "Fish-Sense", a deep learning-based pipeline inspired by the human visual system's ability to recognize and classify objects, developed in conjunction with fish farms, aiming to enhance disease detection and biomass estimation in the aquaculture industry. Our automated framework is two-pronged: one module for biomass estimation using deep learning algorithms to segment fish, classify species, and estimate biomass; and another for disease symptom detection symptoms, employing deep learning algorithms to classify fish into healthy and unhealthy categories, and subsequently identifying symptoms and locations of bacterial infections if a fish is classified as unhealthy. To overcome data scarcity in this field, we have created four novel real-world datasets for fish segmentation, health classification, species classification, and fish part segmentation. Our biomass estimation algorithms demonstrated substantial accuracy across five species, and the health classification. These algorithms provide a foundation for the development of industrial software solutions to improve fish health monitoring in aquaculture farms. Our integrated pipeline facilitates the transition from research to real-world applications, potentially encouraging responsible aquaculture practices. Nevertheless, these advancements must be seen as part of a comprehensive strategy aimed at improving the aquaculture industry's sustainability and efficiency, in line with the United Nations' Sustainable Development Goals' evolving interpretations. The code, trained models, and the data for this project can be obtained from the following GitHub repository: https://github.com/Vision-At-SEECS/Fish-Sense.

Salmon Origin Traceability Based on Hyperspectral Imaging Data Fusion Strategy and Improved Deep Learning Method

Semi-supervised learning-based live fish identification in aquaculture using modified deep convolutional generative adversarial networks

Feature Fusion of Body Surface and Motion-Based Instance Segmentation for High-Density Fish in Industrial Aquaculture

Deep machine learning identified fish flesh using multispectral imaging

Non-destructive Classification of Sturgeon Stress Using Cross-Modal Data Fusion and Multi-Input Deep Learning Models

A Non-Destructive Detection Method of Protein and TVB-N Content Changes in Refrigerated and Frozen-Thawed Salmon Fillets Using Fluorescence Hyperspectral Technology

Off-flavor profiling of cultured salmonids using hyperspectral imaging combined with machine learning

The role of news sentiment in salmon price prediction using deep learning

Comparison of Hyperspectral Imaging and Computer Vision for Automatic Differentiation of Organically and Conventionally Farmed Salmon

Atlantic Salmon Adulteration Authentication by Machine Learning Using Bioimpedance Non-Destructive Flexible Sensing

An integrated three-stream network model for discriminating fish feeding intensity using multi-feature analysis and deep learning

Multi-Frequency Bioimpedance Combined with Machine Learning for Frozen-Thawed Quality Evaluation of Atlantic Salmon

Fingerprint Approaches Coupled with Chemometrics to Discriminate Geographic Origin of Imported Salmon in China’s Consumer Market

Machine Learning for Raman Spectroscopy-based Cyber-Marine Fish Biochemical Composition Analysis

Data fusion of near-infrared and Raman spectroscopy: An innovative tool for non-destructive prediction of the TVB-N content of salmon samples

A Deep CNN-Based Salinity and Freshwater Fish Identification and Classification Using Deep Learning and Machine Learning

A Novel Machine-Learning Framework Based on a Hierarchy of Dispute Models for the Identification of Fish Species Using Multi-Mode Spectroscopy

Intelligent Fisheries: Cognitive Solutions for Improving Aquaculture Commercial Efficiency Through Enhanced Biomass Estimation and Early Disease Detection

Assessment of Fish Health Status for Waterless Transportation Based on Image Features and Deep Learning Models

Rapid Identification of Fish Species by Laser-Induced Breakdown Spectroscopy and Raman Spectroscopy Coupled with Machine Learning Methods.

A novel automatic detection method for abnormal behavior of single fish using image fusion