Abstract:Underwater imaging enables nondestructive plankton sampling at frequencies, durations, and resolutions unattainable by traditional methods. These systems necessitate automated processes to identify organisms efficiently. Early underwater image processing used a standard approach: binarizing images to segment targets, then integrating deep learning models for classification. While intuitive, this infrastructure has limitations in handling high concentrations of biotic and abiotic particles, rapid changes in dominant taxa, and highly variable target sizes. To address these challenges, we introduce a new framework that starts with a scene classifier to capture large within-image variation, such as disparities in the layout of particles and dominant taxa. After scene classification, scene-specific Mask regional convolutional neural network (Mask R-CNN) models are trained to separate target objects into different groups. The procedure allows information to be extracted from different image types, while minimizing potential bias for commonly occurring features. Using in situ coastal plankton images, we compared the scene-specific models to the Mask R-CNN model encompassing all scene categories as a single full model. Results showed that the scene-specific approach outperformed the full model by achieving a 20% accuracy improvement in complex noisy images. The full model yielded counts that were up to 78% lower than those enumerated by the scene-specific model for some small-sized plankton groups. We further tested the framework on images from a benthic video camera and an imaging sonar system with good results. The integration of scene classification, which groups similar images together, can improve the accuracy of detection and classification for complex marine biological images.

DeepSeaNet: A Bio-Detection Network Enabling Species Identification in the Deep Sea Imagery

Identification of Soft Shell Shrimp Based on Deep Learning

Deepwater-SE: A new automatic fish classification network based on deep learning

FDCNet: Filtering Deep Convolutional Network for Marine Organism Classification.

Microscopic image recognition of diatoms based on deep learning.

Deep Learning-Based Recognition of Underwater Target

MASNet: A Robust Deep Marine Animal Segmentation Network

Marine Organism Detection and Classification from Underwater Vision Based on the Deep CNN Method

Taming the Data Deluge: a Novel End-to-end Deep Learning System for Classifying Marine Biological and Environmental Images

Deep Learning Based Algae Detection Method.

DAMNet: Dual Attention Mechanism Deep Neural Network for Underwater Biological Image Classification

Deepdive: Leveraging Pre-trained Deep Learning for Deep-Sea ROV Biota Identification in the Great Barrier Reef

Deep-Sea Debris Identification Using Deep Convolutional Neural Networks

CATNet: Cascaded Attention Transformer Network for Marine Species Image Classification

Instant Deep Sea Debris Detection for Maneuverable Underwater Machines to Build Sustainable Ocean Using Deep Neural Network

HSF-Net: Multiscale Deep Feature Embedding for Ship Detection in Optical Remote Sensing Imagery.

A Multichannel-Based Deep Learning Framework for Ocean SAR Scene Classification

Underwater Species Detection using Channel Sharpening Attention

BenthicNet: A global compilation of seafloor images for deep learning applications

Research on Underwater Target Recognition Technology Based on Neural Network