Abstract:Underwater imaging enables nondestructive plankton sampling at frequencies, durations, and resolutions unattainable by traditional methods. These systems necessitate automated processes to identify organisms efficiently. Early underwater image processing used a standard approach: binarizing images to segment targets, then integrating deep learning models for classification. While intuitive, this infrastructure has limitations in handling high concentrations of biotic and abiotic particles, rapid changes in dominant taxa, and highly variable target sizes. To address these challenges, we introduce a new framework that starts with a scene classifier to capture large within-image variation, such as disparities in the layout of particles and dominant taxa. After scene classification, scene-specific Mask regional convolutional neural network (Mask R-CNN) models are trained to separate target objects into different groups. The procedure allows information to be extracted from different image types, while minimizing potential bias for commonly occurring features. Using in situ coastal plankton images, we compared the scene-specific models to the Mask R-CNN model encompassing all scene categories as a single full model. Results showed that the scene-specific approach outperformed the full model by achieving a 20% accuracy improvement in complex noisy images. The full model yielded counts that were up to 78% lower than those enumerated by the scene-specific model for some small-sized plankton groups. We further tested the framework on images from a benthic video camera and an imaging sonar system with good results. The integration of scene classification, which groups similar images together, can improve the accuracy of detection and classification for complex marine biological images.

Classification of Marine Plankton Based on Few-shot Learning

Classification of Freshwater Zooplankton by Pre-trained Convolutional Neural Network in Underwater Microscopy

Bagging based plankton image classification

Leveraging the Feature Distribution Calibration and Data Augmentation for Few-Shot Classification in Fish Counting.

Classification of Phytoplankton Digital Holograms Using Transfer Learning

Identification of Soft Shell Shrimp Based on Deep Learning

Few-shot Learning for Domain-specific Fine-grained Image Classification

Automatic Classification of Marine Plankton with Digital Holography Using Convolutional Neural Network

A Plankton Detection Method Based on Neural Networks and Digital Holographic Imaging

Toward efficient deep learning system for in-situ plankton image recognition

A Comparison of Few-Shot Learning Methods for Underwater Optical and Sonar Image Classification

Deep Learning Classification of Lake Zooplankton

Rapid detection for optical micrograph of plankton in ballast water based on neural network

Deep Residual Networks For Plankton Classification

Knowledge-Based Fine-Grained Classification for Few-Shot Learning.

Improving plankton image classification using context metadata

A Metric-Based Few-Shot Learning Method for Fish Species Identification with Limited Samples

Anomaly Detection for in Situ Marine Plankton Images.

Taming the Data Deluge: a Novel End-to-end Deep Learning System for Classifying Marine Biological and Environmental Images

Pairwise Nonparametric Discriminant Analysis for Binary Plankton Image Recognition

Beyond transfer learning: Leveraging ancillary images in automated classification of plankton