Abstract:Background: Plankton, including phytoplankton and zooplankton, are the main source of food for organisms in the ocean and form the base of marine food chain. As the fundamental components of marine ecosystems, plankton is very sensitive to environment changes, and the study of plankton abundance and distribution is crucial, in order to understand environment changes and protect marine ecosystems. This study was carried out to develop an extensive applicable plankton classification system with high accuracy for the increasing number of various imaging devices. Literature shows that most plankton image classification systems were limited to only one specific imaging device and a relatively narrow taxonomic scope. The real practical system for automatic plankton classification is even non-existent and this study is partly to fill this gap. Results: Inspired by the analysis of literature and development of technology, we focused on the requirements of practical application and proposed an automatic system for plankton image classification combining multiple view features via multiple kernel learning (MKL). For one thing, in order to describe the biomorphic characteristics of plankton more completely and comprehensively, we combined general features with robust features, especially by adding features like Inner-Distance Shape Context for morphological representation. For another, we divided all the features into different types from multiple views and feed them to multiple classifiers instead of only one by combining different kernel matrices computed from different types of features optimally via multiple kernel learning. Moreover, we also applied feature selection method to choose the optimal feature subsets from redundant features for satisfying different datasets from different imaging devices. We implemented our proposed classification system on three different datasets across more than 20 categories from phytoplankton to zooplankton. The experimental results validated that our system outperforms state-of-the-art plankton image classification systems in terms of accuracy and robustness. Conclusions: This study demonstrated automatic plankton image classification system combining multiple view features using multiple kernel learning. The results indicated that multiple view features combined by NLMKL using three kernel functions (linear, polynomial and Gaussian kernel functions) can describe and use information of features better so that achieve a higher classification accuracy.

Plankton Classification on Imbalanced Dataset Via Hybrid Resample Method with LightBGM

Classification of Freshwater Zooplankton by Pre-trained Convolutional Neural Network in Underwater Microscopy

Hyper-Rayleigh scattering as a means of monitoring crystal nucleation in solution.

Automated Classification of Zooplankton Based on Digital Image Processing

A Plankton Detection Method Based on Neural Networks and Digital Holographic Imaging

Automatic Recognition Method of Zooplankton Image in Dark Field

Producing Plankton Classifiers that are Robust to Dataset Shift

Automatic plankton image classification combining multiple view features via multiple kernel learning

Improving phytoplankton abundance estimation accuracy for autonomous microscopic imaging systems

Image Fusion Method for Improving the Accuracy of Ocean Plankton Recognition

Deep Learning Classification of Lake Zooplankton

WHOI-Plankton- A Large Scale Fine Grained Visual Recognition Benchmark Dataset for Plankton Classification

Deep Residual Networks For Plankton Classification

Plankton Image Classification Based on Multiple Segmentations

Automated classification of zooplankton for a towed imaging system

An automatic identification method of imbalanced lithology based on Deep Forest and K-means SMOTE

Classification of Marine Plankton Based on Few-shot Learning

Adaptive over-sampling method for classification with application to imbalanced datasets in aluminum electrolysis

Development a zooplankton recognition method for dark field image

Automated zooplankton size measurement using deep learning: Overcoming the limitations of traditional methods

A cluster impurity-based hybrid resampling for imbalanced classification problems