Abstract:Planktonic organisms are key components of aquatic ecosystems and respond quickly to changes in the environment, therefore their monitoring is vital to understand the changes in the environment. Yet, monitoring plankton at appropriate scales still remains a challenge, limiting our understanding of functioning of aquatic systems and their response to changes. Modern plankton imaging instruments can be utilized to sample at high frequencies, enabling novel possibilities to study plankton populations. However, manual analysis of the data is costly, time consuming and expert based, making such approach unsuitable for large-scale application and urging for automatic solutions. The key problem related to the utilization of plankton datasets through image analysis is plankton recognition. Despite the large amount of research done, automatic methods have not been widely adopted for operational use. In this paper, a comprehensive survey on existing solutions for automatic plankton recognition is presented. First, we identify the most notable challenges that that make the development of plankton recognition systems difficult. Then, we provide a detailed description of solutions for these challenges proposed in plankton recognition literature. Finally, we propose a workflow to identify the specific challenges in new datasets and the recommended approaches to address them. For many of the challenges, applicable solutions exist. However, important challenges remain unsolved: 1) the domain shift between the datasets hindering the development of a general plankton recognition system that would work across different imaging instruments, 2) the difficulty to identify and process the images of previously unseen classes, and 3) the uncertainty in expert annotations that affects the training of the machine learning models for recognition. These challenges should be addressed in the future research.

Computer vision and deep learning meet plankton: Milestones and future directions

Deep-learning-powered data analysis in plankton ecology

Deep‐learning‐powered data analysis in plankton ecology

Survey of Automatic Plankton Image Recognition: Challenges, Existing Solutions and Future Perspectives

Machine learning techniques to characterize functional traits of plankton from image data

An Open-Source Platform For Underwater Image And Video Analytics

Deep Learning Classification of Lake Zooplankton

Automated zooplankton size measurement using deep learning: Overcoming the limitations of traditional methods

Deep learning for plankton and coral classification

Deep-Learning-Based Automated Tracking and Counting of Living Plankton in Natural Aquatic Environments

A Plankton Detection Method Based on Neural Networks and Digital Holographic Imaging

WHOI-Plankton- A Large Scale Fine Grained Visual Recognition Benchmark Dataset for Plankton Classification

Unlocking the potential of deep learning for marine ecology: overview, applications, and outlook

Computer Vision and Deep Learning for Fish Classification in Underwater Habitats: A Survey

Advancements in underwater imaging through machine learning: Techniques, challenges, and applications

Improving plankton image classification using context metadata

Toward efficient deep learning system for in-situ plankton image recognition

Understanding the picture: the promise and challenges of in-situ imagery data in the study of plankton ecology

A Survey of Deep Learning Techniques for Underwater Image Classification

A Review of Feature Extraction Technologies for Plankton Images