Survey of automatic plankton image recognition: challenges, existing solutions and future perspectives

Eerola, Tuomas,Batrakhanov, Daniel,Kraft, Kaisa,Haraguchi, Lumi,Lensu, Lasse,Suikkanen, Sanna,Seppälä, Jukka,Kälviäinen, Heikki
DOI: https://doi.org/10.1007/s10462-024-10745-y
IF: 9.588
2024-04-12
Artificial Intelligence Review
Abstract:Planktonic organisms including phyto-, zoo-, and mixoplankton are key components of aquatic ecosystems and respond quickly to changes in the environment, therefore their monitoring is vital to follow and understand these changes. Advances in imaging technology have enabled novel possibilities to study plankton populations, but the manual classification of images is time consuming and expert-based, making such an approach unsuitable for large-scale application and urging for automatic solutions for the analysis, especially recognizing the plankton species from images. Despite the extensive research done on automatic plankton recognition, the latest cutting-edge methods have not been widely adopted for operational use. In this paper, a comprehensive survey on existing solutions for automatic plankton recognition is presented. First, we identify the most notable challenges that make the development of plankton recognition systems difficult and restrict the deployment of these systems for operational use. Then, we provide a detailed description of solutions found in plankton recognition literature. Finally, we propose a workflow to identify the specific challenges in new datasets and the recommended approaches to address them. Many important challenges remain unsolved including the following: (1) the domain shift between the datasets hindering the development of an imaging instrument independent plankton recognition system, (2) the difficulty to identify and process the images of previously unseen classes and non-plankton particles, and (3) the uncertainty in expert annotations that affects the training of the machine learning models. To build harmonized instrument and location agnostic methods for operational purposes these challenges should be addressed in future research.
computer science, artificial intelligence
What problem does this paper attempt to address?
The paper attempts to address the problem of automatically identifying species in plankton images. Specifically, the paper aims to: 1. **Review existing solutions**: Conduct a comprehensive review of existing methods for automatic plankton image recognition, including techniques such as feature engineering and convolutional neural networks (CNNs). 2. **Identify challenges**: Clearly point out the most significant challenges faced when developing automatic plankton recognition systems, which limit the practical application of these systems. 3. **Propose future research directions**: Suggest key directions for future research to address currently unresolved issues. ### Main Challenges The main challenges mentioned in the paper include: 1. **Domain shift between datasets**: Differences between datasets hinder the development of plankton recognition systems that are independent of imaging instruments. 2. **Recognition and handling of unseen categories and non-plankton particles**: Difficulty in recognizing and handling images of previously unseen categories and non-plankton particles. 3. **Uncertainty in expert annotations**: Uncertainty in expert annotations affects the training of machine learning models. ### Research Background Plankton (including phytoplankton, zooplankton, and mixoplankton) are key components of aquatic ecosystems and respond quickly to environmental changes. Therefore, monitoring plankton is crucial for understanding and tracking these changes. However, traditional manual classification methods are time-consuming and rely on experts, making them unsuitable for large-scale applications. In recent years, advancements in imaging technology have provided new possibilities for studying plankton populations, but manual classification of images remains very time-consuming, creating an urgent need for automated solutions, especially methods for identifying plankton species from images. ### Objectives The main objectives of the paper are: 1. **Provide a comprehensive guide to available methods**: Detail the methods that can be used to address the challenges of plankton image data. 2. **List unresolved challenges**: Enumerate the currently unresolved challenges and point out beneficial directions for future research. Through these efforts, the paper hopes to advance the development of automatic plankton image recognition technology, making it more effective and reliable in practical applications.