Enhanced Convolutional Neural Network for Plankton Identification and Enumeration V1

Kaichang K Cheng,Xuemin Cheng,Yuqi Wang,Hongsheng Bi,Mark C. Benfield

DOI: https://doi.org/10.17504/protocols.io.2u5gey6

2019-01-01

Abstract:This is an automatic plankton image recognition and enumeration system using an enhanced Convolutional Neural Network (CNN) and examined the performance of different network structures on automatic plankton image classification.

What problem does this paper attempt to address?

Enhanced convolutional neural network for plankton identification and enumeration

Kaichang Cheng,Xuemin Cheng,Yuqi Wang,Hongsheng Bi,Mark C Benfield

DOI: https://doi.org/10.1371/journal.pone.0219570

IF: 3.7

2019-07-10

PLoS ONE

Abstract:Despite the rapid increase in the number and applications of plankton imaging systems in marine science, processing large numbers of images remains a major challenge due to large variations in image content and quality in different marine environments. We constructed an automatic plankton image recognition and enumeration system using an enhanced Convolutional Neural Network (CNN) and examined the performance of different network structures on automatic plankton image classification. The procedure started with an adaptive thresholding approach to extract Region of Interest (ROIs) from in situ plankton images, followed by a procedure to suppress the background noise and enhance target features for each extracted ROI. The enhanced ROIs were classified into seven categories by a pre-trained classifier which was a combination of a CNN and a Support Vector Machine (SVM). The CNN was selected to improve feature description and the SVM was utilized to improve classification accuracy. A series of comparison experiments were then conducted to test the effectiveness of the pre-trained classifier including the combination of CNN and SVM versus CNN alone, and the performance of different CNN models. Compared to CNN model alone, the combination of CNN and SVM increased classification accuracy and recall rate by 7.13% and 6.41%, respectively. Among the selected CNN models, the ResNet50 performed the best with accuracy and recall at 94.52% and 94.13% respectively. The present study demonstrates that deep learning technique can improve plankton image recognition and that the results can provide useful information on the selection of different CNN models for plankton recognition. The proposed algorithm could be generally applied to images acquired from different imaging systems.
Classification of Freshwater Zooplankton by Pre-trained Convolutional Neural Network in Underwater Microscopy

Song Hong,Syed Raza Mehdi,Hui Huang,Kamran Shahani,Yangfang Zhang,Junaidullah,Kazim Raza,Mushtaq Ali Khan

DOI: https://doi.org/10.14569/ijacsa.2020.0110733

IF: 0.9

2020-01-01

International Journal of Advanced Computer Science and Applications

Abstract:Zooplankton is enormously diverse and fundamental group of microorganisms that exists in almost every freshwater body, determining its ecology and play a vital role in food chain. Considering the significance of zooplankton, the study of freshwater zooplankton is very essential which intensely relies on the classification of images. However, the routine manual analysis and classification is laborious, time consuming and expensive, and poses a significant challenge to experts. Thus, for recent decade much research is focused on the development of underwater imaging technologies and intelligent classification system of zooplankton. This work presents devotion to observation of freshwater zooplankton by designed underwater microscope and modeling the system for automatic classification among four different taxa. Unlike most of the existing zooplankton image classification systems, this model is trained on a comparatively small dataset collected from freshwater by designed underwater microscope. Transfer learning of pre-trained AlexNet Convolutional Neural Network (CNN) model proved to be a potential approach in the system design. Among four networks trained over two datasets, the best overall classification accuracy of up to 93.1%, comparable to other existing systems was achieved on test dataset (92.5% for Calanoid and Cyclopoid (Female), 90% for Cyclopoid (Male) and 97.5% for Daphnia). Graphical User Interface (GUI) of the model constructed on MATLAB, makes it easy for the users to collect images for building database, train network and to classify images of different taxa. Moreover, the designed system is adaptable to the addition of more classes in the future.
Research on In Situ Observation Method of Plankton Based on Convolutional Neural Network

Chengzhi Yuan,Zhongjie He,Chunlin Ning,Weimin Wang,Jinkai Zhao,Guozheng Yuan,Chao Li

DOI: https://doi.org/10.3390/jmse12101702

IF: 2.744

2024-09-27

Journal of Marine Science and Engineering

Abstract:The marine ecosystem is one of the most extensive and abundant ecosystems on Earth. Marine plankton is an important component, and its abundance, number of species, and dominant species are regarded as important monitoring indicators. Aiming at the problems of low accuracy and high complexity in identifying plankton based on convolutional neural networks, this study proposes a lightweight identification algorithm for plankton images based on the improved MobileNetV2. Firstly, the network layer structure is extracted by redesigning features to balance the depth and width of the network to reduce the model parameters; secondly, the lightweight coordinate attention (CA) mechanism is introduced to strengthen the attention and extraction ability of key areas; in addition, the structure of the network classifier is optimized to improve the utilization efficiency of the model parameters. The results show that the model achieves a 95.46% accuracy and 94.48% recall in 12 kinds of images. Compared with the initial MobileNetV2, the parameters and calculation amount are reduced by 72.47% and 52.09%, respectively, and the reasoning time for a single image is 6.15 ms. The model realizes the accurate identification of plankton in situ under the premise of ensuring it is lightweight. Combining time information and depth data, it is of great significance for marine ecological environment monitoring and prediction to obtain the abundance of various plankton.

oceanography,engineering, marine, ocean
Rapid detection for optical micrograph of plankton in ballast water based on neural network

Hui Cai,Shihan Shan,Xiaoping Wang

DOI: https://doi.org/10.1016/j.algal.2022.102811

IF: 5.276

2022-01-01

Algal Research

Abstract:There exist various types of organisms in ballast water, among which Escherichia coli and harmful plankton pose a great threat to the marine environment. The automatic and rapid detection of plankton in ballast water is crucial for protecting the marine environment. In this work, A convolutional neural network based on Mobilenetv3 was proposed to rapidly detect plankton. The model can detect five species plankton, Chattonella marina, Alexandrium tamarense, Prorocentrum donghaiense, Phaeocystis globosa, and Karlodinium veneficum. And four traditional neural networks were used for performance comparison. The experimental results show that, compared to the traditional neural network, the developed neural network has a higher speed and accuracy of recognition. The use of neural networks to detect plankton will greatly improve the protection of marine environments.
Method For Training Convolutional Neural Networks For In Situ Plankton Image Recognition And Classification Based On The Mechanisms Of The Human Eye

Xuemin Cheng,Yong Ren,Kaichang Cheng,Jie Cao,Qun Hao

DOI: https://doi.org/10.3390/s20092592

IF: 3.9

2020-01-01

Sensors

Abstract:In this study, we propose a method for training convolutional neural networks to make them identify and classify images with higher classification accuracy. By combining the Cartesian and polar coordinate systems when describing the images, the method of recognition and classification for plankton images is discussed. The optimized classification and recognition networks are constructed. They are available for in situ plankton images, exploiting the advantages of both coordinate systems in the network training process. Fusing the two types of vectors and using them as the input for conventional machine learning models for classification, support vector machines (SVMs) are selected as the classifiers to combine these two features of vectors, coming from different image coordinate descriptions. The accuracy of the proposed model was markedly higher than those of the initial classical convolutional neural networks when using the in situ plankton image data, with the increases in classification accuracy and recall rate being 5.3% and 5.1% respectively. In addition, the proposed training method can improve the classification performance considerably when used on the public CIFAR-10 dataset.
A more efficient CNN architecture for plankton classification

Yan Jiangpeng,Li Xiu,Cui Zuoying

DOI: https://doi.org/10.1007/978-981-10-7305-2_18

2017-01-01

Abstract:With mass data collected by seafloor observation networks, an autonomous system which helps to annotate these pictures are in great demand. In this paper, we study the relationship between the network architecture and the classification accuracy for the Plankton Dataset collected by Oregon State University's Hatfield Marine Science Center. We use multiple classic deep convolutional neural networks (CNN) models to compare the benefit and cost of deeper models which have performed quite well in ImageNet Large Scale Visual Recognition Challenge (ILSVRC) (http: / /www. image- net. org/challenges/LSVP competitions and we discover a hidden degeneration phenomenon. Then we conclude some skills to make CNN smaller and finally propose a more efficient network architecture whose model is much smaller (only 1.5 MB), faster (32.2 fps) and achieve a top-5 accuracy of 96% in the Plankton Dataset. This model can be actually deployed in the seafloor observation network system with its advantages.
A Plankton Detection Method Based on Neural Networks and Digital Holographic Imaging

Kaiqi Lang,Hui Cai,Xiaoping Wang

DOI: https://doi.org/10.3390/chemosensors10060217

2022-01-01

Chemosensors

Abstract:Detecting marine plankton by means of digital holographic microscopy (DHM) has been successfully deployed in recent decades; however, in most previous studies, the identification of the position, shape, and size of plankton has been neglected, which may negate some of the advantages of DHM. Therefore, the procedure of image fusion has been added between the reconstruction of initial holograms and the final identification, which could help present all the images of plankton clearly in a volume of seawater. A new image fusion method called digital holographic microscopy-fully convolutional networks (DHM-FCN) is proposed, which is based on the improved fully convolutional networks (FCN). The DHM-FCN model runs 20 times faster than traditional image fusion methods and suppresses the noise in the holograms. All plankton in a 2 mm thick water body could be clearly represented in the fusion image. The edges of the plankton in the DHM-FCN fusion image are continuous and clear without speckle noise inside. The neural network model, YOLOv4, for plankton identification and localization, was established. A mean average precision (mAP) of 97.69% was obtained for five species, Alexandrium tamarense, Chattonella marina, Mesodinium rubrum, Scrippsiella trochoidea, and Prorocentrum lima. The results of this study could provide a fast image fusion method and a visual method to detect organisms in water.
An Automatic Detection and Statistical Method for Underwater Fish Based on Foreground Region Convolution Network (FR-CNN)

Shenghong Li,Peiliang Li,Shuangyan He,Zhiyan Kuai,Yanzhen Gu,Haoyang Liu,Tao Liu,Yuan Lin

DOI: https://doi.org/10.3390/jmse12081343

IF: 2.744

2024-01-01

Journal of Marine Science and Engineering

Abstract:Computer vision in marine ranching enables real-time monitoring of underwater resources. Detecting fish presents challenges due to varying water turbidity and lighting, affecting color consistency. We propose a Foreground Region Convolutional Neural Network (FR-CNN) that combines unsupervised and supervised methods. It introduces an adaptive multiscale regression Gaussian background model to distinguish fish from noise at different scales. Probability density functions integrate spatiotemporal information for object detection, addressing illumination and water quality shifts. FR-CNN achieves 95% mAP with IoU of 0.5, reducing errors from open-source datasets. It updates anchor boxes automatically on local datasets, enhancing object detection accuracy in long-term monitoring. The results analyze fish species behaviors in relation to environmental conditions, validating the method’s practicality.
Toward efficient deep learning system for in-situ plankton image recognition

Junbai Yue,Zhenshuai Chen,Yupu Long,Kaichang Cheng,Hongsheng Bi,Xuemin Cheng

DOI: https://doi.org/10.3389/fmars.2023.1186343

IF: 5.247

2023-09-22

Frontiers in Marine Science

Abstract:Plankton is critical for the structure and function of marine ecosystems. In the past three decades, various underwater imaging systems have been developed to collect in-situ plankton images and image processing has been a major bottleneck that hinders the deployment of plankton imaging systems. In recent years, deep learning methods have greatly enhanced our ability of processing in-situ plankton images, but high-computational demands and longtime consumption still remain problematic. In this study, we used knowledge distillation as a framework for model compression and improved computing efficiency while maintaining original high accuracy. A novel inter-class similarity distillation algorithm based on feature prototypes was proposed and enabled the student network (small scale) to acquire excellent ability for plankton recognition after being guided by the teacher network (large scale). To identify the suitable teacher network, we compared emerging Transformer neural networks and convolution neural networks (CNNs), and the best performing deep learning model, Swin-B, was selected. Utilizing the proposed knowledge distillation algorithm, the feature extraction ability of Swin-B was transferred to five more lightweight networks, and the results had been evaluated in taxonomic dataset of in-situ plankton images. Subsequently, the chosen lightweight model and the Bilateral–Sobel edge enhancement were tested to process in-situ images with high level of noises captured from coastal waters of Guangdong, China and achieved an overall recall rate of 91.73%. Our work contributes to effective deep learning models and facilitates the deployment of underwater plankton imaging systems by promoting both accuracy and speed in recognition of plankton targets.

marine & freshwater biology
Automatic Classification of Marine Plankton with Digital Holography Using Convolutional Neural Network

Yilong Zhang,Yaoxiang Lu,Haixia Wang,Peng Chen,Ronghua Liang

DOI: https://doi.org/10.1016/j.optlastec.2021.106979

2021-01-01

Abstract:The observation, statistics and classification of marine plankton are the basis of marine ecological research. In recent years, digital holography technology has been widely used in the detection of plankton, living cells and particles. The digital holographic microscope can record the three-dimensional information of the sample in a non-contact manner, which has great advantages for the observation of marine plankton. However, the recon-struction of holographic images requires a priori knowledge and time-consuming iterative calculations, which affects the application efficiency of digital holography. In order to solve the above problem, we proposed to directly predict marine plankton species by training a convolutional neural network (CNN) to extract information of raw holograms without performing reconstruction. In our method, machine vision is used to directly identify the original hologram, and the reconstruction process is omitted, thus reducing time consumption. By using deep transfer learning (DTL), neural networks are trained without starting from scratch and the requirements on training data and training time are alleviated. The classification accuracy of our method could reach approxi-mately 92% for experimental datasets. Our approach demonstrated efficient and robust performance for raw plankton holograms processing.
Deep Residual Networks For Plankton Classification

Xiu Li,Zuoying Cui

DOI: https://doi.org/10.1109/OCEANS.2016.7761223

2016-01-01

Abstract:In this paper, we introduce a deep residual network to classify images of plankton. The Plankton Dataset, which consists of 30,336 plankton images of 121 classes, was used for a data science competition hosted on the Kaggle platform(1). We finally achieved a top-5 accuracy of 95.8% and a nearly real-frame rate of 9.1ftps, which is close to the accuracy of the No. 1 team ( over 98%, 1.4ftps) (2) in the competition but much faster than their classification on a single image.
Image Fusion Method for Improving the Accuracy of Ocean Plankton Recognition

Kaiqi Lang,Shihan Shan,Weihao Lv,Xiaoping Wang

DOI: https://doi.org/10.1109/oceanschennai45887.2022.9775462

2022-01-01

Abstract:Image fusion combines image data on the same target collected from multi-source channels, which are processed to extract the most favorable information from each channel and finally synthesize a high-quality image. In this study, image fusion is used to aggregate multi-focus plankton into a single-fused image. An unsupervised image weighted fusion method based on fully convolutional networks (FCN) is proposed, which can clearly and intuitively show the presence of plankton in the detected water body. The fused image has a high contrast, continuous and clear plankton edges, and little information loss, thereby laying a foundation for the next phytoplankton identification.
Deep learning for plankton and coral classification

Alessandra Lumini,Loris Nanni,Gianluca Maguolo

DOI: https://doi.org/10.1016/j.aci.2019.11.004

2020-08-04

Applied Computing and Informatics

Abstract:In this paper, we present a study about an automated system for monitoring underwater ecosystems. The system here proposed is based on the fusion of different deep learning methods. We study how to create an ensemble based of different Convolutional Neural Network (CNN) models, fine-tuned on several datasets with the aim of exploiting their diversity. The aim of our study is to experiment the possibility of fine-tuning CNNs for underwater imagery analysis, the opportunity of using different datasets for pre-training models, the possibility to design an ensemble using the same architecture with small variations in the training procedure. Our experiments, performed on 5 well-known datasets (3 plankton and 2 coral datasets) show that the combination of such different CNN models in a heterogeneous ensemble grants a substantial performance improvement with respect to other state-of-the-art approaches in all the tested problems. One of the main contributions of this work is a wide experimental evaluation of famous CNN architectures to report the performance of both the single CNN and the ensemble of CNNs in different problems. Moreover, we show how to create an ensemble which improves the performance of the best single model. The MATLAB source code is freely link provided in title page.

English Else
Beyond transfer learning: Leveraging ancillary images in automated classification of plankton

Jeffrey S. Ellen,Mark D. Ohman

DOI: https://doi.org/10.1002/lom3.10648

2024-09-27

Limnology and Oceanography Methods

Abstract:We assess whether a supervised machine learning algorithm, specifically a convolutional neural network (CNN), achieves higher accuracy on planktonic image classification when including non‐plankton and ancillary plankton during the training procedure. We focus on the case of optimizing the CNN for a single planktonic image source, while considering ancillary images to be plankton images from other instruments. We conducted two sets of experiments with three different types of plankton images (from a Zooglider, Underwater Vision Profiler 5, and Zooscan), and our results held across all three image types. First, we considered whether single‐stage transfer learning using non‐plankton images was beneficial. For this assessment, we used ImageNet images and the 2015 ImageNet contest‐winning model, ResNet‐152. We found increased accuracy using a ResNet‐152 model pretrained on ImageNet, provided the entire network was retrained rather than retraining only the fully connected layers. Next, we combined all three plankton image types into a single dataset with 3.3 million images (despite their differences in contrast, resolution, and pixel pitch) and conducted a multistage transfer learning assessment. We executed a transfer learning stage from ImageNet to the merged ancillary plankton dataset, then a second transfer learning stage from that merged plankton model to a single instrument dataset. We found that multistage transfer learning resulted in additional accuracy gains. These results should have generality for other image classification tasks.

oceanography,limnology
Automatic plankton image classification combining multiple view features via multiple kernel learning

Haiyong Zheng,Ruchen Wang,Zhibin Yu,Nan Wang,Zhaorui Gu,Bing Zheng

DOI: https://doi.org/10.1186/s12859-017-1954-8

IF: 3.307

2017-12-28

BMC Bioinformatics

Abstract:Background: Plankton, including phytoplankton and zooplankton, are the main source of food for organisms in the ocean and form the base of marine food chain. As the fundamental components of marine ecosystems, plankton is very sensitive to environment changes, and the study of plankton abundance and distribution is crucial, in order to understand environment changes and protect marine ecosystems. This study was carried out to develop an extensive applicable plankton classification system with high accuracy for the increasing number of various imaging devices. Literature shows that most plankton image classification systems were limited to only one specific imaging device and a relatively narrow taxonomic scope. The real practical system for automatic plankton classification is even non-existent and this study is partly to fill this gap. Results: Inspired by the analysis of literature and development of technology, we focused on the requirements of practical application and proposed an automatic system for plankton image classification combining multiple view features via multiple kernel learning (MKL). For one thing, in order to describe the biomorphic characteristics of plankton more completely and comprehensively, we combined general features with robust features, especially by adding features like Inner-Distance Shape Context for morphological representation. For another, we divided all the features into different types from multiple views and feed them to multiple classifiers instead of only one by combining different kernel matrices computed from different types of features optimally via multiple kernel learning. Moreover, we also applied feature selection method to choose the optimal feature subsets from redundant features for satisfying different datasets from different imaging devices. We implemented our proposed classification system on three different datasets across more than 20 categories from phytoplankton to zooplankton. The experimental results validated that our system outperforms state-of-the-art plankton image classification systems in terms of accuracy and robustness. Conclusions: This study demonstrated automatic plankton image classification system combining multiple view features using multiple kernel learning. The results indicated that multiple view features combined by NLMKL using three kernel functions (linear, polynomial and Gaussian kernel functions) can describe and use information of features better so that achieve a higher classification accuracy.
Chlorophyll a Inversion Algorithm and Algae Classification Technique Based on Hyperspectral Data

Chengqi Huang,Shiyou Xu,Ran Bi,Binbin Jiang,Yong Du,Hui Ma,Xiaoyu Zhang,Ran Liao

DOI: https://doi.org/10.1109/agro-geoinformatics262780.2024.10660904

2024-01-01

Abstract:Accurate monitoring and classification of algal species, as well as the estimation of chlorophyll-a concentration, are crucial for assessing water quality and managing aquatic ecosystems. Algal blooms, particularly those involving toxic species, pose significant threats to water resources, aquatic life, and human health. Traditional remote sensing methods lack the precision and specificity needed to address these challenges effectively. This study aims to develop a more accurate, flexible, and comprehensive approach to chlorophyll-a concentration inversion using hyperspectral data By leveraging the rich spectral information provided by hyperspectral data and combining Long Short-Term Memory (LSTM) networks with one-dimensional Convolutional Neural Networks (1D-CNN), we significantly improve the accuracy of chlorophyll-a concentration inversion. Preliminary measurements in our study area showed chlorophyll-a concentrations exceeding $30 \mu \mathrm{g} / \mathrm{L}$, indicating a eutrophic state. Experimental results demonstrate that this combined approach enhances the ${\mathrm {R}}^{2}$ Coefficient of Determination) between predicted and actual chlorophyll-a concentrations from 0.71 to 0.94, outperforming traditional models. This advancement indicates a significant improvement in aquatic remote sensing technology, providing a more precise and reliable method for water quality monitoring and understanding aquatic ecosystem dynamics.
Improving plankton image classification using context metadata

Jeffrey S. Ellen,Casey A. Graff,Mark D. Ohman

DOI: https://doi.org/10.1002/lom3.10324

2019-07-12

Abstract:Advances in both hardware and software are enabling rapid proliferation of in situ plankton imaging methods, requiring more effective machine learning approaches to image classification. Deep Learning methods, such as convolutional neural networks (CNNs), show marked improvement over traditional feature‐based supervised machine learning algorithms, but require careful optimization of hyperparameters and adequate training sets. Here, we document some best practices in applying CNNs to zooplankton and marine snow images and note where our results differ from contemporary Deep Learning findings in other domains. We boost the performance of CNN classifiers by incorporating metadata of different types and illustrate how to assimilate metadata beyond simple concatenation. We utilize both geotemporal (e.g., sample depth, location, time of day) and hydrographic (e.g., temperature, salinity, chlorophyll a) metadata and show that either type by itself, or both combined, can substantially reduce error rates. Incorporation of context metadata also boosts performance of the feature‐based classifiers we evaluated: Random Forest, Extremely Randomized Trees, Gradient Boosted Classifier, Support Vector Machines, and Multilayer Perceptron. For our assessments, we use an original data set of 350,000 in situ images (roughly 50% marine snow and 50% non‐snow sorted into 26 categories) from a novel in situ Zooglider. We document asymptotically increasing performance with more computationally intensive techniques, such as substantially deeper networks and artificially augmented data sets. Our best model achieves 92.3% accuracy with our 27‐class data set. We provide guidance for further refinements that are likely to provide additional gains in classifier accuracy.

oceanography,limnology
Recognition of Harmful Phytoplankton from Microscopic Images using Deep Learning

Aymane Khaldi,Rohaifa Khaldi

2024-09-20

Abstract:Monitoring plankton distribution, particularly harmful phytoplankton, is vital for preserving aquatic ecosystems, regulating the global climate, and ensuring environmental protection. Traditional methods for monitoring are often time-consuming, expensive, error-prone, and unsuitable for large-scale applications, highlighting the need for accurate and efficient automated systems. In this study, we evaluate several state-of-the-art CNN models, including ResNet, ResNeXt, DenseNet, and EfficientNet, using three transfer learning approaches: linear probing, fine-tuning, and a combined approach, to classify eleven harmful phytoplankton genera from microscopic images. The best performance was achieved by ResNet-50 using the fine-tuning approach, with an accuracy of 96.97%. The results also revealed that the models struggled to differentiate between four harmful phytoplankton types with similar morphological features.

Computer Vision and Pattern Recognition,Artificial Intelligence
TANet: A Tiny Plankton Classification Network for Mobile Devices

Xiu Li,Rujiao Long,Jiangpeng Yan,Kun Jin,Jihae Lee

DOI: https://doi.org/10.1155/2019/6536925

2019-01-01

Mobile Information Systems

Abstract:This paper is devoted to a lightweight convolutional neural network based on the attention mechanism called the tiny attention network (TANet). The TANet consists of three main parts termed as a reduction module, self-attention operation, and group convolution. The reduction module alleviates information loss caused by the pooling operation. The new parameter-free self-attention operation makes the model to focus on learning important parts of images. The group convolution achieves model compression and multibranch fusion. Using the main parts, the proposed network enables efficient plankton classification on mobile devices. The performance of the proposed network is evaluated on the Plankton dataset collected by Oregon State University's Hatfield Marine Science Center. The results show that TANet outperforms other deep models in speed (31.8ms per image), size (648kB, the size of the hard disk space occupied by the model), and accuracy (Top-1 76.5%, Top-5 96.3%).
Automatic identification of harmful algae based on multiple convolutional neural networks and transfer learning

Mengyu Yang,Wensi Wang,Qiang Gao,Chen Zhao,Caole Li,Xiangfei Yang,Jiaxi Li,Xiaoguang Li,Jianglong Cui,Liting Zhang,Yanping Ji,Shuqin Geng

DOI: https://doi.org/10.1007/s11356-022-23280-6

IF: 5.8

2022-09-28

Environmental Science and Pollution Research

Abstract:The monitoring of harmful phytoplankton is very important for the maintenance of the aquatic ecological environment. Traditional algae monitoring methods require professionals with substantial experience in algae species, which are time-consuming, expensive, and limited in practice. The automatic classification of algae cell images and the identification of harmful phytoplankton images were realized by the combination of multiple convolutional neural networks (CNNs) and deep learning techniques based on transfer learning in this work. Eleven common harmful and 31 harmless phytoplankton genera were collected as input samples; the five CNNs classification models of AlexNet, VGG16, GoogLeNet, ResNet50, and MobileNetV2 were fine-tuned to automatically classify phytoplankton images; and the average accuracy was improved 11.9% when compared to models without fine-tuning. In order to monitor harmful phytoplankton which can cause red tides or produce toxins severely polluting drinking water, a new identification method of harmful phytoplankton which combines the recognition results of five CNN models was proposed, and the recall rate reached 98.0%. The experimental results validate that the recognition performance of harmful phytoplankton could be significantly improved by transfer learning, and the proposed identification method is effective in the preliminary screening of harmful phytoplankton and greatly reduces the workload of professional personnel.

environmental sciences

Enhanced Convolutional Neural Network for Plankton Identification and Enumeration V1

Enhanced convolutional neural network for plankton identification and enumeration

Classification of Freshwater Zooplankton by Pre-trained Convolutional Neural Network in Underwater Microscopy

Research on In Situ Observation Method of Plankton Based on Convolutional Neural Network

Rapid detection for optical micrograph of plankton in ballast water based on neural network

Method For Training Convolutional Neural Networks For In Situ Plankton Image Recognition And Classification Based On The Mechanisms Of The Human Eye

A more efficient CNN architecture for plankton classification

A Plankton Detection Method Based on Neural Networks and Digital Holographic Imaging

An Automatic Detection and Statistical Method for Underwater Fish Based on Foreground Region Convolution Network (FR-CNN)

Toward efficient deep learning system for in-situ plankton image recognition

Automatic Classification of Marine Plankton with Digital Holography Using Convolutional Neural Network

Deep Residual Networks For Plankton Classification

Image Fusion Method for Improving the Accuracy of Ocean Plankton Recognition

Deep learning for plankton and coral classification

Beyond transfer learning: Leveraging ancillary images in automated classification of plankton

Automatic plankton image classification combining multiple view features via multiple kernel learning

Chlorophyll a Inversion Algorithm and Algae Classification Technique Based on Hyperspectral Data

Improving plankton image classification using context metadata

Recognition of Harmful Phytoplankton from Microscopic Images using Deep Learning

TANet: A Tiny Plankton Classification Network for Mobile Devices

Automatic identification of harmful algae based on multiple convolutional neural networks and transfer learning