Abstract:Airborne pollen monitoring has been conducted for more than a century now, as knowledge of the quantity and periodicity of airborne pollen has diverse use cases, like reconstructing historic climates and tracking current climate change, forensic applications, and up to warning those affected by pollen-induced respiratory allergies. Hence, related work on automation of pollen classification already exists. In contrast, detection of pollen is still conducted manually, and it is the gold standard for accuracy. So, here we used a new-generation, automated, near-real-time pollen monitoring sampler, the BAA500, and we used data consisting of both raw and synthesised microscope images. Apart from the automatically generated, commercially-labelled data of all pollen taxa, we additionally used manual corrections to the pollen taxa, as well as a manually created test set of bounding boxes and pollen taxa, so as to more accurately evaluate the real-life performance. For the pollen detection, we employed two-stage deep neural network object detectors. We explored a semi-supervised training scheme to remedy the partial labelling. Using a teacher-student approach, the model can add pseudo-labels to complete the labelling during training. To evaluate the performance of our deep learning algorithms and to compare them to the commercial algorithm of the BAA500, we created a manual test set, in which an expert aerobiologist corrected automatically annotated labels. For the novel manual test set, both the supervised and semi-supervised approaches clearly outperform the commercial algorithm with an F1 score of up to 76.9 % compared to 61.3 %. On an automatically created and partially labelled test dataset, we obtain a maximum mAP of 92.7 %. Additional experiments on raw microscope images show comparable performance for the best models, which potentially justifies reducing the complexity of the image generation process. Our results bring automatic pollen monitoring a step forward, as they close the gap in pollen detection performance between manual and automated procedure.

Precise automatic classification of 46 different pollen types with convolutional neural networks

Improving classification of pollen grain images of the POLEN23E dataset through three different applications of deep learning convolutional neural networks

Classification of bee pollen using visible near infrared spectroscopy

Pollen Grain Microscopic Image Classification Using an Ensemble of Fine-Tuned Deep Convolutional Neural Networks

Automated multifocus pollen detection using deep learning

A Computational Approach for Recognition of Electronic Microscope Plant Pollen Images

AIpollen: An Analytic Website for Pollen Identification Through Convolutional Neural Networks

How to identify pollen like a palynologist: A prior knowledge-guided deep feature learning for real-world pollen classification

PollenNet: A novel architecture for high precision pollen grain classification through deep learning and explainable AI

Pollen identification through convolutional neural networks: First application on a full fossil pollen sequence

Combating data incompetence in pollen images detection and classification for pollinosis prevention

Robust Pollen Imagery Classification with Generative Modeling and Mixup Training

Airborne pollen grain detection from partially labelled data utilising semi-supervised learning

Research on the Fine-Grained Plant Image Classification

Neural networks for increased accuracy of allergenic pollen monitoring

Pollen recognition through an open-source web-based system: automated particle counting for aerobiological analysis

Standard methods for inexpensive pollen loads authentication by means of computer vision and machine learning

Pollen Grain Classification Using Some Convolutional Neural Network Architectures

A General Framework for Multi-focal Image Classification and Authentication: Application to Microscope Pollen Images

PollenDetect: An Open-Source Pollen Viability Status Recognition System Based on Deep Learning Neural Networks

Unsupervised Representations of Pollen in Bright-Field Microscopy