Abstract:Airborne pollen monitoring has been conducted for more than a century now, as knowledge of the quantity and periodicity of airborne pollen has diverse use cases, like reconstructing historic climates and tracking current climate change, forensic applications, and up to warning those affected by pollen-induced respiratory allergies. Hence, related work on automation of pollen classification already exists. In contrast, detection of pollen is still conducted manually, and it is the gold standard for accuracy. So, here we used a new-generation, automated, near-real-time pollen monitoring sampler, the BAA500, and we used data consisting of both raw and synthesised microscope images. Apart from the automatically generated, commercially-labelled data of all pollen taxa, we additionally used manual corrections to the pollen taxa, as well as a manually created test set of bounding boxes and pollen taxa, so as to more accurately evaluate the real-life performance. For the pollen detection, we employed two-stage deep neural network object detectors. We explored a semi-supervised training scheme to remedy the partial labelling. Using a teacher-student approach, the model can add pseudo-labels to complete the labelling during training. To evaluate the performance of our deep learning algorithms and to compare them to the commercial algorithm of the BAA500, we created a manual test set, in which an expert aerobiologist corrected automatically annotated labels. For the novel manual test set, both the supervised and semi-supervised approaches clearly outperform the commercial algorithm with an F1 score of up to 76.9 % compared to 61.3 %. On an automatically created and partially labelled test dataset, we obtain a maximum mAP of 92.7 %. Additional experiments on raw microscope images show comparable performance for the best models, which potentially justifies reducing the complexity of the image generation process. Our results bring automatic pollen monitoring a step forward, as they close the gap in pollen detection performance between manual and automated procedure.

Pollen Dictionary Construction Based on Supervised Comparative Learning

How to identify pollen like a palynologist: A prior knowledge-guided deep feature learning for real-world pollen classification

A Computational Approach for Recognition of Electronic Microscope Plant Pollen Images

Classification of bee pollen using visible near infrared spectroscopy

AIpollen: An Analytic Website for Pollen Identification Through Convolutional Neural Networks

PollenNet: A novel architecture for high precision pollen grain classification through deep learning and explainable AI

Airborne pollen grain detection from partially labelled data utilising semi-supervised learning

Robust Pollen Imagery Classification with Generative Modeling and Mixup Training

Research on the Fine-Grained Plant Image Classification

AMFF-Net: An attention-based multi-scale feature fusion network for allergic pollen detection

Pollen Grain Microscopic Image Classification Using an Ensemble of Fine-Tuned Deep Convolutional Neural Networks

Precise automatic classification of 46 different pollen types with convolutional neural networks

PollenDetect: An Open-Source Pollen Viability Status Recognition System Based on Deep Learning Neural Networks

Spatially Aware Dictionary Learning and Coding for Fossil Pollen Identification

Improving classification of pollen grain images of the POLEN23E dataset through three different applications of deep learning convolutional neural networks

Automated multifocus pollen detection using deep learning

An External Contour Extraction Method for Pollen Images

Recognition of Airborne Pollen in Microscopy Images Based on Shape and Texture

Unsupervised Representations of Pollen in Bright-Field Microscopy

An improved local binary pattern method for pollen image classification and recognition

Neural networks for increased accuracy of allergenic pollen monitoring