Abstract:Airborne pollen monitoring has been conducted for more than a century now, as knowledge of the quantity and periodicity of airborne pollen has diverse use cases, like reconstructing historic climates and tracking current climate change, forensic applications, and up to warning those affected by pollen-induced respiratory allergies. Hence, related work on automation of pollen classification already exists. In contrast, detection of pollen is still conducted manually, and it is the gold standard for accuracy. So, here we used a new-generation, automated, near-real-time pollen monitoring sampler, the BAA500, and we used data consisting of both raw and synthesised microscope images. Apart from the automatically generated, commercially-labelled data of all pollen taxa, we additionally used manual corrections to the pollen taxa, as well as a manually created test set of bounding boxes and pollen taxa, so as to more accurately evaluate the real-life performance. For the pollen detection, we employed two-stage deep neural network object detectors. We explored a semi-supervised training scheme to remedy the partial labelling. Using a teacher-student approach, the model can add pseudo-labels to complete the labelling during training. To evaluate the performance of our deep learning algorithms and to compare them to the commercial algorithm of the BAA500, we created a manual test set, in which an expert aerobiologist corrected automatically annotated labels. For the novel manual test set, both the supervised and semi-supervised approaches clearly outperform the commercial algorithm with an F1 score of up to 76.9 % compared to 61.3 %. On an automatically created and partially labelled test dataset, we obtain a maximum mAP of 92.7 %. Additional experiments on raw microscope images show comparable performance for the best models, which potentially justifies reducing the complexity of the image generation process. Our results bring automatic pollen monitoring a step forward, as they close the gap in pollen detection performance between manual and automated procedure.

Recognition of Airborne Pollen in Microscopy Images Based on Shape and Texture

Recognition of optical microscopy images based on shape and texture

A Computational Approach for Recognition of Electronic Microscope Plant Pollen Images

Classification of bee pollen using visible near infrared spectroscopy

An External Contour Extraction Method for Pollen Images

Segmentation of Microscopic Images Based on Image Patch Classifier and Conditional Random Field

How to identify pollen like a palynologist: A prior knowledge-guided deep feature learning for real-world pollen classification

An improved local binary pattern method for pollen image classification and recognition

A General Framework for Multi-focal Image Classification and Authentication: Application to Microscope Pollen Images

Airborne pollen grain detection from partially labelled data utilising semi-supervised learning

AMFF-Net: An attention-based multi-scale feature fusion network for allergic pollen detection

Neural networks for increased accuracy of allergenic pollen monitoring

Automated multifocus pollen detection using deep learning

Identification and Removal of Pollen Spectral Interference in the Classification of Hazardous Substances Based on Excitation Emission Matrix Fluorescence Spectroscopy

PollenNet: A novel architecture for high precision pollen grain classification through deep learning and explainable AI

PollenDetect: An Open-Source Pollen Viability Status Recognition System Based on Deep Learning Neural Networks

Multi-Angle Polarization Index System for Pollen Type Bioaerosol Recognition

Combating data incompetence in pollen images detection and classification for pollinosis prevention

Spatially Aware Dictionary Learning and Coding for Fossil Pollen Identification

A TWO STAGE ARTIFICIAL INTELLIGENCE (AI) DETECTION AND CLASSIFICATION MODEL FOR POLLEN GRAIN (PG) COUNTING.

Automatic Pollen Grain and Exine Segmentation from Microscope Images