Abstract:We demonstrate that deep learning techniques can detect, identify, and count wildflowers in photographs, and thereby provide detailed information on flowering occurrences in complex systems (like wildflower meadows). Mountain meadows are an essential part of the alpine–subalpine ecosystem; they provide ecosystem services like pollination and are home to diverse plant communities. Changes in climate affect meadow ecology on multiple levels, for example, by altering growing season dynamics. Tracking the effects of climate change on meadow diversity through the impacts on individual species and overall growing season dynamics is critical to conservation efforts. Here, we explore how to combine crowd‐sourced camera images with machine learning to quantify flowering species richness across a range of elevations in alpine meadows located in Mt. Rainier National Park, Washington, USA. We employed three machine‐learning techniques (Mask R‐CNN, RetinaNet and YOLOv5) to detect wildflower species in images taken during two flowering seasons. We demonstrate that deep learning techniques can detect multiple species, providing information on flowering richness in photographed meadows. The results indicate higher richness just above the tree line for most of the species, which is comparable with patterns found using field studies. We found that the two‐stage detector Mask R‐CNN was more accurate than single‐stage detectors like RetinaNet and YOLO, with the Mask R‐CNN network performing best overall with mean average precision (mAP) of 0.67 followed by RetinaNet (0.5) and YOLO (0.4). We found that across the methods using anchor box variations in multiples of 16 led to enhanced accuracy. We also show that detection is possible even when pictures are interspersed with complex backgrounds and are not in focus. We found differential detection rates depending on species abundance, with additional challenges related to similarity in flower characteristics, labeling errors and occlusion issues. Despite these potential biases and limitations in capturing flowering abundance and location‐specific quantification, accuracy was notable considering the complexity of flower types and picture angles in this dataset. We, therefore, expect that this approach can be used to address many ecological questions that benefit from automated flower detection, including studies of flowering phenology and floral resources, and that this approach can, therefore, complement a wide range of ecological approaches (e.g., field observations, experiments, community science, etc.). In all, our study suggests that ecological metrics like floral richness can be efficiently monitored by combining machine learning with easily accessible publicly curated datasets (e.g., Flickr, iNaturalist).

Imaging pollen using a Raspberry Pi and LED with deep learning

A Computational Approach for Recognition of Electronic Microscope Plant Pollen Images

Pollen Detection Through Integrated Microfluidics and Smartphone-Driven Deep Learning Systems

Unsupervised Representations of Pollen in Bright-Field Microscopy

Enhancing cotton whitefly (Bemisia tabaci) detection and counting with a cost-effective deep learning approach on the Raspberry Pi

Automated multifocus pollen detection using deep learning

Combating data incompetence in pollen images detection and classification for pollinosis prevention

Label-free quantitative phase imaging and analysis of airborne pollen

PollenNet: A novel architecture for high precision pollen grain classification through deep learning and explainable AI

Using photographs and deep neural networks to understand flowering phenology and diversity in mountain meadows

Constructing a pollen proxy from low-cost Optical Particle Counter (OPC) data processed with Neural Networks and Random Forests

An integrated system for automated measurement of airborne pollen based on electrostatic enrichment and image analysis with machine vision

Comparison of computer vision models in application to pollen classification using light scattering

How to identify pollen like a palynologist: A prior knowledge-guided deep feature learning for real-world pollen classification

AMFF-Net: An attention-based multi-scale feature fusion network for allergic pollen detection

AIpollen: An Analytic Website for Pollen Identification Through Convolutional Neural Networks

Neural networks for increased accuracy of allergenic pollen monitoring

Intelligent Real-Time Face Mask And Temperature Recognition Using Deep Learning On Raspberry Pi

Airborne pollen grain detection from partially labelled data utilising semi-supervised learning

RaspberryPI for mosquito neutralization by power laser

Utilising affordable smartphones and open-source time-lapse photography for monitoring pollinators