Abstract:We present an automatized method for monitoring flower phenology of specific plant species trough full growing seasons and across geographical regions. The method couples image‐based monitoring of field plots with a dedicated convolutional neural network to detect and count flowers in the images, and returns information on flowering phenology at unprecedented temporal resolution and spatial extent, as well as reliable estimates of traditional phenological variables such as onset, peak, and end of flowering. We demonstrate the method on two species of mountain avens which are common in Arctic plant phenology monitoring programs. The method can be directly adopted by the research community at sites containing mountain avens, using our trained flower detection model, or adapted to other species of interest. The advancement of spring is a widespread biological response to climate change observed across taxa and biomes. However, the species level responses to warming are complex and the underlying mechanisms are difficult to disentangle. This is partly due to a lack of data, which are typically collected by direct observations, and thus very time‐consuming to obtain. Data deficiency is especially pronounced in the Arctic where the warming is particularly severe. We present a method for automated monitoring of flowering phenology of specific plant species at very high temporal resolution through full growing seasons and across geographical regions. The method consists of image‐based monitoring of field plots using near‐surface time‐lapse cameras and subsequent automated detection and counting of flowers in the images using a convolutional neural network. We demonstrate the feasibility of collecting flower phenology data using automatic time‐lapse cameras and show that the temporal resolution of the results surpasses what can be collected by traditional observation methods. We focus on two Arctic species, the mountain avens Dryas octopetala and Dryas integrifolia in 20 image series from four sites. Our flower detection model proved capable of detecting flowers of the two species with a remarkable precision of 0.918 (adjusted to 0.966) and a recall of 0.907. Thus, the method can automatically quantify the seasonal dynamics of flower abundance at fine scale and return reliable estimates of traditional phenological variables such as the timing of onset, peak, and end of flowering. We describe the system and compare manual and automatic extraction of flowering phenology data from the images. Our method can be directly applied on sites containing mountain avens using our trained model, or the model could be fine‐tuned to other species. We discuss the potential of automatic image‐based monitoring of flower phenology and how the method can be improved and expanded for future studies.

Monitoring crop phenology with street-level imagery using computer vision

Crop Identification Using Deep Learning on LUCAS Crop Cover Photos

Mapping Crop Types in Southeast India with Smartphone Crowdsourcing and Deep Learning

Spatial-aware SAR-optical Time-Series Deep Integration for Crop Phenology Tracking

Computer Vision and Deep Learning as Tools for Leveraging Dynamic Phenological Classification in Vegetable Crops

Towards Optimising the Derivation of Phenological Phases of Different Crop Types over Germany Using Satellite Image Time Series

A Novel Fusion of Optical and Radar Satellite Data for Crop Phenology Estimation using Machine Learning and Cloud Computing

Boosting crop classification by hierarchically fusing satellite, rotational, and contextual data

Combining Deep Learning and Street View Imagery to Map Smallholder Crop Types

Developing an operational algorithm for near-real-time monitoring of crop progress at field scales by fusing harmonized Landsat and Sentinel-2 time series with geostationary satellite observations

Street-level Imagery Analytics and Applications

PhenoVision: A framework for automating and delivering research-ready plant phenology data from field images

Agricultural plant cataloging and establishment of a data framework from UAV-based crop images by computer vision

Automated crop plant counting from very high-resolution aerial imagery

Automatic flower detection and phenology monitoring using time‐lapse cameras and deep learning

A Hidden Markov Models Approach for Crop Classification: Linking Crop Phenology to Time Series of Multi-Sensor Remote Sensing Data

Urban Plant Phenology Monitoring: Expanding the Functions of Widespread Surveillance Cameras to Nature Rhythm Understanding

High-Throughput Plot-Level Quantitative Phenotyping Using Convolutional Neural Networks on Very High-Resolution Satellite Images

A deep learning approach for deriving wheat phenology from near-surface RGB image series using spatiotemporal fusion

Automated Workflow for High-Resolution 4D Vegetation Monitoring Using Stereo Vision