Abstract:Microclimate-proximal climatic variation at scales of metres and minutes-can exacerbate or mitigate the impacts of climate change on biodiversity. However, most microclimate studies are temperature centric, and do not consider meteorological factors such as sunshine, hail and snow. Meanwhile, remote cameras have become a primary tool to monitor wild plants and animals, even at micro-scales, and deep learning tools rapidly convert images into ecological data. However, deep learning applications for wildlife imagery have focused exclusively on living subjects. Here, we identify an overlooked opportunity to extract latent, ecologically relevant meteorological information. We produce an annotated image dataset of micrometeorological conditions across 49 wildlife cameras in South Africa's Maloti-Drakensberg and the Swiss Alps. We train ensemble deep learning models to classify conditions as overcast, sunshine, hail or snow. We achieve 91.7% accuracy on test cameras not seen during training. Furthermore, we show how effective accuracy is raised to 96% by disregarding 14.1% of classifications where ensemble member models did not reach a consensus. For two-class weather classification (overcast vs. sunshine) in a novel location in Svalbard, Norway, we achieve 79.3% accuracy (93.9% consensus accuracy), outperforming a benchmark model from the computer vision literature (75.5% accuracy). Our model rapidly classifies sunshine, snow and hail in almost 2 million unlabelled images. Resulting micrometeorological data illustrated common seasonal patterns of summer hailstorms and autumn snowfalls across mountains in the northern and southern hemispheres. However, daily patterns of sunshine and shade diverged between sites, impacting daily temperature cycles. Crucially, we leverage micrometeorological data to demonstrate that (1) experimental warming using open-top chambers shortens early snow events in autumn, and (2) image-derived sunshine marginally outperforms sensor-derived temperature when predicting bumblebee foraging. These methods generate novel micrometeorological variables in synchrony with biological recordings, enabling new insights from an increasingly global network of wildlife cameras.

Zero-shot Microclimate Prediction with Deep Learning

Micro-climate Prediction - Multi Scale Encoder-decoder based Deep Learning Framework

Short-term precipitation prediction using deep learning

A Novel Framework for Spatio-Temporal Prediction of Environmental Data Using Deep Learning

Deep learning to extract the meteorological by-catch of wildlife cameras

Theoretical Assessment for Weather Nowcasting Using Deep Learning Methods

Target inductive methods for zero-shot regression

Deep-AI soft sensor for sustainable health risk monitoring and control of fine particulate matter at sensor devoid underground spaces: A zero-shot transfer learning approach

Advances and prospects of deep learning for medium-range extreme weather forecasting

Spatially-resolved hyperlocal weather prediction and anomaly detection using IoT sensor networks and machine learning techniques

ForecastPFN: Synthetically-Trained Zero-Shot Forecasting

Intelligent Spatial Interpolation-based Frost Prediction Methodology using Artificial Neural Networks with Limited Local Data

Deep Learning for Day Forecasts from Sparse Observations

Survey on the Application of Deep Learning in Extreme Weather Prediction

Evaluating Deep Learning Approaches for Predictions in Unmonitored Basins with Continental-scale Stream Temperature Models

Deep Learning-based Extreme Heatwave Forecast

Deep Learning Based Prediction Of Weather Using Hybrid_stacked Bi-Long Short Term Memory

Cloud Cover Nowcasting with Deep Learning

Data driven weather forecasts trained and initialised directly from observations

Photovoltaic Power Prediction Based on Hybrid Deep Learning Networks and Meteorological Data

Deep Learning for Inferring the Surface Solar Irradiance from Sky Imagery