Abstract:Abstract. Identifying, detecting, and localizing extreme weather events is a crucial first step in understanding how they may vary under different climate change scenarios. Pattern recognition tasks such as classification, object detection, and segmentation (i.e., pixel-level classification) have remained challenging problems in the weather and climate sciences. While there exist many empirical heuristics for detecting extreme events, the disparities between the output of these different methods even for a single event are large and often difficult to reconcile. Given the success of deep learning (DL) in tackling similar problems in computer vision, we advocate a DL-based approach. DL, however, works best in the context of supervised learning – when labeled datasets are readily available. Reliable labeled training data for extreme weather and climate events is scarce. We create “ClimateNet” – an open, community-sourced human-expert-labeled curated dataset that captures tropical cyclones (TCs) and atmospheric rivers (ARs) in high-resolution climate model output from a simulation of a recent historical period. We use the curated ClimateNet dataset to train a state-of-the-art DL model for pixel-level identification – i.e., segmentation – of TCs and ARs. We then apply the trained DL model to historical and climate change scenarios simulated by the Community Atmospheric Model (CAM5.1) and show that the DL model accurately segments the data into TCs, ARs, or “the background” at a pixel level. Further, we show how the segmentation results can be used to conduct spatially and temporally precise analytics by quantifying distributions of extreme precipitation conditioned on event types (TC or AR) at regional scales. The key contribution of this work is that it paves the way for DL-based automated, high-fidelity, and highly precise analytics of climate data using a curated expert-labeled dataset – ClimateNet. ClimateNet and the DL-based segmentation method provide several unique capabilities: (i) they can be used to calculate a variety of TC and AR statistics at a fine-grained level; (ii) they can be applied to different climate scenarios and different datasets without tuning as they do not rely on threshold conditions; and (iii) the proposed DL method is suitable for rapidly analyzing large amounts of climate model output. While our study has been conducted for two important extreme weather patterns (TCs and ARs) in simulation datasets, we believe that this methodology can be applied to a much broader class of patterns and applied to observational and reanalysis data products via transfer learning.

A median absolute deviation-neural network (MAD-NN) method for atmospheric temperature data cleaning

Data-driven techniques for temperature data prediction: big data analytics approach

Robust and Automatic Data Cleansing Method for Short-Term Load Forecasting of Distribution Feeders

Using Neural Networks for Data Cleaning in Weather Datasets

A High-Resolution Land Surface Temperature Downscaling Method Based on Geographically Weighted Neural Network Regression

Forecasting of Meteorological variables using statistical methods and tools

Neural-network modeling of solar radiation and temperature variability due to climate change in Ibadan Metropolis

DAT-Net: Filling of missing temperature values of meteorological stations by data augmentation attention neural network

A Generalised Additive Model and Deep Learning Method for Cross-Validating the North Atlantic Oscillation Index

Development and Application of a Statistically-Based Quality Control for Crowdsourced Air Temperature Data

Reconstructing aerosol optical depth using spatiotemporal Long Short-Term Memory convolutional autoencoder

Deep learning downscaled high-resolution daily near surface meteorological datasets over East Asia

An improved machine learning-based model for prediction of diurnal and spatially continuous near surface air temperature

ClimateNet: an expert-labeled open dataset and deep learning architecture for enabling high-precision analyses of extreme weather

A multilayer perceptron neural network approach for optimizing solar irradiance forecasting in Central Africa with meteorological insights

Transforming Observations of Ocean Temperature with a Deep Convolutional Residual Regressive Neural Network

Temperature and Relative Humidity Profile Retrieval from Fengyun-3D/VASS in the Arctic Region Using Neural Networks

A Deep Learning Approach to Increase the Value of Satellite Data for PM2.5 Monitoring in China

A Machine Learning Approach for the Efficient Estimation of Ground-Level Air Temperature in Urban Areas

A Deep Neural Network Modeling Framework to Reduce Bias in Satellite Precipitation Products

Validation of North American land data assimilation system Phase 2 (NLDAS-2) air temperature forcing and downscaled data with New York State station observations