Abstract:Data-driven forecasts of air quality have recently achieved more accurate short-term predictions. Despite their success, most of the current data-driven solutions lack proper quantifications of model uncertainty that communicate how much to trust the forecasts. Recently, several practical tools to estimate uncertainty have been developed in probabilistic deep learning. However, there have not been empirical applications and extensive comparisons of these tools in the domain of air quality forecasts. Therefore, this work applies state-of-the-art techniques of uncertainty quantification in a real-world setting of air quality forecasts. Through extensive experiments, we describe training probabilistic models and evaluate their predictive uncertainties based on empirical performance, reliability of confidence estimate, and practical applicability. We also propose improving these models using "free" adversarial training and exploiting temporal and spatial correlation inherent in air quality data. Our experiments demonstrate that the proposed models perform better than previous works in quantifying uncertainty in data-driven air quality forecasts. Overall, Bayesian neural networks provide a more reliable uncertainty estimate but can be challenging to implement and scale. Other scalable methods, such as deep ensemble, Monte Carlo (MC) dropout, and stochastic weight averaging-Gaussian (SWAG), can perform well if applied correctly but with different tradeoffs and slight variations in performance metrics. Finally, our results show the practical impact of uncertainty estimation and demonstrate that, indeed, probabilistic models are more suitable for making informed decisions. Code and dataset are available at \url{https://github.com/Abdulmajid-Murad/deep_probabilistic_forecast}

Deep Learning based Uncertainty Decomposition for Real-time Control

Deep Modeling of Non-Gaussian Aleatoric Uncertainty

Spatial Uncertainty Sampling for End-to-End Control

Active Learning of Discrete-Time Dynamics for Uncertainty-Aware Model Predictive Control

Quantification of Uncertainties in Deep Learning-based Environment Perception

Improving Robustness of Deep Neural Networks for Aerial Navigation by Incorporating Input Uncertainty

Learning Disturbances Online for Risk-Aware Control: Risk-Aware Flight with Less Than One Minute of Data

Evaluating Uncertainty Quantification in End-to-End Autonomous Driving Control

A Deep Learning Approach For Epistemic Uncertainty Quantification Of Turbulent Flow Simulations

Uncertainty Quantification for Deep Learning

Generative Modeling of Residuals for Real-Time Risk-Sensitive Safety with Discrete-Time Control Barrier Functions

Disentangling Epistemic and Aleatoric Uncertainty in Reinforcement Learning

Enabling risk-aware Reinforcement Learning for medical interventions through uncertainty decomposition

Quantifying Epistemic Uncertainty in Deep Learning

Predicting Safety Misbehaviours in Autonomous Driving Systems using Uncertainty Quantification

How to Learn and Generalize From Three Minutes of Data: Physics-Constrained and Uncertainty-Aware Neural Stochastic Differential Equations

Robust Direct Data-Driven Control for Probabilistic Systems

Probabilistic Deep Learning to Quantify Uncertainty in Air Quality Forecasting

Learning Flight Control Systems from Human Demonstrations and Real-Time Uncertainty-Informed Interventions

Automatic AI controller that can drive with confidence: steering vehicle with uncertainty knowledge

Deep Learning Quadcopter Control Via Risk-Aware Active Learning.