Conformalized-DeepONet: A Distribution-Free Framework for Uncertainty Quantification in Deep Operator Networks

Christian Moya,Amirhossein Mollaali,Zecheng Zhang,Lu Lu,Guang Lin

2024-02-24

Abstract:In this paper, we adopt conformal prediction, a distribution-free uncertainty quantification (UQ) framework, to obtain confidence prediction intervals with coverage guarantees for Deep Operator Network (DeepONet) regression. Initially, we enhance the uncertainty quantification frameworks (B-DeepONet and Prob-DeepONet) previously proposed by the authors by using split conformal prediction. By combining conformal prediction with our Prob- and B-DeepONets, we effectively quantify uncertainty by generating rigorous confidence intervals for DeepONet prediction. Additionally, we design a novel Quantile-DeepONet that allows for a more natural use of split conformal prediction. We refer to this distribution-free effective uncertainty quantification framework as split conformal Quantile-DeepONet regression. Finally, we demonstrate the effectiveness of the proposed methods using various ordinary, partial differential equation numerical examples, and multi-fidelity learning.

Machine Learning,Numerical Analysis

What problem does this paper attempt to address?

The paper aims to address the issue of uncertainty quantification (UQ) in Deep Operator Networks (DeepONet) for operational learning and proposes a conformal prediction-based method to construct confidence intervals with coverage guarantees. Specifically, the objectives of the paper include: 1. **Improving existing uncertainty quantification frameworks**: By incorporating Split Conformal Prediction, the paper enhances the previously proposed Bayesian Deep Operator Network (B-DeepONet) and Probabilistic Deep Operator Network (Prob-DeepONet) frameworks to generate confidence intervals with coverage guarantees. 2. **Proposing a new Quantile-DeepONet extension**: The paper designs a new Quantile-DeepONet to better facilitate the development of a Split Conformal Quantile-DeepONet regression algorithm, thereby constructing rigorous confidence intervals. The main contribution of the paper lies in addressing the shortcomings of existing methods in generating rigorous confidence intervals through the Split Conformal Prediction method, thereby improving the performance of DeepONet in various numerical experiments.

Conformalized-DeepONet: A Distribution-Free Framework for Uncertainty Quantification in Deep Operator Networks

Scalable Uncertainty Quantification for Deep Operator Networks using Randomized Priors

DOA Uncertainty Quantification With Conformal Prediction

Calibrated Uncertainty Quantification for Operator Learning via Conformal Prediction

A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantification

Conformal Prediction on Quantifying Uncertainty of Dynamic Systems

Distribution free uncertainty quantification in neuroscience-inspired deep operators

Deep Conformal Supervision: Leveraging Intermediate Features for Robust Uncertainty Quantification

Improved Copula-based conformal prediction for uncertainty quantification of multi-output regression

Robust and scalable uncertainty estimation with conformal prediction for machine-learned interatomic potentials

Uncertainty quantification for deeponets with ensemble kalman inversion

On the Out-of-Distribution Coverage of Combining Split Conformal Prediction and Bayesian Deep Learning

Quantifying Deep Learning Model Uncertainty in Conformal Prediction

Nested conformal prediction and quantile out-of-bag ensemble methods

Adaptive Uncertainty Quantification for Generative AI

Conformal Prediction: A Gentle Introduction

Empirical Validation of Conformal Prediction for Trustworthy Skin Lesions Classification

Uncertainty Quantification of Surrogate Models using Conformal Prediction

Improving Uncertainty Quantification of Deep Classifiers via Neighborhood Conformal Prediction: Novel Algorithm and Theoretical Analysis

Using Uncertainty Quantification to Characterize and Improve Out-of-Domain Learning for PDEs

Conformal Prediction: A Data Perspective