Abstract:Polynomial chaos expansion (PCE) is a versatile tool widely used in uncertainty quantification and machine learning, but its successful application depends strongly on the accuracy and reliability of the resulting PCE-based response surface. High accuracy typically requires high polynomial degrees, demanding many training points especially in high-dimensional problems through the curse of dimensionality. So-called sparse PCE concepts work with a much smaller selection of basis polynomials compared to conventional PCE approaches and can overcome the curse of dimensionality very efficiently, but have to pay specific attention to their strategies of choosing training points. Furthermore, the approximation error resembles an uncertainty that most existing PCE-based methods do not estimate. In this study, we develop and evaluate a fully Bayesian approach to establish the PCE representation via joint shrinkage priors and Markov chain Monte Carlo. The suggested Bayesian PCE model directly aims to solve the two challenges named above: achieving a sparse PCE representation and estimating uncertainty of the PCE itself. The embedded Bayesian regularizing via the joint shrinkage prior allows using higher polynomial degrees for given training points due to its ability to handle underdetermined situations, where the number of considered PCE coefficients could be much larger than the number of available training points. We also explore multiple variable selection methods to construct sparse PCE expansions based on the established Bayesian representations, while globally selecting the most meaningful orthonormal polynomials given the available training data. We demonstrate the advantages of our Bayesian PCE and the corresponding sparsity-inducing methods on several benchmarks.

Multivariate regression and fit function uncertainty

Theoretical characterization of uncertainty in high-dimensional linear classification

Uncertainty Analysis for Non-identifiable Dynamical Systems: Profile Likelihoods, Bootstrapping and More

Uncertainty Quantification Using Polynomial Chaos Expansion with Points of Monomial Cubature Rules

Cubature-based uncertainty estimation for nonlinear regression models

Multivariate uncertain regression model with imprecise observations

Towards a Unified Framework for Uncertainty-aware Nonlinear Variable Selection with Theoretical Guarantees

Uncertainty calibration for probabilistic projection methods

Uncertainty-Aware Principal Component Analysis

Practical and Rigorous Uncertainty Bounds for Gaussian Process Regression

An adaptive minimum spanning tree multi-element method for uncertainty quantification of smooth and discontinuous responses

Enhanced Gaussian-mixture-model-based nonlinear probabilistic uncertainty propagation using Gaussian splitting approach

Outlier Robust Multivariate Polynomial Regression

Robust Regression over Averaged Uncertainty

A fully Bayesian sparse polynomial chaos expansion approach with joint priors on the coefficients and global selection of terms

Awareness of uncertainty in classification using a multivariate model and multi-views

Polynomial approaches in improving accuracy of probability distribution estimation using the method of moments

Tukey’s biweight estimation for uncertain regression model with imprecise observations

Mixtures of Gaussians and Minimum Relative Entropy Techniques for Modeling Continuous Uncertainties

A Statistical Perspective on Linear Programs with Uncertain Parameters

Multi-Layer Kernel Machines: Fast and Optimal Nonparametric Regression with Uncertainty Quantification