Abstract:We introduce a new framework, Bayesian Distributionally Robust Optimization (Bayesian-DRO), for data-driven stochastic optimization where the underlying distribution is unknown. Bayesian-DRO contrasts with most of the existing DRO approaches in the use of Bayesian estimation of the unknown distribution. To make computation of Bayesian updating tractable, Bayesian-DRO first assumes the underlying distribution takes a parametric form with unknown parameter and then computes the posterior distribution of the parameter. To address the model uncertainty brought by the assumed parametric distribution, Bayesian-DRO constructs an ambiguity set of distributions with the assumed parametric distribution as the reference distribution and then optimizes with respect to the worst case in the ambiguity set. We show the consistency of the Bayesian posterior distribution and subsequently the convergence of objective functions and optimal solutions of Bayesian-DRO. Our consistency result of the Bayesian posterior requires simpler assumptions than the classical literature on Bayesian consistency. We also consider several approaches for selecting the ambiguity set size in Bayesian-DRO and compare them numerically. Our numerical experiments demonstrate the out-of-sample performance of Bayesian-DRO in comparison with Kullback-Leibler-based (KL-) and Wasserstein-based empirical DRO as well as risk-neutral Bayesian Risk Optimization. Our numerical results shed light on how to choose the modeling framework (Bayesian-DRO, KL-DRO, Wasserstein-DRO) for specific problems, but the choice for general problems still remains an important and open question.

What problem does this paper attempt to address?

This paper attempts to solve the problem of how to optimize in data - driven stochastic optimization when the underlying distribution is unknown. Specifically, the paper proposes a new framework - Bayesian Distributionally Robust Optimization (Bayesian - DRO) to address the model uncertainty problem in traditional methods. ### Main Problem Description In many practical applications, we cannot know exactly the true distribution \(Q^*\) of the random variable \(\xi\), but can only estimate it through limited data. Traditional Distributionally Robust Optimization (DRO) methods usually assume an ambiguity set and perform worst - case optimization on this basis. However, these methods often overlook the model uncertainty brought by the parametric distribution assumption. ### Core Contributions of the Paper 1. **Introducing the Bayesian DRO Framework**: - This framework first assumes that the underlying distribution has a certain parametric form \(P_\theta\), where \(\theta\) is an unknown parameter. - Then, it uses the Bayesian method to update the posterior distribution \(p(\theta|\xi^{(N)})\) of the parameter \(\theta\). - In order to deal with the model uncertainty brought by the parametric distribution assumption, an ambiguity set with the parametric distribution as a reference is constructed, and the worst - case optimal solution is sought in this set. 2. **Theoretical Guarantees**: - It is proved that the Bayesian posterior distribution is consistent, that is, as the amount of data increases, the posterior distribution will converge to the parametric distribution closest to the true distribution \(Q^*\). - It is further proved that the objective function and the optimal solution are consistent. 3. **Numerical Experiments**: - Through numerical experiments, the out - of - sample performance of Bayesian DRO is compared with that of other methods (such as empirical DRO based on Kullback - Leibler divergence and Wasserstein distance and risk - neutral Bayesian risk optimization). - Specific guidance for choosing different modeling frameworks (Bayesian - DRO, KL - DRO, Wasserstein - DRO) is provided, but it is pointed out that the choice for general problems is still an open research topic. ### Mathematical Formula Representation - **Bayesian Posterior Distribution**: \[ p(\theta|\xi^{(N)})=\frac{f(\xi^{(N)}|\theta)p(\theta)}{\int_{\Theta} f(\xi^{(N)}|\theta)p(\theta)d\theta} \] where \(f(\xi^{(N)}|\theta)\) is the conditional density of the sample and \(p(\theta)\) is the prior distribution. - **Bayesian DRO Problem**: \[ \min_{x\in X}\mathbb{E}_{\theta^N}\left[\sup_{Q\in M_\theta}\mathbb{E}_Q[G(x,\xi)]\right] \] where \(\mathbb{E}_{\theta^N}\) represents the expectation of the posterior distribution \(p(\theta|\xi^{(N)})\), and \(M_\theta\) is the ambiguity set with the parametric distribution as a reference. ### Summary By introducing the Bayesian DRO framework, this paper not only solves the model uncertainty problem existing in traditional DRO methods, but also provides strong theoretical consistency guarantees and verifies its superior out - of - sample performance through numerical experiments. This provides a new and effective tool for data - driven stochastic optimization.

Bayesian Distributionally Robust Optimization

Data-Driven Bayesian Nonparametric Wasserstein Distributionally Robust Optimization

Distributionally Robust Optimization with Confidence Bands for Probability Density Functions

O C ] 8 J an 2 01 9 Distributionally Robust Optimization with Confidence Bands for Probability Density Functions

A Bayesian Risk Approach to Data-driven Stochastic Optimization: Formulations and Asymptotics

Distributionally Robust Optimisation with Bayesian Ambiguity Sets

Distributionally Robust Bayesian Optimization with $φ$-divergences

Multi-stage Distributionally Robust Convex Stochastic Optimization with Bayesian-type Ambiguity Sets

Bayesian Nonparametrics Meets Data-Driven Distributionally Robust Optimization

Doubly Robust Data-Driven Distributionally Robust Optimization

Distributionally Robust Optimization under Distorted Expectations

Decision Making under the Exponential Family: Distributionally Robust Optimisation with Bayesian Ambiguity Sets

Distributionally Robust Decision Making Leveraging Conditional Distributions

Large-Scale Non-convex Stochastic Constrained Distributionally Robust Optimization

DORO: Distributional and Outlier Robust Optimization

Distributed Robust Optimization in Networked System.

Wasserstein Distributionally Robust Optimization with Heterogeneous Data Sources

Computationally Efficient Approximations for Distributionally Robust Optimization Under Moment and Wasserstein Ambiguity

Non-convex Distributionally Robust Optimization: Non-asymptotic Analysis

Modeling the Second Player in Distributionally Robust Optimization