A Unified Theory of Robust and Distributionally Robust Optimization via the Primal-Worst-Equals-Dual-Best Principle

Jianzhe Zhen,Daniel Kuhn,Wolfram Wiesemann

2023-07-20

Abstract:Robust and distributionally robust optimization are modeling paradigms for decision-making under uncertainty where the uncertain parameters are only known to reside in an uncertainty set or are governed by any probability distribution from within an ambiguity set, respectively, and a decision is sought that minimizes a cost function under the most adverse outcome of the uncertainty. In this paper, we develop a rigorous and general theory of robust and distributionally robust nonlinear optimization using the language of convex analysis. Our framework is based on a generalized `primal-worst-equals-dual-best' principle that establishes strong duality between a semi-infinite primal worst and a non-convex dual best formulation, both of which admit finite convex reformulations. This principle offers an alternative formulation for robust optimization problems that obviates the need to mobilize the machinery of abstract semi-infinite duality theory to prove strong duality in distributionally robust optimization. We illustrate the modeling power of our approach through convex reformulations for distributionally robust optimization problems whose ambiguity sets are defined through general optimal transport distances, which generalize earlier results for Wasserstein ambiguity sets.

Optimization and Control

What problem does this paper attempt to address?

### What problem does the paper attempt to solve?

The paper primarily aims to address the issues in Robust Optimization (RO) and Distributionally Robust Optimization (DRO) in the context of decision-making under uncertainty. Specifically:

1. **Unified Theoretical Framework**:
- Proposes a unified theoretical framework for robust optimization and distributionally robust optimization based on convex analysis.
- Utilizes the "Primal-Worst-Equals-Dual-Best Principle" to establish strong duality between semi-infinite primal problems and non-convex dual problems, and these problems can be transformed into finite convex optimization problems.

2. **Robust Optimization**:
- Assumes that uncertain parameters take values within a predefined uncertainty set.
- Derives easily verifiable strong duality conditions, thus avoiding the use of abstract semi-infinite duality theory to prove strong duality.
- Addresses nonlinear functions and conic inequalities, significantly expanding the range of robust optimization problems that can be transformed into finite convex forms.

3. **Distributionally Robust Optimization**:
- Assumes that uncertain parameters follow a probability distribution, which is only partially known.
- Proposes a method to define ambiguity sets based on the Optimal Transport distance, thereby generalizing previous results on Wasserstein ambiguity sets.
- Provides easily verifiable strong duality conditions through convex analysis, simplifying computations in practical applications.

4. **Technical Details**:
- Discusses technical details in convex analysis, particularly the handling of extended real-valued functions.
- Provides explicit dual problem formulations, making algorithm implementation easier.

### Summary
This paper addresses the limitations and complexities of existing methods by establishing a unified theoretical framework for robust optimization and distributionally robust optimization. It offers a more general and easier-to-implement methodology, aiding in better handling of decision-making problems under uncertainty in practical applications.