Abstract: Data-driven distributionally robust optimization is a recently emerging paradigm aimed at finding a solution that is driven by sample data but is protected against sampling errors. An increasingly popular approach, known as Wasserstein distributionally robust optimization (DRO), achieves this by applying the Wasserstein metric to construct a ball centred at the empirical distribution and finding a solution that performs well against the most adversarial distribution from the ball. In this paper, we present a general framework for studying different choices of a Wasserstein metric and point out the limitation of the existing choices. In particular, while choosing a Wasserstein metric of a higher order is desirable from a data-driven perspective, given its less conservative nature, such a choice comes with a high price from a robustness perspective - it is no longer applicable to many heavy-tailed distributions of practical concern. We show that this seemingly inevitable trade-off can be resolved by our framework, where a new class of Wasserstein metrics, called coherent Wasserstein metrics, is introduced. Like Wasserstein DRO, distributionally robust optimization using the coherent Wasserstein metrics, termed generalized Wasserstein distributionally robust optimization (GW-DRO), has all the desirable performance guarantees: finite-sample guarantee, asymptotic consistency, and computational tractability. The worst-case expectation problem in GW-DRO is in general a nonconvex optimization problem, yet we provide new analysis to prove its tractability without relying on the common duality scheme. Our framework, as shown in this paper, offers a fruitful opportunity to design novel Wasserstein DRO models that can be applied in various contexts such as operations management, finance, and machine learning.

Wasserstein Distributionally Robust Optimization and Variation Regularization

Wasserstein distributionally robust optimization and its tractable regularization formulations

On Generalization and Regularization Via Wasserstein Distributionally Robust Optimization

Regularization for Wasserstein distributionally robust optimization

Wasserstein Distributionally Robust Optimization: Theory and Applications in Machine Learning

A General Wasserstein Framework for Data-driven Distributionally Robust Optimization: Tractability and Applications

A General Wasserstein Framework for Data-driven Distributionally Robust Optimization: Tractability and Applications

Robust Wasserstein Optimization and its Application in Mean-CVaR

Distributionally Robust Optimization with Correlated Data from Vector Autoregressive Processes

A Robust Learning Algorithm for Regression Models Using Distributionally Robust Optimization under the Wasserstein Metric

A Distributionally Robust Optimization Approach for Multivariate Linear Regression under the Wasserstein Metric

Finite-Sample Guarantees for Wasserstein Distributionally Robust Optimization: Breaking the Curse of Dimensionality

Shortfall-Based Wasserstein Distributionally Robust Optimization

Wasserstein Distributionally Robust Optimization: A Three-Player Game Framework

Regularization for Adversarial Robust Learning

Universal generalization guarantees for Wasserstein distributionally robust models

Confidence regions in Wasserstein distributionally robust estimation

Data-driven distributionally robust optimization using the Wasserstein metric: performance guarantees and tractable reformulations

Distributional Robustness Bounds Generalization Errors

Decomposition Algorithm for Distributionally Robust Optimization using Wasserstein Metric

Mathematical Foundations of Robust and Distributionally Robust Optimization