Abstract:We propose a statistically optimal approach to construct data-driven decisions for stochastic optimization problems. Fundamentally, a data-driven decision is simply a function that maps the available training data to a feasible action. It can always be expressed as the minimizer of a surrogate optimization model constructed from the data. The quality of a data-driven decision is measured by its out-of-sample risk. An additional quality measure is its out-of-sample disappointment, which we define as the probability that the out-of-sample risk exceeds the optimal value of the surrogate optimization model. An ideal data-driven decision should minimize the out-of-sample risk simultaneously with respect to every conceivable probability measure as the true measure is unkown. Unfortunately, such ideal data-driven decisions are generally unavailable. This prompts us to seek data-driven decisions that minimize the in-sample risk subject to an upper bound on the out-of-sample disappointment. We prove that such Pareto-dominant data-driven decisions exist under conditions that allow for interesting applications: the unknown data-generating probability measure must belong to a parametric ambiguity set, and the corresponding parameters must admit a sufficient statistic that satisfies a large deviation principle. We can further prove that the surrogate optimization model must be a distributionally robust optimization problem constructed from the sufficient statistic and the rate function of its large deviation principle. Hence the optimal method for mapping data to decisions is to solve a distributionally robust optimization model. Maybe surprisingly, this result holds even when the training data is non-i.i.d. Our analysis reveals how the structural properties of the data-generating stochastic process impact the shape of the ambiguity set underlying the optimal distributionally robust model.

Statistical Decision Theory Respecting Stochastic Dominance

Identification And Statistical Decision Theory

Statistical Comparisons of Classifiers by Generalized Stochastic Dominance

Exceeding Expectations: Stochastic Dominance as a General Decision Theory

A Pareto Dominance Principle for Data-Driven Optimization

Higher-degree Stochastic Dominance Optimality and Efficiency.

Beyond Expectations: Learning with Stochastic Dominance Made Practical

Decision Theory for Treatment Choice Problems with Partial Identification

Linear Tests for Decreasing Absolute Risk Aversion Stochastic Dominance.

Multivariate Almost Stochastic Dominance: Transfer Characterizations and Sufficient Conditions Under Dependence Uncertainty

Portfolio Construction Based on Stochastic Dominance and Empirical Likelihood

Stochastic Optimization with Decision-Dependent Distributions

Stochastic Madm Analysis Based On Stochastic Dominance Degrees

Weighted Utility and Optimism/Pessimism: A Decision-Theoretic Foundation of Various Stochastic Dominance Orders

Make Almost Stochastic Dominance Really Almost

Probabilistic Prediction for Binary Treatment Choice: with focus on personalized medicine

Decision Making with Side Information and Unbounded Loss Functions

A Method Based on the Disappointment Almost Stochastic Dominance Degree for the Multi-Attribute Decision Making with Linguistic Distributions.

Multivariate Stochastic Dominance via Optimal Transport and Applications to Models Benchmarking

Modified Wilcoxon-Mann-Whitney tests of stochastic dominance

A Critical Comparison of Three Notions of Fractional Stochastic Dominance