Abstract:Optimization models used to make discrete decisions often contain uncertain parameters that are context-dependent and estimated through prediction. To account for the quality of the decision made based on the prediction, decision-focused learning (end-to-end predict-then-optimize) aims at training the predictive model to minimize regret, i.e., the loss incurred by making a suboptimal decision. Despite the challenge of the gradient of this loss w.r.t. the predictive model parameters being zero almost everywhere for optimization problems with a linear objective, effective gradient-based learning approaches have been proposed to minimize the expected loss, using the empirical loss as a surrogate. However, empirical regret can be an ineffective surrogate because empirical optimal decisions can vary substantially from expected optimal decisions. To understand the impact of this deficiency, we evaluate the effect of aleatoric and epistemic uncertainty on the accuracy of empirical regret as a surrogate. Next, we propose three novel loss functions that approximate expected regret more robustly. Experimental results show that training two state-of-the-art decision-focused learning approaches using robust regret losses improves test-sample empirical regret in general while keeping computational time equivalent relative to the number of training epochs.

Bayesian and minimax estimators of loss

The Impact of Loss Estimation on Gibbs Measures

An approach for finding fully Bayesian optimal designs using normal-based approximations to loss functions

Joint estimation of insurance loss development factors using Bayesian hidden Markov models

Minimax Estimation of Parameter in a Family of Distributions under Two Different Loss Functions

Minimax estimation of linear functionals under squared error loss

Stochastic Loss Reserving: Dependence and Estimation

All your loss are belong to Bayes

Minimal penalty for Goldenshluger-Lepski method

Proper losses regret at least 1/2-order

Robust Estimation of Loss Models for Lognormal Insurance Payment Severity Data

Large losses - probability minimizing approach

Comparison of Bayesian Estimation of the Scale Parameter for Loggamma Distribution Under Linex Loss Function and Compound Linex Loss Function

On continuous distribution functions, minimax and best invariant estimators, and integrated balanced loss functions

Robust Losses for Decision-Focused Learning

Decision Making with Side Information and Unbounded Loss Functions

Loss modeling with many-parameter distributions

Minimax Estimator of Regression Coefficient in Normal Distribution under Balanced Loss Function

Efficient Empirical Bayes prediction under check loss using Asymptotic Risk Estimates

Optimal nonparametric estimation of the expected shortfall risk

Statistical Learning of Value-at-Risk and Expected Shortfall