Abstract:We study the problem of making predictions of an adversarially chosen high-dimensional state that are unbiased subject to an arbitrary collection of conditioning events, with the goal of tailoring these events to downstream decision makers. We give efficient algorithms for solving this problem, as well as a number of applications that stem from choosing an appropriate set of conditioning events. For example, we can efficiently make predictions targeted at polynomially many decision makers, giving each of them optimal swap regret if they best-respond to our predictions. We generalize this to online combinatorial optimization, where the decision makers have a very large action space, to give the first algorithms offering polynomially many decision makers no regret on polynomially many subsequences that may depend on their actions and the context. We apply these results to get efficient no-subsequence-regret algorithms in extensive-form games (EFGs), yielding a new family of regret guarantees for EFGs that generalizes some existing EFG regret notions, e.g. regret to informed causal deviations, and is generally incomparable to other known such notions. Next, we develop a novel transparent alternative to conformal prediction for building valid online adversarial multiclass prediction sets. We produce class scores that downstream algorithms can use for producing valid-coverage prediction sets, as if these scores were the true conditional class probabilities. We show this implies strong conditional validity guarantees including set-size-conditional and multigroup-fair coverage for polynomially many downstream prediction sets. Moreover, our class scores can be guaranteed to have improved $L_2$ loss, cross-entropy loss, and generally any Bregman loss, compared to any collection of benchmark models, yielding a high-dimensional real-valued version of omniprediction.

Predictions as statements and decisions

Learning Predictions for Algorithms with Predictions

Electronic structure study by means of X-ray spectroscopy and theoretical calculations of the "ferric star" single molecule magnet

Leading strategies in competitive on-line prediction

Online Classification with Predictions

Prediction in reading: A review of predictability effects, their theoretical implications, and beyond

Performative Prediction: Past and Future

Complexity Classes for Online Problems with and without Predictions

High-Dimensional Prediction for Sequential Decision Making

Competitive Machine Learning: Best Theoretical Prediction vs Optimization

Metric entropy in competitive on-line prediction

Improving Online Algorithms via ML Predictions

Prediction with eventual almost sure guarantees

From Fairness to Infinity: Outcome-Indistinguishable (Omni)Prediction in Evolving Graphs

Best of Many in Both Worlds: Online Resource Allocation with Predictions under Unknown Arrival Model

Online Algorithms with Multiple Predictions

Transitions, Losses, and Re-parameterizations: Elements of Prediction Games

Rehearsal: Learning from Prediction to Decision

Is there an Elegant Universal Theory of Prediction?

What's a Good Prediction? Challenges in evaluating an agent's knowledge

The production of prediction: What does machine learning want?