Abstract:Machine learning (ML) models are increasingly used in various applications, from recommendation systems in e-commerce to diagnosis prediction in healthcare. In this paper, we present a novel dynamic framework for thinking about the deployment of ML models in a performative, human-ML collaborative system. In our framework, the introduction of ML recommendations changes the data-generating process of human decisions, which are only a proxy to the ground truth and which are then used to train future versions of the model. We show that this dynamic process in principle can converge to different stable points, i.e. where the ML model and the Human+ML system have the same performance. Some of these stable points are suboptimal with respect to the actual ground truth. As a proof of concept, we conduct an empirical user study with 1,408 participants. In the study, humans solve instances of the knapsack problem with the help of machine learning predictions of varying performance. This is an ideal setting because we can identify the actual ground truth, and evaluate the performance of human decisions supported by ML recommendations. We find that for many levels of ML performance, humans can improve upon the ML predictions. We also find that the improvement could be even higher if humans rationally followed the ML recommendations. Finally, we test whether monetary incentives can increase the quality of human decisions, but we fail to find any positive effect. Using our empirical data to approximate our collaborative system suggests that the learning process would dynamically reach an equilibrium performance that is around 92% of the maximum knapsack value. Our results have practical implications for the deployment of ML models in contexts where human decisions may deviate from the indisputable ground truth.

The Limitations of Model Retraining in the Face of Performativity

Stochastic Optimization for Performative Prediction

Performative Prediction with Bandit Feedback: Learning through Reparameterization

Adjusting Pretrained Backbones for Performativity

How to Learn when Data Reacts to Your Model: Performative Gradient Descent

Practical Performative Policy Learning with Strategic Agents

Optimizing the Performative Risk under Weak Convexity Assumptions

Performative Prediction with Neural Networks

Performative Reinforcement Learning with Linear Markov Decision Process

Stochastic Optimization Schemes for Performative Prediction with Nonconvex Loss

Towards Stable Machine Learning Model Retraining via Slowly Varying Sequences

Tight Lower Bounds and Improved Convergence in Performative Prediction

Plug-in Performative Optimization

Post-Hoc Reversal: Are We Selecting Models Prematurely?

Revisiting the Superficial Alignment Hypothesis

A Dynamic Model of Performative Human-ML Collaboration: Theory and Empirical Evidence

Zero-Regret Performative Prediction Under Inequality Constraints

Stochastic Optimization with Decision-Dependent Distributions

Progress or Regress? Self-Improvement Reversal in Post-training

Pretrained AI Models: Performativity, Mobility, and Change