Abstract:Predictions about people, such as their expected educational achievement or their credit risk, can be performative and shape the outcome that they aim to predict. Understanding the causal effect of these predictions on the eventual outcomes is crucial for foreseeing the implications of future predictive models and selecting which models to deploy. However, this causal estimation task poses unique challenges: model predictions are usually deterministic functions of input features and highly correlated with outcomes. This can make the causal effects of predictions on outcomes impossible to disentangle from the direct effect of the covariates. We study this problem through the lens of causal identifiability, and despite the hardness of this problem in full generality, we highlight three natural scenarios where the causal relationship between covariates, predictions and outcomes can be identified from observational data: randomization in predictions, overparameterization of the predictive model deployed during data collection, and discrete prediction outputs. Empirically we show that given our identifiability conditions hold, standard variants of supervised learning that predict from predictions by treating the prediction as an input feature can indeed find transferable functional relationships that allow for conclusions about newly deployed predictive models. These positive results fundamentally rely on model predictions being recorded during data collection, bringing forward the importance of rethinking standard data collection practices to enable progress towards a better understanding of social outcomes and performative feedback loops.

Learning the Distribution Map in Reverse Causal Performative Prediction

Microfoundation Inference for Strategic Prediction

Anticipating Performativity by Predicting from Predictions

Practical Performative Policy Learning with Strategic Agents

Distributionally Robust Performative Prediction

Performative Prediction: Past and Future

Causal Inference and Counterfactual Prediction in Machine Learning for Actionable Healthcare

Towards Out-of-Distribution Sequential Event Prediction: A Causal Treatment

Performative Prediction with Bandit Feedback: Learning through Reparameterization

CausPref: Causal Preference Learning for Out-of-Distribution Recommendation.

Learning In Reverse Causal Strategic Environments With Ramifications on Two Sided Markets

A Unifying Causal Framework for Analyzing Dataset Shift-stable Learning Algorithms

Distribution-Free Prediction Intervals Under Covariate Shift, With an Application to Causal Inference

New User Event Prediction Through the Lens of Causal Inference

Evaluating and Correcting Performative Effects of Decision Support Systems via Causal Domain Shift

Learning Causal Semantic Representation for Out-of-Distribution Prediction

Explaining the Behavior of Black-Box Prediction Algorithms with Causal Learning

Causal Learning Empowered OD Prediction for Urban Planning

Stochastic Optimization for Performative Prediction

Learning Causally Invariant Reward Functions from Diverse Demonstrations

Performative Prediction with Neural Networks