Scoring Rules for Performative Binary Prediction

Abstract

We construct a model of expert prediction where predictions can influence the state of the world. Under this model, we show through theoretical and numerical results that proper scoring rules can incentivize experts to manipulate the world with their predictions. We also construct a simple class of scoring rules that avoids this problem.

Publication
In NeurIPS 2021 Workshop on Strategic ML
Alan Chan
Alan Chan
PhD Student

I work on AI governance as a Research Fellow at GovAI and a PhD student at Mila.

Related