Predictive Coding beyond Correlations

Tommaso Salvatori,Luca Pinchetti,Amine M'Charrak,Beren Millidge,Thomas Lukasiewicz
2024-06-03
Abstract:Recently, there has been extensive research on the capabilities of biologically plausible algorithms. In this work, we show how one of such algorithms, called predictive coding, is able to perform causal inference tasks. First, we show how a simple change in the inference process of predictive coding enables to compute interventions without the need to mutilate or redefine a causal graph. Then, we explore applications in cases where the graph is unknown, and has to be inferred from observational data. Empirically, we show how such findings can be used to improve the performance of predictive coding in image classification tasks, and conclude that such models are able to perform simple end-to-end causal inference tasks.
Machine Learning
What problem does this paper attempt to address?