Abstract:Inferring the causal structure that links n observables is usually based upon detecting statistical dependences and choosing simple graphs that make the joint measure Markovian. Here we argue why causal inference is also possible when only single observations are present. We develop a theory how to generate causal graphs explaining similarities between single objects. To this end, we replace the notion of conditional stochastic independence in the causal Markov condition with the vanishing of conditional algorithmic mutual information and describe the corresponding causal inference rules. We explain why a consistent reformulation of causal inference in terms of algorithmic complexity implies a new inference principle that takes into account also the complexity of conditional probability densities, making it possible to select among Markov equivalent causal graphs. This insight provides a theoretical foundation of a heuristic principle proposed in earlier work. We also discuss how to replace Kolmogorov complexity with decidable complexity criteria. This can be seen as an algorithmic analog of replacing the empirically undecidable question of statistical independence with practical independence tests that are based on implicit or explicit assumptions on the underlying distribution.

Markov Equivalence of Max-Linear Bayesian Networks

Distinguish Markov Equivalence Classes From Large-Scale Linear Non-Gaussian Data

Markov Kernels and the Conditional Extreme Value Model

Markov Equivalence Classes for Maximal Ancestral Graphs

Two-sample inference for high-dimensional Markov networks

Tropical combinatorics of max-linear Bayesian networks

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Discrete Max-Linear Bayesian Networks

Markov Processes Follow from the Principle of Maximum Caliber

A class of measure-valued Markov chains and Bayesian nonparametrics

Distributional Invariances and Interventional Markov Equivalence for Mixed Graph Models

Towards Bounding Causal Effects under Markov Equivalence

Optimal approximating Markov chains for Bayesian inference

Max Markov Chain

Geometric ergodicity of trans-dimensional Markov chain Monte Carlo algorithms

Causal inference using the algorithmic Markov condition

Max-Margin Nonparametric Latent Feature Models for Link Prediction.

Generalized linear mixed model with bayesian rank likelihood

A Markovian Model for Joint Observations, Bell's Inequality and Hidden States

Bayesian Discrete Conditional Transformation Models

Linking Frequentist and Bayesian Change-Point Methods