Abstract:Causal representation learning algorithms discover lower-dimensional representations of data that admit a decipherable interpretation of cause and effect; as achieving such interpretable representations is challenging, many causal learning algorithms utilize elements indicating prior information, such as (linear) structural causal models, interventional data, or weak supervision. Unfortunately, in exploratory causal representation learning, such elements and prior information may not be available or warranted. Alternatively, scientific datasets often have multiple modalities or physics-based constraints, and the use of such scientific, multimodal data has been shown to improve disentanglement in fully unsupervised settings. Consequently, we introduce a causal representation learning algorithm (causalPIMA) that can use multimodal data and known physics to discover important features with causal relationships. Our innovative algorithm utilizes a new differentiable parametrization to learn a directed acyclic graph (DAG) together with a latent space of a variational autoencoder in an end-to-end differentiable framework via a single, tractable evidence lower bound loss function. We place a Gaussian mixture prior on the latent space and identify each of the mixtures with an outcome of the DAG nodes; this novel identification enables feature discovery with causal relationships. Tested against a synthetic and a scientific dataset, our results demonstrate the capability of learning an interpretable causal structure while simultaneously discovering key features in a fully unsupervised setting.

Causal Discovery for Modular World Models

Modular Learning of Deep Causal Generative Models for High-dimensional Causal Inference

Discovering Latent Structural Causal Models from Spatio-Temporal Data

Discovering Mixtures of Structural Causal Models from Time Series Data

Constraint-based Causal Discovery for Non-Linear Structural Causal Models with Cycles and Latent Confounders

Local Causal Discovery with Linear non-Gaussian Cyclic Models

Causal discovery with endogenous context variables

Language Agents Meet Causality -- Bridging LLMs and Causal World Models

Amortized Causal Discovery: Learning to Infer Causal Graphs from Time-Series Data

Learning Causal Dynamics Models in Object-Oriented Environments

Robust agents learn causal world models

Contrastive Unsupervised Learning of World Model with Invariant Causal Features

Scalable Variational Causal Discovery Unconstrained by Acyclicity

Induced Covariance for Causal Discovery in Linear Sparse Structures

A Versatile Causal Discovery Framework to Allow Causally-Related Hidden Variables

Causal disentanglement of multimodal data

Large Language Models for Constrained-Based Causal Discovery

Discovery of the Hidden World with Large Language Models

Causal Discovery with Language Models as Imperfect Experts

Causal Discovery and Forecasting in Nonstationary Environments with State-Space Models