Abstract:Causal representation learning algorithms discover lower-dimensional representations of data that admit a decipherable interpretation of cause and effect; as achieving such interpretable representations is challenging, many causal learning algorithms utilize elements indicating prior information, such as (linear) structural causal models, interventional data, or weak supervision. Unfortunately, in exploratory causal representation learning, such elements and prior information may not be available or warranted. Alternatively, scientific datasets often have multiple modalities or physics-based constraints, and the use of such scientific, multimodal data has been shown to improve disentanglement in fully unsupervised settings. Consequently, we introduce a causal representation learning algorithm (causalPIMA) that can use multimodal data and known physics to discover important features with causal relationships. Our innovative algorithm utilizes a new differentiable parametrization to learn a directed acyclic graph (DAG) together with a latent space of a variational autoencoder in an end-to-end differentiable framework via a single, tractable evidence lower bound loss function. We place a Gaussian mixture prior on the latent space and identify each of the mixtures with an outcome of the DAG nodes; this novel identification enables feature discovery with causal relationships. Tested against a synthetic and a scientific dataset, our results demonstrate the capability of learning an interpretable causal structure while simultaneously discovering key features in a fully unsupervised setting.

SCM-VAE: Learning Identifiable Causal Representations Via Structural Knowledge.

Learning Causally Disentangled Representations via the Principle of Independent Causal Mechanisms

Towards Human-like Perception: Learning Structural Causal Model in Heterogeneous Graph

Structural Causality-based Generalizable Concept Discovery Models

CMVAE: Causal Meta VAE for Unsupervised Meta-Learning.

Identifying Weight-Variant Latent Causal Models

CauF-VAE: Causal Disentangled Representation Learning with VAE and Causal Flows

Inducing Causal Structure for Abstractive Text Summarization

Causal Flow-based Variational Auto-Encoder for Disentangled Causal Representation Learning

Concept-free Causal Disentanglement with Variational Graph Auto-Encoder

Disentangled Representation Learning for Causal Inference with Instruments

Causal disentanglement of multimodal data

Learning Causal Abstractions of Linear Structural Causal Models

Learning Conditional Instrumental Variable Representation for Causal Effect Estimation

Language-Based Causal Representation Learning

Causal Representation Learning Via Counterfactual Intervention

VACA: Designing Variational Graph Autoencoders for Causal Queries

Unifying Causal Representation Learning with the Invariance Principle

Causal Discovery in Linear Structural Causal Models with Deterministic Relations

Amortized Inference for Causal Structure Learning

Diffusion-Based Causal Representation Learning