Abstract:Under stringent model type and variable distribution assumptions, differentiable score-based causal discovery methods learn a directed acyclic graph (DAG) from observational data by evaluating candidate graphs over an average score function. Despite great success in low-dimensional linear systems, it has been observed that these approaches overly exploit easier-to-fit samples, thus inevitably learning spurious edges. Worse still, inherent mostly in these methods the common homogeneity assumption can be easily violated, due to the widespread existence of heterogeneous data in the real world, resulting in performance vulnerability when noise distributions vary. We propose a simple yet effective model-agnostic framework to boost causal discovery performance by dynamically learning the adaptive weights for the Reweighted Score function, ReScore for short, where the weights tailor quantitatively to the importance degree of each sample. Intuitively, we leverage the bilevel optimization scheme to \wx{alternately train a standard DAG learner and reweight samples -- that is, upweight the samples the learner fails to fit and downweight the samples that the learner easily extracts the spurious information from. Extensive experiments on both synthetic and real-world datasets are carried out to validate the effectiveness of ReScore. We observe consistent and significant boosts in structure learning performance. Furthermore, we visualize that ReScore concurrently mitigates the influence of spurious edges and generalizes to heterogeneous data. Finally, we perform the theoretical analysis to guarantee the structure identifiability and the weight adaptive properties of ReScore in linear systems. Our codes are available at <a class="link-external link-https" href="https://github.com/anzhang314/ReScore" rel="external noopener nofollow">this https URL</a>.

Score-based Causal Discovery from Heterogeneous Data

Generalized Score Functions for Causal Discovery

Causal Discovery from Heterogeneous/Nonstationary Data with Independent Changes

Optimal Kernel Choice for Score Function-based Causal Discovery

Causal Discovery by Kernel Deviance Measures with Heterogeneous Transforms

Boosting Differentiable Causal Discovery via Adaptive Sample Reweighting

Boosting Causal Discovery via Adaptive Sample Reweighting

Scalable Causal Discovery with Score Matching

Unsupervised Pairwise Causal Discovery on Heterogeneous Data using Mutual Information Measures

Causal Discovery with Mixed Linear and Nonlinear Additive Noise Models: A Scalable Approach

A Metaheuristic Causal Discovery Method in Directed Acyclic Graphs Space

A Genetic Algorithm for Causal Discovery Based on Structural Causal Model.

A Hybrid Causal Structure Learning Algorithm for Mixed-Type Data

Federated Causal Discovery from Heterogeneous Data

A Skewness-Based Criterion for Addressing Heteroscedastic Noise in Causal Discovery

DiCausal: Exploiting Domain Knowledge for Interactive Causal Discovery.

Hybrid Local Causal Discovery

Causal Discovery over High-Dimensional Structured Hypothesis Spaces with Causal Graph Partitioning

Stable Differentiable Causal Discovery

Personalized Binomial DAGs Learning with Network Structured Covariates

High-dimensional causal discovery based on heuristic causal partitioning