Abstract:Under stringent model type and variable distribution assumptions, score-based causal discovery methods learn the directed acyclic graph (DAG) from observational data by evaluating candidate graphs over an averaged score function. Despite the great success in low-dimensional linear systems, it has been observed that these approaches overly exploits easier-to-fit samples, thus inevitably learning spurious edges. Worse still, the common homogeneity assumption of most causal discovery methods can be easily violated due to the widespread existence of heterogeneous data in the real world, resulting in performance vulnerability when noise distributions vary. We propose a simple yet effective model-agnostic framework to boost causal discovery performance by dynamically learning the adaptive weights for the Reweighted Score function, ReScore for short, where the learned weights tailors quantitatively to the important degree of each samples. Intuitively, we leverage the bilevel optimization scheme to alternatively train a standard DAG learner first, then upweight the samples that the DAG learner fails to fit well and downweight the samples that the DAG learner easily extracts the causation information from. Extensive experiments on both synthetic and real-world datasets are carried out to validate the effectiveness of ReScore. We observe consistent and significant boosts in structure learning performance. We further visualize that ReScore concurrently mitigates the influence of spurious edges and generalizes to heterogeneous data. Finally, we perform theoretical analysis to guarantee the structure identifiability and the weight adaptive properties of ReScore. Our codes are available at https://anonymous.4open.science/r/ReScore-7631.

Boosting Causal Embeddings Via Potential Verb-Mediated Causal Patterns

Boosting Collective Entity Linking via Type-Guided Semantic Embedding.

Distributed Representation of Words in Cause and Effect Spaces

CausE: Towards Causal Knowledge Graph Embedding

Causal Lifting and Link Prediction

Boosting Efficiency in Task-Agnostic Exploration through Causal Knowledge

CausalBERT: Injecting Causal Knowledge Into Pre-trained Models with Minimal Supervision

Event causality extraction through external event knowledge learning and polyhedral word embedding

Creating Causal Embeddings for Question Answering with Minimal Supervision

Causal Enhanced Uplift Model

Constructing and Embedding Abstract Event Causality Networks from Text Snippets

A fine-grained causality extraction model incorporating relative location coding

Causality extraction based on self-attentive BiLSTM-CRF with transferred embeddings

A Meta-Learning Perspective on Transformers for Causal Language Modeling

Causal-relationship representation enhanced joint extraction model for elements and relationships

How to Enhance Causal Discrimination of Utterances: A Case on Affective Reasoning

Causal relation extraction and network construction of web events

Boosting Causal Additive Models

Enhancing Narrative Commonsense Reasoning With Multilevel Causal Knowledge

Boosting Causal Discovery via Adaptive Sample Reweighting

Effect Generation Based on Causal Reasoning