Abstract:Causal analysis has become an essential component in understanding the underlying causes of phenomena across various fields. Despite its significance, existing literature on causal discovery algorithms is fragmented, with inconsistent methodologies, i.e., there is no universal classification standard for existing methods, and a lack of comprehensive evaluations, i.e., data characteristics are often ignored to be jointly analyzed when benchmarking algorithms. This study addresses these gaps by conducting an exhaustive review and empirical evaluation for causal discovery methods on numerical data, aiming to provide a clearer and more structured understanding of the field. Our research begins with a comprehensive literature review spanning over two decades, analyzing over 200 academic articles and identifying more than 40 representative algorithms. This extensive analysis leads to the development of a structured taxonomy tailored to the complexities of causal discovery, categorizing methods into six main types. To address the lack of comprehensive evaluations, our study conducts an extensive empirical assessment of 29 causal discovery algorithms on multiple synthetic and real-world datasets. We categorize synthetic datasets based on size, linearity, and noise distribution, employing five evaluation metrics, and summarize the top-3 algorithm recommendations, providing guidelines for users in various data scenarios. Our results highlight a significant impact of dataset characteristics on algorithm performance. Moreover, a metadata extraction strategy with an accuracy exceeding 80% is developed to assist users in algorithm selection on unknown datasets. Based on these insights, we offer professional and practical guidelines to help users choose the most suitable causal discovery methods for their specific dataset.

Better Simulations for Validating Causal Discovery with the DAG-Adaptation of the Onion Method

Idag: Invariant DAG Searching for Domain Generalization

Automated versus do-it-yourself methods for causal inference: Lessons learned from a data analysis competition

Simulation Experiments as a Causal Problem

Deep Learning With DAGs

Subset verification and search algorithms for causal DAGs

Conducting Simulations in Causal Inference with Networks-Based Structural Equation Models

Choosing DAG Models Using Markov and Minimal Edge Count in the Absence of Ground Truth

OCDB: Revisiting Causal Discovery with a Comprehensive Benchmark and Evaluation Framework

Adaptive Online Experimental Design for Causal Discovery

Confidence in Causal Discovery with Linear Causal Models

The Landscape of Causal Discovery Data: Grounding Causal Discovery in Real-World Applications

Credible causal inference beyond toy models

Comprehensive Review and Empirical Evaluation of Causal Discovery Algorithms for Numerical Data

DagSim: Combining DAG-based model structure with unconstrained data types and relations for flexible, transparent, and modularized data simulation

DoWhy: Addressing Challenges in Expressing and Validating Causal Assumptions

Evaluation Methods and Measures for Causal Learning Algorithms

Self-Compatibility: Evaluating Causal Discovery without Ground Truth

Discovering Internal Validity Threats and Operational Concerns in Single-Case Experimental Designs Through Directed Acyclic Graphs

Choice Function-Based Hyper-Heuristics for Causal Discovery under Linear Structural Equation Models

Amortized Causal Discovery: Learning to Infer Causal Graphs from Time-Series Data