Abstract:Causal analysis has become an essential component in understanding the underlying causes of phenomena across various fields. Despite its significance, existing literature on causal discovery algorithms is fragmented, with inconsistent methodologies, i.e., there is no universal classification standard for existing methods, and a lack of comprehensive evaluations, i.e., data characteristics are often ignored to be jointly analyzed when benchmarking algorithms. This study addresses these gaps by conducting an exhaustive review and empirical evaluation for causal discovery methods on numerical data, aiming to provide a clearer and more structured understanding of the field. Our research begins with a comprehensive literature review spanning over two decades, analyzing over 200 academic articles and identifying more than 40 representative algorithms. This extensive analysis leads to the development of a structured taxonomy tailored to the complexities of causal discovery, categorizing methods into six main types. To address the lack of comprehensive evaluations, our study conducts an extensive empirical assessment of 29 causal discovery algorithms on multiple synthetic and real-world datasets. We categorize synthetic datasets based on size, linearity, and noise distribution, employing five evaluation metrics, and summarize the top-3 algorithm recommendations, providing guidelines for users in various data scenarios. Our results highlight a significant impact of dataset characteristics on algorithm performance. Moreover, a metadata extraction strategy with an accuracy exceeding 80% is developed to assist users in algorithm selection on unknown datasets. Based on these insights, we offer professional and practical guidelines to help users choose the most suitable causal discovery methods for their specific dataset.

Can algorithms Replace Expert Knowledge for Causal Inference? A Case Study on Novice Use of Causal Discovery

Can algorithms Replace Expert Knowledge for Causal Inference? A Case Study on Novice Use of Causal Discovery

Synthesizing Subject-matter Expertise for Variable Selection in Causal Effect Estimation: A Case Study

Causal Inference and Counterfactual Prediction in Machine Learning for Actionable Healthcare

Comprehensive Review and Empirical Evaluation of Causal Discovery Algorithms for Numerical Data

Methods and tools for causal discovery and causal inference

Causal discovery for observational sciences using supervised machine learning

Causal Discovery with Stage Variables for Health Time Series

Comparative Study of Causal Discovery Methods for Cyclic Models with Hidden Confounders

The Impact of Missing Data on Causal Discovery: A Multicentric Clinical Study

An Application of the Causal Roadmap in Two Safety Monitoring Case Studies: Covariate-Adjustment and Outcome Prediction using Electronic Health Record Data

An Introduction to Causal Discovery

The Causal Plausibility Decision in Healthcare

Matching Algorithms for Causal Inference with Multiple Treatments

RCT Rejection Sampling for Causal Estimation Evaluation

Overcoming Confounding Bias in Causal Discovery Using Minimum Redundancy and Maximum Relevancy Constraint

Permutation-based Causal Inference Algorithms with Interventions

Causal Discovery Analysis: A Promising Tool for Precision Medicine

Comparing Causal Inference Methods for Point Exposures with Missing Confounders: A Simulation Study

Practical Approaches to Causal Relationship Exploration

Comparing Covariate Prioritization via Matching to Machine Learning Methods for Causal Inference using Five Empirical Applications