Abstract:The causal capabilities of large language models (LLMs) are a matter of significant debate, with critical implications for the use of LLMs in societally impactful domains such as medicine, science, law, and policy. We conduct a "behavorial" study of LLMs to benchmark their capability in generating causal arguments. Across a wide range of tasks, we find that LLMs can generate text corresponding to correct causal arguments with high probability, surpassing the best-performing existing methods. Algorithms based on GPT-3.5 and 4 outperform existing algorithms on a pairwise causal discovery task (97%, 13 points gain), counterfactual reasoning task (92%, 20 points gain) and event causality (86% accuracy in determining necessary and sufficient causes in vignettes). We perform robustness checks across tasks and show that the capabilities cannot be explained by dataset memorization alone, especially since LLMs generalize to novel datasets that were created after the training cutoff date. That said, LLMs exhibit unpredictable failure modes, and we discuss the kinds of errors that may be improved and what are the fundamental limits of LLM-based answers. Overall, by operating on the text metadata, LLMs bring capabilities so far understood to be restricted to humans, such as using collected knowledge to generate causal graphs or identifying background causal context from natural language. As a result, LLMs may be used by human domain experts to save effort in setting up a causal analysis, one of the biggest impediments to the widespread adoption of causal methods. Given that LLMs ignore the actual data, our results also point to a fruitful research direction of developing algorithms that combine LLMs with existing causal techniques. Code and datasets are available at <a class="link-external link-https" href="https://github.com/py-why/pywhy-llm" rel="external noopener nofollow">this https URL</a>.

Knowledge Graph Structure as Prompt: Improving Small Language Models Capabilities for Knowledge-based Causal Discovery

Causal Reasoning in Large Language Models: A Knowledge Graph Approach

Prompt-based vs. Fine-tuned LLMs Toward Causal Graph Verification

Large Language Models Can Better Understand Knowledge Graphs Than We Thought

Graph Neural Prompting with Large Language Models

Large Language Models are Effective Priors for Causal Graph Discovery

From Query Tools to Causal Architects: Harnessing Large Language Models for Advanced Causal Discovery from Data

Fine-tuning and Prompt Engineering with Cognitive Knowledge Graphs for Scholarly Knowledge Organization

Integrating Large Language Models in Causal Discovery: A Statistical Causal Approach

Causal Reasoning and Large Language Models: Opening a New Frontier for Causality

Causality-aware Concept Extraction based on Knowledge-guided Prompting

Causal Graph Discovery with Retrieval-Augmented Generation based Large Language Models

Large Language Models and Knowledge Graphs: Opportunities and Challenges

CausalGraph2LLM: Evaluating LLMs for Causal Queries

Can We Utilize Pre-trained Language Models within Causal Discovery Algorithms?

Knowledge Graph-Enhanced Large Language Models via Path Selection

Causal Structure Learning Supervised by Large Language Model

Large Language Models for Constrained-Based Causal Discovery

An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaboration

Can large language models build causal graphs?

Causality for Large Language Models