Abstract:Large language models (LLMs) have achieved significant success across various domains. However, the inherent complexity of causal problems and causal theory poses challenges in accurately describing them in natural language, making it difficult for LLMs to comprehend and use them effectively. Causal methods are not easily conveyed through natural language, which hinders LLMs' ability to apply them accurately. Additionally, causal datasets are typically tabular, while LLMs excel in handling natural language data, creating a structural mismatch that impedes effective reasoning with tabular data. This lack of causal reasoning capability limits the development of LLMs. To address these challenges, we have equipped the LLM with causal tools within an agent framework, named the Causal Agent, enabling it to tackle causal problems. The causal agent comprises tools, memory, and reasoning modules. In the tools module, the causal agent applies causal methods to align tabular data with natural language. In the reasoning module, the causal agent employs the ReAct framework to perform reasoning through multiple iterations with the tools. In the memory module, the causal agent maintains a dictionary instance where the keys are unique names and the values are causal graphs. To verify the causal ability of the causal agent, we established a benchmark consisting of four levels of causal problems: variable level, edge level, causal graph level, and causal effect level. We generated a test dataset of 1.3K using ChatGPT-3.5 for these four levels of issues and tested the causal agent on the datasets. Our methodology demonstrates remarkable efficacy on the four-level causal problems, with accuracy rates all above 80%. For further insights and implementation details, our code is accessible via the GitHub repository <a class="link-external link-https" href="https://github.com/Kairong-Han/Causal_Agent" rel="external noopener nofollow">this https URL</a>.

Causal Knowledge Representation and Nonmonotonic Reasoning Models in Law Consultant Systems

Fuzzy Cognitive Map Based Agent Reasoning Model

The expressive language ALCNHR+K(D) for knowledge reasoning

Non-monotonic Reasoning and Argumentation System

Towards CausalGPT: A Multi-Agent Approach for Faithful Knowledge Reasoning via Promoting Causal Consistency in LLMs

Is Knowledge All Large Language Models Needed for Causal Reasoning?

Knowledge is Power: Understanding Causality Makes Legal judgment Prediction Models More Generalizable and Robust

Argumentation-Based Non-Monotonic Reasoning of Agents

Causal Agent based on Large Language Model

A Logical Approach to Doxastic Causal Reasoning.

Language Agents Meet Causality -- Bridging LLMs and Causal World Models

Causal Laws and Multi-Valued Fluents

A Model of Reasoning about Knowledge

Learning a Structural Causal Model for Intuition Reasoning in Conversation

CLEAR: Can Language Models Really Understand Causal Graphs?

A Lewisian Logic of Causal Counterfactuals

Causal Reasoning in Large Language Models: A Knowledge Graph Approach

A causal-based symbolic reasoning framework for uncertain knowledge graphs

Neuro-Symbolic Integration Brings Causal and Reliable Reasoning Proofs

CLadder: Assessing Causal Reasoning in Language Models