ArgMed-Agents: Explainable Clinical Decision Reasoning with LLM Disscusion via Argumentation Schemes

Shengxin Hong,Liang Xiao,Xin Zhang,Jianxia Chen

2024-06-21

Abstract:There are two main barriers to using large language models (LLMs) in clinical reasoning. Firstly, while LLMs exhibit significant promise in Natural Language Processing (NLP) tasks, their performance in complex reasoning and planning falls short of expectations. Secondly, LLMs use uninterpretable methods to make clinical decisions that are fundamentally different from the clinician's cognitive processes. This leads to user distrust. In this paper, we present a multi-agent framework called ArgMed-Agents, which aims to enable LLM-based agents to make explainable clinical decision reasoning through interaction. ArgMed-Agents performs self-argumentation iterations via Argumentation Scheme for Clinical Discussion (a reasoning mechanism for modeling cognitive processes in clinical reasoning), and then constructs the argumentation process as a directed graph representing conflicting relationships. Ultimately, use symbolic solver to identify a series of rational and coherent arguments to support decision. We construct a formal model of ArgMed-Agents and present conjectures for theoretical guarantees. ArgMed-Agents enables LLMs to mimic the process of clinical argumentative reasoning by generating explanations of reasoning in a self-directed manner. The setup experiments show that ArgMed-Agents not only improves accuracy in complex clinical decision reasoning problems compared to other prompt methods, but more importantly, it provides users with decision explanations that increase their confidence.

Artificial Intelligence,Multiagent Systems,Symbolic Computation

What problem does this paper attempt to address?

This paper attempts to address two major obstacles in using large - language models (LLMs) for clinical decision support: 1. **Lack of complex reasoning and planning abilities**: Although LLMs perform well in natural - language - processing tasks, their performance in complex reasoning and planning tasks falls short of expectations. 2. **Inexplicability**: The methods employed by LLMs are opaque, leading to fundamental differences between the clinical decisions they make and the cognitive processes of doctors, which triggers user distrust. To overcome these obstacles, the paper proposes a multi - agent framework, ArgMed - Agents, which aims to enable LLM - based agents to perform interpretable clinical - decision - making reasoning through interaction. Specifically, ArgMed - Agents achieves this goal in the following ways: - **Self - argumentation iteration**: Conduct self - argumentation iteration through the Argumentation Scheme for Clinical Discussion (ASCD). - **Construct argumentation process**: Construct the argumentation process as a directed graph representing conflict relationships. - **Symbolic solver**: Use a symbolic solver to identify a series of reasonable and coherent arguments to support decision - making. The paper also proposes some conjectures with theoretical guarantees and verifies through experiments the accuracy and interpretability of ArgMed - Agents in complex clinical - decision - making reasoning tasks, especially in zero - sample settings, which shows a significant improvement compared to other methods.

ArgMed-Agents: Explainable Clinical Decision Reasoning with LLM Disscusion via Argumentation Schemes

MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoning

ClinicalAgent: Clinical Trial Multi-Agent System with Large Language Model-based Reasoning

Argumentative Large Language Models for Explainable and Contestable Decision-Making

Adaptive Reasoning and Acting in Medical Language Agents

MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Making

Multimodal Clinical Reasoning through Knowledge-augmented Rationale Generation

Large Language Models are Clinical Reasoners: Reasoning-Aware Diagnosis Framework with Prompt-Generated Rationales

MedAide: Towards an Omni Medical Aide via Specialized LLM-based Multi-Agent Collaboration

Textualized Agent-Style Reasoning for Complex Tasks by Multiple Round LLM Generation

SocraSynth: Multi-LLM Reasoning with Conditional Statistics

Integrating Automated Knowledge Extraction with Large Language Models for Explainable Medical Decision-Making

XAgents: A Framework for Interpretable Rule-Based Multi-Agents Cooperation

Reason for Future, Act for Now: A Principled Framework for Autonomous LLM Agents with Provable Sample Efficiency

An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaboration

LLM-ARC: Enhancing LLMs with an Automated Reasoning Critic

Towards Reasoning in Large Language Models via Multi-Agent Peer Review Collaboration

Reason for Future, Act for Now: A Principled Architecture for Autonomous LLM Agents

Corex: Pushing the Boundaries of Complex Reasoning through Multi-Model Collaboration

Inquire, Interact, and Integrate: A Proactive Agent Collaborative Framework for Zero-Shot Multimodal Medical Reasoning