Abstract:In the modern healthcare system, rapidly expanding costs/complexity, the growing myriad of treatment options, and exploding information streams that often do not effectively reach the front lines hinder the ability to choose optimal treatment decisions over time. The goal in this paper is to develop a general purpose (non-disease-specific) computational/artificial intelligence (AI) framework to address these challenges. This serves two potential functions: 1) a simulation environment for exploring various healthcare policies, payment methodologies, etc., and 2) the basis for clinical artificial intelligence - an AI that can think like a doctor. This approach combines Markov decision processes and dynamic decision networks to learn from clinical data and develop complex plans via simulation of alternative sequential decision paths while capturing the sometimes conflicting, sometimes synergistic interactions of various components in the healthcare system. It can operate in partially observable environments (in the case of missing observations or data) by maintaining belief states about patient health status and functions as an online agent that plans and re-plans. This framework was evaluated using real patient data from an electronic health record. Such an AI framework easily outperforms the current treatment-as-usual (TAU) case-rate/fee-for-service models of healthcare (Cost per Unit Change: $189 vs. $497) while obtaining a 30-35% increase in patient outcomes. Tweaking certain model parameters further enhances this advantage, obtaining roughly 50% more improvement for roughly half the costs. Given careful design and problem formulation, an AI simulation framework can approximate optimal decisions even in complex and uncertain environments. Future work is described that outlines potential lines of research and integration of machine learning algorithms for personalized medicine.

Emerging medical informatics with case-based reasoning for aiding clinical decision in multi-agent system

Integrating HL7 RIM and Ontology for Unified Knowledge and Data Representation in Clinical Decision Support Systems

Design and Development of a Sharable Clinical Decision Support System Based on a Semantic Web Service Framework

A Knowledge Representation Method Based on Two-Layer Modeling for Constructing Medical Knowledge Base

Risk prediction in surgery using case-based reasoning and agent-based modelization

Leveraging XML-based electronic medical records to extract experiential clinical knowledge. An automated approach to generate cases for medical case-based reasoning systems

A Smart Healthcare Knowledge Service Framework for Hierarchical Medical Treatment System

The Case Manager: An Agent Controlling the Activation of Knowledge Sources in a FHIR-Based Distributed Reasoning Environment

Artificial Intelligent Agent Architecture and Clinical Decision-Making in the Healthcare Sector

A Multi-Agent Formalism Based on Contextual Defeasible Logic for Healthcare Systems

Multiagent Approach for the Representation of Information in a Decision Support System

Autonomous Artificial Intelligence Agents for Clinical Decision Making in Oncology

MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Making

Multi-agent adaptive learning system based on incremental hybrid case-based reasoning (IHCBR)

Clinical decision-support systems for intensive care units using case-based reasoning

MedAide: Towards an Omni Medical Aide via Specialized LLM-based Multi-Agent Collaboration

Constructing Ontology-Based Cancer Treatment Decision Support System with Case-Based Reasoning

Software Solutions for Biomedical Decision Making

Towards Next-Generation Medical Agent: How o1 is Reshaping Decision-Making in Medical Scenarios

Multi-agent Searching System for Medical Information

Artificial Intelligence Framework for Simulating Clinical Decision-Making: A Markov Decision Process Approach