Abstract:In the modern healthcare system, rapidly expanding costs/complexity, the growing myriad of treatment options, and exploding information streams that often do not effectively reach the front lines hinder the ability to choose optimal treatment decisions over time. The goal in this paper is to develop a general purpose (non-disease-specific) computational/artificial intelligence (AI) framework to address these challenges. This serves two potential functions: 1) a simulation environment for exploring various healthcare policies, payment methodologies, etc., and 2) the basis for clinical artificial intelligence - an AI that can think like a doctor. This approach combines Markov decision processes and dynamic decision networks to learn from clinical data and develop complex plans via simulation of alternative sequential decision paths while capturing the sometimes conflicting, sometimes synergistic interactions of various components in the healthcare system. It can operate in partially observable environments (in the case of missing observations or data) by maintaining belief states about patient health status and functions as an online agent that plans and re-plans. This framework was evaluated using real patient data from an electronic health record. Such an AI framework easily outperforms the current treatment-as-usual (TAU) case-rate/fee-for-service models of healthcare (Cost per Unit Change: $189 vs. $497) while obtaining a 30-35% increase in patient outcomes. Tweaking certain model parameters further enhances this advantage, obtaining roughly 50% more improvement for roughly half the costs. Given careful design and problem formulation, an AI simulation framework can approximate optimal decisions even in complex and uncertain environments. Future work is described that outlines potential lines of research and integration of machine learning algorithms for personalized medicine.

A model-based method for computer-aided medical decision-making

A Knowledge Representation Method Based on Two-Layer Modeling for Constructing Medical Knowledge Base

A Patient-Similarity-based Model for Diagnostic Prediction

Modeling Paradigms for Medical Diagnostic Decision Support: A Survey and Future Directions

Syndromes Diagnostic Model for Coronary Artery Disease (CAD): an Improved Naïve Bayesian Classification Model Based on Attribute Relevancy

Decision Curve Analysis: a Technical Note

Decision making model to predict presence of coronary artery disease using neural network and C5.0 decision tree

Computer-based clinical decision aids. A review of methods and assessment of systems.

Machine Learning and Visualization in Clinical Decision Support: Current State and Future Directions

A Decision-Theoretic Model for Using Scientific Data

Bayesian Network Modelling for the Clinical Diagnosis of Alzheimer's Disease

Development of a graphical model of causal gene regulatory networks using medical big data and Bayesian machine learning

Edge computing-based ensemble learning model for health care decision systems

Medical diagnosis based on artificial intelligence and decision support system in the management of health development

A Medical Decision Making Study based on Markov Chain Model

Monte Carlo decision curve analysis using aggregate data

A Clinical Decision Support Framework for Heterogeneous Data Sources

The Research of Clinical Decision Support System Based on Three-Layer Knowledge Base Model

Bayesian Network Modelling for the Clinical Diagnosis of Alzheimer’s Disease

Artificial Intelligence Framework for Simulating Clinical Decision-Making: A Markov Decision Process Approach

Causal modeling in large-scale data to improve identification of adults at risk for combined and common variable immunodeficiencies