Abstract:Background and objective In everyday clinical practice, medical decision is currently based on clinical guidelines which are often static and rigid, and do not account for population variability, while individualized, patient-oriented decision and/or treatment are the paradigm change necessary to enter into the era of precision medicine. Most of the limitations of a guideline-based system could be overcome through the adoption of Clinical Decision Support Systems (CDSSs) based on Artificial Intelligence (AI) algorithms. However, the black-box nature of AI algorithms has hampered a large adoption of AI-based CDSSs in clinical practice. In this study, an innovative AI-based method to compress AI-based prediction models into explainable, model-agnostic, and reduced decision support systems (NEAR) with application to healthcare is presented and validated. Methods NEAR is based on the Shapley Additive Explanations framework and can be applied to complex input models to obtain the contributions of each input feature to the output. Technically, the simplified NEAR models approximate contributions from input features using a custom library and merge them to determine the final output. Finally, NEAR estimates the confidence error associated with the single input feature contributing to the final score, making the result more interpretable. Here, NEAR is evaluated on a clinical real-world use case, the mortality prediction in patients who experienced Acute Coronary Syndrome (ACS), applying three different Machine Learning/Deep Learning models as implementation examples. Results NEAR, when applied to the ACS use case, exhibits performances like the ones of the AI-based model from which it is derived, as in the case of the Adaptive Boosting classifier, whose Area Under the Curve is not statistically different from the NEAR one, even the model's simplification. Moreover, NEAR comes with intrinsic explainability and modularity, as it can be tested on the developed web application platform ( https://neardashboard.pythonanywhere.com/ ). Conclusions An explainable and reliable CDSS tailored to single-patient analysis has been developed. The proposed AI-based system has the potential to be used alongside the clinical guidelines currently employed in the medical setting making them more personalized and dynamic and assisting doctors in taking their everyday clinical decisions.

Bayesian Networks in the Management of Hospital Admissions: A Comparison between Explainable AI and Black Box AI during the Pandemic

Deployment of a Robust and Explainable Mortality Prediction Model: The COVID-19 Pandemic and Beyond

A historical perspective of biomedical explainable AI research

Decision Support Analysis for Risk Identification and Control of Patients Affected by COVID-19 Based on Bayesian Networks

Opening the Black Box of Neural Networks: Methods for Interpreting Neural Network Models in Clinical Applications

Using machine learning in prediction of ICU admission, mortality, and length of stay in the early stage of admission of COVID-19 patients

COVID-Net Clinical ICU: Enhanced Prediction of ICU Admission for COVID-19 Patients via Explainability and Trust Quantification

Uncovering hidden and complex relations of pandemic dynamics using an AI driven system

Bayesian Modelling in Practice: Using Uncertainty to Improve Trustworthiness in Medical Applications

A multivariate statistical approach to predict COVID‐19 count data with epidemiological interpretation and uncertainty quantification

An innovative artificial intelligence-based method to compress complex models into explainable, model-agnostic and reduced decision support systems with application to healthcare (NEAR)

Innovation through Artificial Intelligence in Triage Systems for Resource Optimization in Future Pandemics

An Explainable Decision Model Based on Extended Belief-Rule-based Systems to Predict Admission to the Intensive Care Unit During COVID-19 Breakout

The challenges of deploying artificial intelligence models in a rapidly evolving pandemic

Shedding Light on the Black Box: Explaining Deep Neural Network Prediction of Clinical Outcomes

Prediction of patient flow in the emergency department using explainable artificial intelligence

Predicting special care during the COVID-19 pandemic: A machine learning approach

Forecasting Patient Flows with Pandemic Induced Concept Drift using Explainable Machine Learning

Neural-Symbolic Ensemble Learning for early-stage prediction of critical state of Covid-19 patients

Explainable artificial intelligence in emergency medicine: an overview

Machine Learning First Response to COVID-19: A Systematic Literature Review of Clinical Decision Assistance Approaches during Pandemic Years from 2020 to 2022