Abstract:BACKGROUND:Personalized medicine requires the patient similarity analysis for providing specific treatments tailed for each patient. However, the patient similarity analysis in personalized clinical scenarios encounters challenges, which are twofold. First, heterogeneous and multi-type data are usually recorded to Electronic Health Records (EHRs) during the course of admissions, which makes it difficult to measure the patient similarity. Second, disease progression manifests diverse disease states at different times, which brings sequential complexity to dynamically retrieve similar patients' sequences.MATERIALS AND METHODS:To overcome the above-mentioned challenges, we propose a novel dynamic patient similarity analysis model based on deep learning. Specifically, the proposed model embeds the multi-type and heterogeneous data into hidden representations with a specially designed embedding and attention module. Thereafter, the proposed model retrieves similar patients' sequences based on these hidden representations in a dynamic manner. More importantly, we adopt two clinical tasks, i.e., diagnosis prediction and medication recommendation, to validate the effectiveness of the proposed model. It is worth noticing that the proposed model integrates a drug-drug interaction (DDI) knowledge graph in the medication recommendation task to reduce adverse reactions caused by combinational treatments, such that a more rational strategy can be realized. We evaluate our proposed model using the critical care database MIMIC-III, which includes 5,430 patients covering 14,096 clinical visits.RESULTS:The proposed model outperforms several state-of-the-art methods. For diagnosis prediction, the average PR-AUC score of the proposed model reaches 0.6200, which is significantly higher than that of the baseline models (0.2497∼0.5407). Meanwhile, for medication recommendation, the average PR-AUC of the proposed model is 0.6682 (Jaccard: 0.4070; F1: 0.5672; Recall: 0.7832) whereas the K-nearest model can only reach 0.3805 (Jaccard: 0.3911; F1: 0.5465; Recall: 0.5705). In addition, our proposed model achieves a lower DDI rate.CONCLUSION:We propose a novel dynamic patient similarity analysis model, which can be implemented into a decision support system for clinical tasks including diagnosis prediction, surgical procedure selection, medication recommendation, etc. Also, the proposed model serves as an explainable protocol in clinical practice thanks to its analogy to real clinical reasoning where a doctor diagnoses diseases and prescribes medications according to the previous cured patients empirically.

A Latent Batch-Constrained Deep Reinforcement Learning Approach for Precision Dosing Clinical Decision Support

Development and Validation of Heparin Dosing Policies Using an Offline Reinforcement Learning Algorithm

Model Based Reinforcement Learning for Personalized Heparin Dosing

A Goal-Oriented Reinforcement Learning for Optimal Drug Dosage Control

Deep Dynamic Patient Similarity Analysis: Model Development and Validation in ICU.

Model-Informed Reinforcement Learning for Enabling Precision Dosing Via Adaptive Dosing

On the Challenges of using Reinforcement Learning in Precision Drug Dosing: Delay and Prolongedness of Action Effects

Reinforcement Learning in Clinical Medicine: a Method to Optimize Dynamic Treatment Regime over Time.

Optimal Treatment Strategies for Critical Patients with Deep Reinforcement Learning

OMG-RL:Offline Model-based Guided Reward Learning for Heparin Treatment

Reinforcement learning and Bayesian data assimilation for model-informed precision dosing in oncology

Dynamic Programming for Solving a Simulated Clinical Scenario of Sepsis Resuscitation

Model‐Informed Artificial Intelligence: Reinforcement Learning for Precision Dosing

An Explainable Deep Reinforcement Learning Model for Warfarin Maintenance Dosing Using Policy Distillation and Action Forging

Towards Real-World Applications of Personalized Anesthesia Using Policy Constraint Q Learning for Propofol Infusion Control

Inverse reinforcement learning for intelligent mechanical ventilation and sedative dosing in intensive care units

Applying Machine Learning for Prescriptive Support: A Use Case with Unfractionated Heparin in Intensive Care Units

Personalized Dose Guidance using Safe Bayesian Optimization

Predicting the Need for Blood Transfusion in Intensive Care Units with Reinforcement Learning

DTR-Bench: An in silico Environment and Benchmark Platform for Reinforcement Learning Based Dynamic Treatment Regime

Pruning the Way to Reliable Policies: A Multi-Objective Deep Q-Learning Approach to Critical Care