Abstract:BACKGROUND AND OBJECTIVE: Risk stratification aims to provide physicians with the accurate assessment of a patient's clinical risk such that an individualized prevention or management strategy can be developed and delivered. Existing risk stratification techniques mainly focus on predicting the overall risk of an individual patient in a supervised manner, and, at the cohort level, often offer little insight beyond a flat score-based segmentation from the labeled clinical dataset. To this end, in this paper, we propose a new approach for risk stratification by exploring a large volume of electronic health records (EHRs) in an unsupervised fashion.METHODS: Along this line, this paper proposes a novel probabilistic topic modeling framework called probabilistic risk stratification model (PRSM) based on Latent Dirichlet Allocation (LDA). The proposed PRSM recognizes a patient clinical state as a probabilistic combination of latent sub-profiles, and generates sub-profile-specific risk tiers of patients from their EHRs in a fully unsupervised fashion. The achieved stratification results can be easily recognized as high-, medium- and low-risk, respectively. In addition, we present an extension of PRSM, called weakly supervised PRSM (WS-PRSM) by incorporating minimum prior information into the model, in order to improve the risk stratification accuracy, and to make our models highly portable to risk stratification tasks of various diseases.RESULTS: We verify the effectiveness of the proposed approach on a clinical dataset containing 3463 coronary heart disease (CHD) patient instances. Both PRSM and WS-PRSM were compared with two established supervised risk stratification algorithms, i.e., logistic regression and support vector machine, and showed the effectiveness of our models in risk stratification of CHD in terms of the Area Under the receiver operating characteristic Curve (AUC) analysis. As well, in comparison with PRSM, WS-PRSM has over 2% performance gain, on the experimental dataset, demonstrating that incorporating risk scoring knowledge as prior information can improve the performance in risk stratification.CONCLUSIONS: Experimental results reveal that our models achieve competitive performance in risk stratification in comparison with existing supervised approaches. In addition, the unsupervised nature of our models makes them highly portable to the risk stratification tasks of various diseases. Moreover, patient sub-profiles and sub-profile-specific risk tiers generated by our models are coherent and informative, and provide significant potential to be explored for the further tasks, such as patient cohort analysis. We hypothesize that the proposed framework can readily meet the demand for risk stratification from a large volume of EHRs in an open-ended fashion.

Stabilized Sparse Ordinal Regression for Medical Risk Stratification

Distributed Learning from Multi-Site Observational Health Data for Zero-Inflated Count Outcomes

A probabilistic topic model for clinical risk stratification from electronic health records

Sparse ordinal discriminant analysis

Clinical Risk Prediction With Multilinear Sparse Logistic Regression

Development of scoring system for risk stratification in clinical medicine: a step-by-step tutorial.

An evaluation of randomized machine learning methods for redundant data: Predicting short and medium-term suicide risk from administrative records and risk assessments

Hospital Readmission Prediction - Applying Hierarchical Sparsity Norms for Interpretable Models

A Novel Data-Driven Framework for Risk Characterization and Prediction from Electronic Medical Records: A Case Study of Renal Failure

Regularizing the Deepsurv Network Using Projection Loss for Medical Risk Assessment

A Novel Two-stage Deming Regression Framework with Applications to Association Analysis between Clinical Risks

Small samples-oriented intrinsically explainable machine learning using Variational Bayesian Logistic Regression: An intensive care unit readmission prediction case for liver transplantation patients

StratMed: Relevance stratification between biomedical entities for sparsity on medication recommendation

Tree-Guided Rare Feature Selection and Logic Aggregation with Electronic Health Records Data

Risk Stratification with Extreme Learning Machine: A Retrospective Study on Emergency Department Patients

Ordinal Regression With Sparse Bayesian

Improving Trustworthiness of AI Disease Severity Rating in Medical Imaging with Ordinal Conformal Prediction Sets

Ordinal Multi-modal Feature Selection for Survival Analysis of Early-Stage Renal Cancer

A Deep Clustering-Based State-Space Model for Improved Disease Risk Prediction in Personalized Healthcare

TransLSTD: Augmenting hierarchical disease risk prediction model with time and context awareness via disease clustering

High-dimensional Feature Selection in Competing Risks Modeling: A Stable Approach Using a Split-and-merge Ensemble Algorithm