Abstract:Background and Objectives: Sepsis is one of the common causes of death in intensive care units. A reliable prognostic model based on patients' data acquired at the intensive care unit (ICU) would enable clinicians to make treatment decisions to improve clinical outcomes for septic patients. This study aims to develop a machine-learning framework for building such prognostic tools by exploring the class-imbalanced longitudinal data of a group of septic patients.Methods: A feature-represented input dataset is devised in the form of concatenated triples to increase the data size relative to the dimension of the feature space. Each concatenated triplet consists of a patient's static data, the k-day consecutively collected longitudinal data, and the clinical outcome (k=2,3,4,5). The structured input data are then used to train classifiers in combination with appropriate feature engineering techniques. The trained classifiers are tested on a new set of septic patients to ensure their clinical efficacy. We implement the modeling approach using five classifiers: K nearest neighbors, Logistic Regression, Support Vector Machine, Random Forest (RF), and Extreme Gradient Boosting (XGBoost) coupled with a set of feature engineering techniques. AUROC and a new metric, $\gamma$, made up of the F1 score on the external validation set, are used to assess the efficacy of the models.Results: Five prognostic models are built on the feature-represented input dataset accounting for 10 selected dynamic features from the patient medical data. Our research shows that the XGBoost (AUROC=0.777, F1 score=0.694) and RF (AUROC=0.769, F1 score=0.647) model combined with the ensemble under-sampling strategy outperform all other models in the external validation or testing. For example, the improvement in AUROC and overfitting are (6.66\%, 54.96\%) and (0.52\%, 77.72\%) for the RF and XGBoost model with the sampling strategy compared to the same models without using the sampling strategy, respectively. This indicates that the machine-learning framework can greatly improve the accuracy and generalizability of standard classifiers. Conclusion:A new modeling framework is devised to develop prognostic tools for treatment outcomes of septic patients using small, class-imbalanced, and high-dimensional datasets. It enables standard classifiers to use small datasets to achieve relatively high predictability by engineering new structured datasets encoded with temporal features, sampling strategies, and dimension reduction techniques, providing clinically useful prognostic models and setting an example for applying machine learning methods to small data problems in medicine.

New approaches to missing biomedical data recovery for machine learning

What is Hiding in Medicine's Dark Matter? Learning with Missing Data in Medical Practices

Extremely missing numerical data in Electronic Health Records for machine learning can be managed through simple imputation methods considering informative missingness: A comparative of solutions in a COVID-19 mortality case study

An analysis of missing data treatment methods and their application to health care dataset

Missing Values in Big Data Research: Some Basic Skills

Moving Beyond Medical Statistics: A Systematic Review on Missing Data Handling in Electronic Health Records

Applying Data Mining Algorithms to Inpatient Dataset with Missing Values

Machine Learning Models for Early Prediction of Sepsis on Large Healthcare Datasets

Predictive modeling of biomedical temporal data in healthcare applications: review and future directions

An Approach to Find Missing Values in Medical Datasets

Analysis of Missingness Scenarios for Observational Health Data

Machine-Learning-Enabled Prognostic Models for Sepsis

Investigating computational models for diagnosis and prognosis of sepsis based on clinical parameters: Opportunities, challenges, and future research directions

Leveraging Patient Similarity and Time Series Data in Healthcare Predictive Models

Prediction of Sepsis Mortality in ICU Patients Using Machine Learning Methods

Missing Values and Imputation in Healthcare Data: Can Interpretable Machine Learning Help?

Evaluating the state of the art in missing data imputation for clinical data

Implicit bias in Critical Care Data: Factors affecting sampling frequencies and missingness patterns of clinical and biological variables in ICU Patients

Dealing with Missing, Imbalanced, and Sparse Features During the Development of a Prediction Model for Sudden Death Using Emergency Medicine Data: Machine Learning Approach

Imputation of missing values for electronic health record laboratory data

Dealing with the Missing, Imbalanced and Sparse Features Problems in Emergency Data Using Random Forest, K-means and PCA Respectively (Preprint)