Abstract:Ordinal learning (OL) is a type of machine learning models with broad utility in health care applications such as diagnosis of different grades of a disease (e.g., mild, modest, severe) and prediction of the speed of disease progression (e.g., very fast, fast, moderate, slow). This paper aims to tackle a situation when precisely labeled samples are limited in the training set due to cost or availability constraints, whereas there could be an abundance of samples with imprecise labels. We focus on imprecise labels that are intervals, i.e., one can know that the a sample belongs to an interval of labels but cannot know which unique label it has. This situation is quite common in health care datasets due to limitations of the diagnostic instrument, sparse clinical visits, or/and patient dropout. Limited research has been done to develop OL models with imprecise/interval labels. We propose a new Hybrid Ordinal Learner (HOL) to integrate samples with both precise and interval labels to train a robust OL model. We also develop a tractable and efficient optimization algorithm to solve the HOL formulation. We compare HOL with several recently developed OL methods on four benchmarking datasets, which demonstrate the superior performance of HOL. Finally, we apply HOL to a real-world dataset for predicting the speed of progressing to Alzheimer’s Disease (AD) for individuals with Mild Cognitive Impairment (MCI) based on a combination of multi-modality neuroimaging and demographic/clinical datasets. HOL achieves high accuracy in the prediction and outperforms existing methods. The capability of accurately predicting the speed of progression to AD for each individual with MCI has the potential for helping facilitate more individually-optimized interventional strategies. Note to Practitioners—Machine learning (ML) algorithms have been widely adopted to support disease diagnosis and prognosis. In some situations, the outcome variable of interest is on an ordinal scale, i.e., it includes several classes with a natural order. For example, the variable of interest can be the grade of a disease as mild, moderate, or severe; or it can be the progression speed of a disease as very fast, fast, moderate, or slow. Ordinal learning (OL) is the type of ML algorithms for ordinal variable prediction. Most existing OL algorithms can only include samples with precise labels in training. However, it is common to have samples with imprecise/interval labels, i.e., we know that a sample belongs to a range of classes/labels but do not know which specific class/label it belongs to. This situation can happen due to a variety of different reasons such as use of less accurate diagnostic instrument under cost or availability constraints, sparse clinical assessment, and patient dropout. We propose a Hybrid Ordinal Learner (HOL) to integrate samples with both precise and interval labels to train a robust OL model. HOL is evaluated using four public benchmarking datasets and shows superior performance compared to existing methods. Also, we apply HOL to a real-world dataset for predicting the speed of progressing to Alzheimer’s Disease (AD) for individuals with Mild Cognitive Impairment (MCI). MCI is the prodromal stage of AD. Individuals with MCI show noticeable signs of memory loss and cognitive declines, but these symptoms are not severe enough to interfere their independent living. HOL achieves high accuracy in predicting the speed of progressing to AD for each MCI subject (e.g., the speed of ‘very fast’‘, fast’‘, moderate’, or ‘slow), which could potentially help facilitate the development of more individually-optimized interventional strategies.

Deep Ordinal Neural Network for Length of Stay Estimation in the Intensive Care Units.

Length of Stay Prediction for Clinical Treatment Process Using Temporal Similarity

Length of Stay Prediction With Standardized Hospital Data From Acute and Emergency Care Using a Deep Neural Network

Multi-modal learning for inpatient length of stay prediction

Semi-supervised Optimal Transport with Self-paced Ensemble for Cross-hospital Sepsis Early Detection.

Predicting Length of Stay Ranges by Using Novel Deep Neural Networks

Prediction of Length of Stay on the Intensive Care Unit Based on Bayesian Neural Network

Predicting the Stay Length of Patients in Hospitals using Convolutional Gated Recurrent Deep Learning Model

A Novel Hybrid Ordinal Learning Model With Health Care Application

Network analytics and machine learning for predicting length of stay in elderly patients with chronic diseases at point of admission

Enhancing Length of Stay Prediction by Learning Similarity-Aware Representations for Hospitalized Patients.

Distributed Learning from Multi-Site Observational Health Data for Zero-Inflated Count Outcomes

Length of stay prediction for hospital management using domain adaptation

A PSO-based Deep Learning Approach to Classifying Patients from Emergency Departments

Machine learning-based prediction of length of stay (LoS) in the neonatal intensive care unit using ensemble methods

Beyond the Bedside: Machine Learning-Guided Length of Stay (LOS) Prediction for Cardiac Patients in Tertiary Care

An Ordinal Regression Framework for a Deep Learning Based Severity Assessment for Chest Radiographs

Interpretable Deep Learning System for Identifying Critical Patients Through the Prediction of Triage Level, Hospitalization, and Length of Stay: Prospective Study

Predicting Length of Stay in ICU and Mortality with Temporal Dilated Separable Convolution and Context-Aware Feature Fusion.

Stabilized Sparse Ordinal Regression for Medical Risk Stratification