The leap to ordinal: detailed functional prognosis after traumatic brain injury with a flexible modelling approach

Shubhayu Bhattacharyay,Ioan Milosevic,Lindsay Wilson,David K. Menon,Robert D. Stevens,Ewout W. Steyerberg,David W. Nelson,Ari Ercole,CENTER-TBI investigators/participants

DOI: https://doi.org/10.1371/journal.pone.0270973

2022-05-04

Abstract:When a patient is admitted to the intensive care unit (ICU) after a traumatic brain injury (TBI), an early prognosis is essential for baseline risk adjustment and shared decision making. TBI outcomes are commonly categorised by the Glasgow Outcome Scale-Extended (GOSE) into 8, ordered levels of functional recovery at 6 months after injury. Existing ICU prognostic models predict binary outcomes at a certain threshold of GOSE (e.g., prediction of survival [GOSE>1] or functional independence [GOSE>4]). We aimed to develop ordinal prediction models that concurrently predict probabilities of each GOSE score. From a prospective cohort (n=1,550, 65 centres) in the ICU stratum of the Collaborative European NeuroTrauma Effectiveness Research in TBI (CENTER-TBI) patient dataset, we extracted all clinical information within 24 hours of ICU admission (1,151 predictors) and 6-month GOSE scores. We analysed the effect of 2 design elements on ordinal model performance: (1) the baseline predictor set, ranging from a concise set of 10 validated predictors to a token-embedded representation of all possible predictors, and (2) the modelling strategy, from ordinal logistic regression to multinomial deep learning. With repeated k-fold cross-validation, we found that expanding the baseline predictor set significantly improved ordinal prediction performance while increasing analytical complexity did not. Half of these gains could be achieved with the addition of 8 high-impact predictors (2 demographic variables, 4 protein biomarkers, and 2 severity assessments) to the concise set. At best, ordinal models achieved 0.76 (95% CI: 0.74-0.77) ordinal discrimination ability (ordinal c-index) and 57% (95% CI: 54%-60%) explanation of ordinal variation in 6-month GOSE (Somers' D). Our results motivate the search for informative predictors for higher GOSE and the development of ordinal dynamic prediction models.

Machine Learning

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the accurate prediction of early functional prognosis in patients with traumatic brain injury (TBI) in the intensive care unit (ICU). Specifically, the existing ICU prognosis models can usually only predict binary outcomes (such as survival or death), and these models use a fixed threshold of the Glasgow Outcome Scale - Extended (GOSE) to define "favorable" or "unfavorable" outcomes. However, this method ignores the subtle differences between different recovery levels defined by GOSE and limits the richness of prognostic information provided in the shared treatment - decision - making process. For example, when deciding whether to withdraw life - support measures (WLSM), understanding the probabilities of different functional recovery levels, rather than just the survival probability, can provide better considerations for quality of life and decision - making confidence.

Therefore, the goal of the paper is to develop an ordinal prediction model that can simultaneously predict the probability of each GOSE score, thereby providing more detailed prognostic information. Through this method, the model can not only predict the survival rate of patients but also predict their probabilities at different functional recovery levels, providing more comprehensive support for clinical decision - making. In addition, the paper also explores the impact of different design elements (such as the selection of baseline predictor sets and modeling strategies) on the performance of the ordinal model, aiming to improve the accuracy and practicality of the model.