Abstract:In recent times, time-to-event data such as time to failure or death is routinely collected alongside high-throughput covariates. These high-dimensional bioinformatics data often challenge classical survival models, which are either infeasible to fit or produce low prediction accuracy due to overfitting. To address this issue, the focus has shifted towards introducing a novel approaches for feature selection and survival prediction. In this article, we propose a new hybrid feature selection approach that handles high-dimensional bioinformatics datasets for improved survival prediction. This study explores the efficacy of four distinct variable selection techniques: LASSO, RSF-vs, SCAD, and CoxBoost, in the context of non-parametric biomedical survival prediction. Leveraging these methods, we conducted comprehensive variable selection processes. Subsequently, survival analysis models—specifically CoxPH, RSF, and DeepHit NN—were employed to construct predictive models based on the selected variables. Furthermore, we introduce a novel approach wherein only variables consistently selected by a majority of the aforementioned feature selection techniques are considered. This innovative strategy, referred to as the proposed method, aims to enhance the reliability and robustness of variable selection, subsequently improving the predictive performance of the survival analysis models. To evaluate the effectiveness of the proposed method, we compare the performance of the proposed approach with the existing LASSO, RSF-vs, SCAD, and CoxBoost techniques using various performance metrics including integrated brier score (IBS), concordance index (C-Index) and integrated absolute error (IAE) for numerous high-dimensional survival datasets. The real data applications reveal that the proposed method outperforms the competing methods in terms of survival prediction accuracy.

Assessing variable importance in survival analysis using machine learning

Unbiased Prediction and Feature Selection in High-Dimensional Survival Regression

Conditional screening for ultra-high dimensional covariates with survival outcomes

A Framework for Leveraging Machine Learning Tools to Estimate Personalized Survival Curves

EFFICIENT ESTIMATION OF THE MAXIMAL ASSOCIATION BETWEEN MULTIPLE PREDICTORS AND A SURVIVAL OUTCOME

Variable selection with missing data in both covariates and outcomes: Imputation and machine learning

Variable Screening for Survival Data in the Presence of Heterogeneous Censoring

Improved nonparametric survival prediction using CoxPH, Random Survival Forest & DeepHit Neural Network

Variable selection for competing risk regression models: recommendations for analyzing data from epidemiological studies

Inference on summaries of a model-agnostic longitudinal variable importance trajectory with application to suicide prevention

Comparison of methods for early-readmission prediction in a high-dimensional heterogeneous covariates and time-to-event outcome framework

Survival Prediction and Variable Selection with Simultaneous Shrinkage and Grouping Priors

A Computational Exploration of Emerging Methods of Variable Importance Estimation

A Flexible Approach for Predictive Biomarker Discovery

Super Learner for Survival Data Prediction

Estimating optimal treatment regimes in survival contexts using an instrumental variable

Independent screening for single-index hazard rate models with ultra-high dimensional features

High‐dimensional feature screening for nonlinear associations with survival outcome using restricted mean survival time

A tutorial on evaluating time-varying discrimination accuracy for survival models used in dynamic decision-making

Comparison of Parametric and Machine Methods for Variable Selection in Simulated Genetic Analysis Workshop 19 Data.

Identifying High-Dimensional Biomarkers for Personalized Medicine via Variable Importance Ranking