Abstract:Motivation: Sparse survival models are statistical models that select a subset of predictor variables while modeling the time until an event occurs, which can subsequently help interpretability and transportability. The subset of important features is often obtained with regularized models, such as the Cox Proportional Hazards model with Lasso regularization, which limit the number of non-zero coefficients. However, such models can be sensitive to the choice of regularization hyperparameter. Results: In this work, we develop a software package and demonstrate how knowledge distillation, a powerful technique in machine learning that aims to transfer knowledge from a complex teacher model to a simpler student model, can be leveraged to learn sparse survival models while mitigating this challenge. For this purpose, we present sparsesurv, a Python package that contains a set of teacher-student model pairs, including the semi-parametric accelerated failure time and the extended hazards models as teachers, which currently do not have Python implementations. It also contains in-house survival function estimators, removing the need for external packages. Sparsesurv is validated against R-based Elastic Net regularized linear Cox proportional hazards models as implemented in the commonly used glmnet package. Our results reveal that knowledge distillation-based approaches achieve competitive discriminative performance relative to glmnet across the regularization path while making the choice of the regularization hyperparameter significantly easier. All of these features, combined with an sklearn-like API, make sparsesurv an easy-to-use Python package that enables survival analysis for high-dimensional datasets through fitting sparse survival models via knowledge distillation. Availability: sparsesurv is freely available under a BSD 3 license on GitHub (https://github.com/BoevaLab/sparsesurv) and The Python Package Index (PyPi) (https://pypi.org/project/sparsesurv/). Supplementary information: Supplementary data are available at Bioinformatics online.

BoXHED2.0: Scalable boosting of dynamic survival analysis

SurvBoost: An R Package for High-Dimensional Variable Selection in the Stratified Proportional Hazards Model via Gradient Boosting

BOOSTED NONPARAMETRIC HAZARDS WITH TIME-DEPENDENT COVARIATES

Multi-stage optimal dynamic treatment regimes for survival outcomes with dependent censoring

Survival regression with accelerated failure time model in XGBoost

FPBoost: Fully Parametric Gradient Boosting for Survival Analysis

Parmsurv: a SAS Macro for Flexible Parametric Survival Analysis with Long-Term Predictions

A scalable and flexible Cox proportional hazards model for high-dimensional survival prediction and functional selection

Unbiased Prediction and Feature Selection in High-Dimensional Survival Regression

An empirical comparison between gradient boosting methods and cox's proportional hazards model for right-censored survival data

BigSurvSGD: Big Survival Data Analysis via Stochastic Gradient Descent

An online framework for survival analysis: reframing Cox proportional hazards model for large data sets and neural networks

Survival Models: Proper Scoring Rule and Stochastic Optimization with Competing Risks

Dynamic Treatment Regimes Using Bayesian Additive Regression Trees for Censored Outcomes

Minorization-Maximization-based Steepest Ascent for Large-scale Survival Analysis with Time-Varying Effects: Application to the National Kidney Transplant Dataset

FastSurvival: Hidden Computational Blessings in Training Cox Proportional Hazards Models

A copula-based boosting model for time-to-event prediction with dependent censoring

sparsesurv: A Python package for fitting sparse survival models via knowledge distillation

Penalized semiparametric Cox regression model on XGBoost and random survival forests

HACSurv: A Hierarchical Copula-based Approach for Survival Analysis with Dependent Competing Risks

pencal: an R Package for the Dynamic Prediction of Survival with Many Longitudinal Predictors