Abstract:Ischemic heart disease is a leading cause of death worldwide, and its importance is increasing with the aging population. The aim of this study was to evaluate the accuracy of SurvTrace, a survival analysis model using the Transformer—a state-of-the-art deep learning method—for predicting recurrent cardiovascular events and stratifying high-risk patients. The model's performance was compared to that of a conventional scoring system utilizing real-world data from cardiovascular patients. This study consecutively enrolled patients who underwent percutaneous coronary intervention (PCI) at the Department of Cardiovascular Medicine, University of Tokyo Hospital, between 2005 and 2019. Each patient's initial PCI at our hospital was designated as the index procedure, and a composite of major adverse cardiovascular events (MACE) was monitored for up to two years post-index event. Data regarding patient background, clinical presentation, medical history, medications, and perioperative complications were collected to predict MACE. The performance of two models—a conventional scoring system proposed by Wilson et al. and the Transformer-based model SurvTrace—was evaluated using Harrell's c-index, Kaplan–Meier curves, and log-rank tests. A total of 3938 cases were included in the study, with 394 used as the test dataset and the remaining 3544 used for model training. SurvTrace exhibited a mean c-index of 0.72 (95% confidence intervals (CI): 0.69–0.76), which indicated higher prognostic accuracy compared with the conventional scoring system's 0.64 (95% CI: 0.64–0.64). Moreover, SurvTrace demonstrated superior risk stratification ability, effectively distinguishing between the high-risk group and other risk categories in terms of event occurrence. In contrast, the conventional system only showed a significant difference between the low-risk and high-risk groups. This study based on real-world cardiovascular patient data underscores the potential of the Transformer-based survival analysis model, SurvTrace, for predicting recurrent cardiovascular events and stratifying high-risk patients.

A transformer model for cause-specific hazard prediction

Hidformer: Hierarchical Dual-Tower Transformer Using Multi-Scale Mergence for Long-Term Time Series Forecasting

Enhancing Time Series Forecasting: A Hierarchical Transformer with Probabilistic Decomposition Representation

Adaptive Transformer Modelling of Density Function for Nonparametric Survival Analysis

A Kernel Attention-based Transformer Model for Survival Prediction of Heart Disease Patients

Transformers for cardiac patient mortality risk prediction from heterogeneous electronic health records

Dynamic Survival Transformers for Causal Inference with Electronic Health Records

SeqRisk: Transformer-augmented latent variable model for improved survival prediction with longitudinal data

G-Transformer: Counterfactual Outcome Prediction under Dynamic and Time-varying Treatment Regimes

Hi-BEHRT: Hierarchical Transformer-based model for accurate prediction of clinical events using multimodal longitudinal electronic health records

TransformerLSR: Attentive Joint Model of Longitudinal Data, Survival, and Recurrent Events with Concurrent Latent Structure

A Transformer Heavy Overload Spatiotemporal Distribution Prediction Ensemble under Imbalanced and Nonlinear Data Scenarios

Clinically-Inspired Multi-Agent Transformers for Disease Trajectory Forecasting from Multimodal Data

An explainable Transformer-based deep learning model for the prediction of incident heart failure

The potential of the transformer-based survival analysis model, SurvTrace, for predicting recurrent cardiovascular events and stratifying high-risk patients with ischemic heart disease

Optimizing Acute Coronary Syndrome Patient Treatment: Leveraging Gated Transformer Models for Precise Risk Prediction and Management

Predicting Deterioration in Mild Cognitive Impairment with Survival Transformers, Extreme Gradient Boosting and Cox Proportional Hazard Modelling

Time-series forecasting of mortality rates using transformer

Dual-Transformer: A General Model for Traffic Accident Prediction

Causal-Transformer: Spatial-temporal Causal Attention-Based Transformer for Time Series Prediction

Time-aware Heterogeneous Graph Transformer with Adaptive Attention Merging for Health Event Prediction