TransformerLSR: Attentive Joint Model of Longitudinal Data, Survival, and Recurrent Events with Concurrent Latent Structure

Zhiyue Zhang,Yao Zhao,Yanxun Xu

2024-04-05

Abstract:In applications such as biomedical studies, epidemiology, and social sciences, recurrent events often co-occur with longitudinal measurements and a terminal event, such as death. Therefore, jointly modeling longitudinal measurements, recurrent events, and survival data while accounting for their dependencies is critical. While joint models for the three components exist in statistical literature, many of these approaches are limited by heavy parametric assumptions and scalability issues. Recently, incorporating deep learning techniques into joint modeling has shown promising results. However, current methods only address joint modeling of longitudinal measurements at regularly-spaced observation times and survival events, neglecting recurrent events. In this paper, we develop TransformerLSR, a flexible transformer-based deep modeling and inference framework to jointly model all three components simultaneously. TransformerLSR integrates deep temporal point processes into the joint modeling framework, treating recurrent and terminal events as two competing processes dependent on past longitudinal measurements and recurrent event times. Additionally, TransformerLSR introduces a novel trajectory representation and model architecture to potentially incorporate a priori knowledge of known latent structures among concurrent longitudinal variables. We demonstrate the effectiveness and necessity of TransformerLSR through simulation studies and analyzing a real-world medical dataset on patients after kidney transplantation.

Machine Learning,Applications,Methodology

What problem does this paper attempt to address?

This paper proposes a new approach called TransformerLSR for simultaneously modeling longitudinal data, recurrent events, and survival data, with a particular focus on the dependencies between these components. In domains such as biomedical research, epidemiology, and social sciences, recurrent events often occur with long-term measurements and an eventual event such as death. Existing statistical methods have strong parametric assumptions and scalability issues when modeling these three types of data jointly. TransformerLSR leverages deep learning techniques, specifically the Transformer architecture, to integrate deep temporal point processes into a joint modeling framework, treating recurrent events and the eventual event as two competing processes dependent on past long-term measurements and recurrent event times. Additionally, TransformerLSR introduces a new trajectory representation and model architecture to potentially incorporate latent structures of known concurrent long-term variables. Through simulation studies and analysis of real kidney transplant medical datasets, the paper demonstrates the effectiveness and necessity of TransformerLSR, highlighting its advantages in handling complex and unstructured data.