Trend Analysis Neural Networks for Interpretable Analysis of Longitudinal Data

Zhenjie Yao,Yixin Chen,Jinwei Wang,Shouling Wu,Yanhui Tu,Minghui Zhao,Luxia Zhang
DOI: https://doi.org/10.1109/bigdata52589.2021.9671590
2024-01-01
ACM Transactions on Computing for Healthcare
Abstract:Cohort study is one of the most commonly used study methods in medical and public health researches, which result in longitudinal data. Conventional statistical models and machine learning methods are not capable of modeling the evolution trend of the variables in longitudinal data. In this paper, we propose a Trend Analysis Neural Networks (TANN), which models the evolution trend of the variables by adaptive feature learning. TANN was tested on dataset of Kaiuan research. The task was to predict occurrence of death within 5 years, with 3 repeated medical examinations from 2008 to 2013. The AUC of the TANN is 0.7888, which is a slightly improvement than that of conventional methods, while that of GBDT is 0.7824, that of random forests is 0.7822, and that of logistic regression is 0.7789. The experimental results show that the proposed TANN achieves better prediction performance on death events prediction than conventional models. Furthermore, by analyzing the weights of TANN, we could find out important trends of the indicators. The trend discovery mechanism interprets the model well. TANN is an appropriate trade-off between high performance and interpretability.
What problem does this paper attempt to address?