Abstract:Abstract Motivation Electronic health records (EHRs) represent a comprehensive resource of a patient’s medical history. EHRs are essential for utilizing advanced technologies such as deep learning (DL), enabling healthcare providers to analyze extensive data, extract valuable insights, and make precise and data-driven clinical decisions. DL methods such as recurrent neural networks (RNN) have been utilized to analyze EHR to model disease progression and predict diagnosis. However, these methods do not address some inherent irregularities in EHR data such as irregular time intervals between clinical visits. Furthermore, most DL models are not interpretable. In this study, we propose two interpretable DL architectures based on RNN, namely time-aware RNN (TA-RNN) and TA-RNN-autoencoder (TA-RNN-AE) to predict patient’s clinical outcome in EHR at the next visit and multiple visits ahead, respectively. To mitigate the impact of irregular time intervals, we propose incorporating time embedding of the elapsed times between visits. For interpretability, we propose employing a dual-level attention mechanism that operates between visits and features within each visit. Results The results of the experiments conducted on Alzheimer’s Disease Neuroimaging Initiative (ADNI) and National Alzheimer’s Coordinating Center (NACC) datasets indicated the superior performance of proposed models for predicting Alzheimer’s Disease (AD) compared to state-of-the-art and baseline approaches based on F2 and sensitivity. Additionally, TA-RNN showed superior performance on the Medical Information Mart for Intensive Care (MIMIC-III) dataset for mortality prediction. In our ablation study, we observed enhanced predictive performance by incorporating time embedding and attention mechanisms. Finally, investigating attention weights helped identify influential visits and features in predictions. Availability and implementation https://github.com/bozdaglab/TA-RNN.

TA-RNN: an Attention-based Time-aware Recurrent Neural Network Architecture for Electronic Health Records

TA-RNN: an attention-based time-aware recurrent neural network architecture for electronic health records

RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanism

Interpretable Representation Learning for Healthcare via Capturing Disease Progression through Time

Interpretable time-aware and co-occurrence-aware network for medical prediction

Modeling Long-term Dependencies and Short-term Correlations in Patient Journey Data with Temporal Attention Networks for Health Prediction

Temporal Cross-Attention for Dynamic Embedding and Tokenization of Multimodal Electronic Health Records

Predictive Modeling of the Progression of Alzheimer’s Disease with Recurrent Neural Networks

Simple Recurrent Neural Networks is all we need for clinical events predictions using EHR data

Context-aware and Time-aware Attention-based Model for Disease Risk Prediction with Interpretability

Adaptive Prediction Timing for Electronic Health Records

Associative attention networks for temporal relation extraction from electronic health records

Time Series Prediction Using Deep Learning Methods in Healthcare

Attend and Diagnose: Clinical Time Series Analysis using Attention Models

BEHRT: Transformer for Electronic Health Records

Predictive Modeling with Temporal Graphical Representation on Electronic Health Records

RetainVis: Visual Analytics with Interpretable and Interactive Recurrent Neural Networks on Electronic Medical Records

CARRNN: A Continuous Autoregressive Recurrent Neural Network for Deep Representation Learning from Sporadic Temporal Data

Time-Guided High-Order Attention Model of Longitudinal Heterogeneous Healthcare Data

Deep Diabetologist: Learning to Prescribe Hyperglycemia Medications with Hierarchical Recurrent Neural Networks

DNA-T: Deformable Neighborhood Attention Transformer for Irregular Medical Time Series