Abstract:Abstract Motivation Electronic health records (EHRs) represent a comprehensive resource of a patient’s medical history. EHRs are essential for utilizing advanced technologies such as deep learning (DL), enabling healthcare providers to analyze extensive data, extract valuable insights, and make precise and data-driven clinical decisions. DL methods such as recurrent neural networks (RNN) have been utilized to analyze EHR to model disease progression and predict diagnosis. However, these methods do not address some inherent irregularities in EHR data such as irregular time intervals between clinical visits. Furthermore, most DL models are not interpretable. In this study, we propose two interpretable DL architectures based on RNN, namely time-aware RNN (TA-RNN) and TA-RNN-autoencoder (TA-RNN-AE) to predict patient’s clinical outcome in EHR at the next visit and multiple visits ahead, respectively. To mitigate the impact of irregular time intervals, we propose incorporating time embedding of the elapsed times between visits. For interpretability, we propose employing a dual-level attention mechanism that operates between visits and features within each visit. Results The results of the experiments conducted on Alzheimer’s Disease Neuroimaging Initiative (ADNI) and National Alzheimer’s Coordinating Center (NACC) datasets indicated the superior performance of proposed models for predicting Alzheimer’s Disease (AD) compared to state-of-the-art and baseline approaches based on F2 and sensitivity. Additionally, TA-RNN showed superior performance on the Medical Information Mart for Intensive Care (MIMIC-III) dataset for mortality prediction. In our ablation study, we observed enhanced predictive performance by incorporating time embedding and attention mechanisms. Finally, investigating attention weights helped identify influential visits and features in predictions. Availability and implementation https://github.com/bozdaglab/TA-RNN.

Attention-Based Hierarchical Recurrent Neural Network for Phenotype Classification.

Extracting Dynamic Information of Temporal Clinical Data to Predict the Outcome in Critically Ill Patients.

HADLN: Hybrid Attention-Based Deep Learning Network for Automated Arrhythmia Classification

Interpretable Hierarchical Attention Network for Medical Condition Identification

Hierarchical Multi-Granularity Attention- Based Hybrid Neural Network for Text Classification.

Interpretable Clinical Prediction Via Attention-Based Neural Network.

Attention-based Multi-instance Neural Network for Medical Diagnosis from Incomplete and Low Quality Data

Modeling Long-term Dependencies and Short-term Correlations in Patient Journey Data with Temporal Attention Networks for Health Prediction

Hierarchical Multi-label Text Classification: An Attention-based Recurrent Network Approach

Interpretive Clinical Measurements Prediction and Diagnosis in ICU with Multi-Task Attention-Guided Sequential Feature Learning

Interpretable time-aware and co-occurrence-aware network for medical prediction

LA-HCN: Label-based Attention for Hierarchical Multi-label TextClassification Neural Network

Attend and Diagnose: Clinical Time Series Analysis using Attention Models

Temporal-spatial Correlation Attention Network for Clinical Data Analysis in Intensive Care Unit

TA-RNN: an attention-based time-aware recurrent neural network architecture for electronic health records

An interpretable outcome prediction model based on electronic health records and hierarchical attention

Simple Recurrent Neural Networks is all we need for clinical events predictions using EHR data

Sliding Hierarchical Recurrent Neural Networks for Sequence Classification

Context-aware and Time-aware Attention-based Model for Disease Risk Prediction with Interpretability

Feature Explanations in Recurrent Neural Networks for Predicting Risk of Mortality in Intensive Care Patients

Graph Neural Network Based Multi-Label Hierarchical Classification for Disease Predictions in General Practice.