Abstract:Deep learning methods have achieved success in disease prediction using electronic health records (EHR) data. Most of the existing methods have some limitations. First, most of the methods adopt a homogeneous decay way to deal with the effect of time interval on patient's previous visits information. However, the effect of the time interval between patient's visits is not always negative. For example, although the time interval between visits for patients with chronic diseases is relatively long, the importance of the previous visit to the next visit is high, and we may not be able to consider the effect of the time interval as negative at this point. That is, the effect of the time interval on previous visits is exerted in a nonmonotonic manner, and it is either positive, negative, or neutral. In addition, the effect of text information on prediction results is not taken into account in most of methods. The text in EHR contains a description of the patient's past medical history and current symptoms of the disease, which is important for prediction results. In order to solve these issues, we propose a Time Interval Uncertainty-Aware and Text-Enhanced Based Disease Prediction Model, which utilizes the uncertain effects of time intervals and patient's text information for disease prediction. Firstly, we apply a cross-attention mechanism to generate a global representation of the patient using the patient's disease and text information from the EHR. Then, we use the key-query attention mechanism to obtain the two importance weights of the two visit sequences with and without time intervals, respectively. Furthermore, we achieve disease prediction by making slight adjustments to the encode part of the Transformer, a deep learning model based on a self-attention mechanism. We compare with various state-of-the-art models on two publicly available datasets, MIMIC-III and MIMIC-IV, and select the top 10 diseases with the highest frequency in the dataset as the target diseases. On the MIMIC-III dataset, our model is up to three percent higher than the optimal baseline in terms of evaluation metrics.

Disease Prediction Model Based on BiLSTM and Attention Mechanism

A Method for the Early Prediction of Chronic Diseases Based on Short Sequential Medical Data.

Time interval uncertainty-aware and text-enhanced based disease prediction

Context-aware and Time-aware Attention-based Model for Disease Risk Prediction with Interpretability

Disease prediction based on multi-type data fusion from Chinese electronic health record.

Deep Cardiovascular Disease Prediction with Risk Factors Powered Bi-Attention

Deep Cardiovascular Disease Prediction with Risk Factors Powered Bi-attention.

Modeling Long-term Dependencies and Short-term Correlations in Patient Journey Data with Temporal Attention Networks for Health Prediction

Label Dependent Attention Model for Disease Risk Prediction Using Multimodal Electronic Health Records

A Knowledge-Guided Method for Disease Prediction Based on Attention Mechanism

Multi-disease prediction using LSTM recurrent neural networks

Optimizing Disease Prediction with Artificial Intelligence Driven Feature Selection and Attention Networks

Research on Disease Prediction Method Based on R-Lookahead-LSTM

A Hybrid Neural Network Model for Predicting Kidney Disease in Hypertension Patients Based on Electronic Health Records

An Interpretable Disease Onset Predictive Model Using Crossover Attention Mechanism from Electronic Health Records.

Health-LLM: Personalized Retrieval-Augmented Disease Prediction Model

A Novel Hybrid CNN-BiLSTM-Attention Model for Diabetes Prediction

Hospitalization Behavior Prediction Based on Attention and Time Adjustment Factors in Bidirectional LSTM

Deep EHR: Chronic Disease Prediction Using Medical Notes

Predictive Multi-level Patient Representations from Electronic Health Records

Enhancing Personalized Healthcare via Capturing Disease Severity, Interaction, and Progression