Continuous patient state attention model for addressing irregularity in electronic health records

Vinod Kumar Chauhan,Anshul Thakur,Odhran O’Donoghue,Omid Rohanian,Soheila Molaei,David A. Clifton
DOI: https://doi.org/10.1186/s12911-024-02514-2
IF: 3.298
2024-05-06
BMC Medical Informatics and Decision Making
Abstract:Irregular time series (ITS) are common in healthcare as patient data is recorded in an electronic health record (EHR) system as per clinical guidelines/requirements but not for research and depends on a patient's health status. Due to irregularity, it is challenging to develop machine learning techniques to uncover vast intelligence hidden in EHR big data, without losing performance on downstream patient outcome prediction tasks.
medical informatics
What problem does this paper attempt to address?
This paper attempts to solve the following problems: 1. **Deal with the problem of irregular time series (ITS) in electronic health records (EHR)** The data in electronic health records are usually irregular because the time intervals of data recording are uneven and depend on the patient's health condition and clinical needs rather than research purposes. This irregularity makes it difficult for traditional machine - learning methods to be directly applied to EHR big data, and especially may lead to performance loss when predicting downstream patient outcomes (such as in - hospital mortality). 2. **Develop a model that can efficiently process long - sequence time data** Deep - learning models such as Transformer have high computational complexity when processing long - sequence data, which limits their application in the medical field. Therefore, the paper proposes a Perceiver model based on the cross - attention mechanism to reduce the computational cost and improve the ability to process long - sequence data. 3. **Capture patient health trajectories through continuous - state modeling** The paper proposes continuous patient - state attention models (COPER and CTransformer), which use neural ordinary differential equations (NODE) to learn patient health dynamics from irregular observation time steps, so that patient states can be sampled at any time point and regular time series can be generated for further processing. --- ### Core objectives of the paper - Propose a computationally efficient Perceiver model for processing long - sequence time data in EHR. - Develop continuous patient - state attention models (COPER and CTransformer) to solve the irregularity problem in EHR data. - Verify the performance of the proposed models in the in - hospital mortality prediction task and compare them with existing baseline methods. Through these methods, the paper aims to improve the utilization of EHR data, enhance the performance of downstream tasks (such as predicting patient outcomes), and at the same time increase the transparency and credibility of the models.