Hierarchical Encoder-Decoder with Addressable Memory Network for Diagnosis Prediction

Mingxia Wang,Yun Xiong,Yao Zhang,Philip S. Yu,Yangyong Zhu
DOI: https://doi.org/10.1007/978-3-031-30678-5_20
2023-01-01
Abstract:Deep learning methods have demonstrated success in diagnosis prediction on Electronic Health Records (EHRs). Early attempts utilize sequential models to encode patient historical records, but they lack the ability to identify critical diseases for patient health conditions. Besides, some works focus on the hierarchical structure of EHR data during learning patient representations, but neglect it in diagnosis prediction process, which leads to insufficient utilization of hierarchical information. To tackle these challenges, we propose a new Hierarchical Encoder-Decoder with Addressable Memory Network for Diagnosis Prediction named HAMNet. Specifically, we employ a hierarchical encoder-decoder framework to utilize the hierarchical structure of historical visits both during representation learning and diagnosis prediction. Furthermore, we propose the addressable memory network to distinguish core diseases towards patient health status at next visit through the well-designed addressing mechanism. It employs feed-forward layers to build the memory network, which can automatically update the memory module through gradient backpropagation without explicit read/write operations. Finally, we evaluate the performance of HAMNet on a large real-world EHR dataset MIMIC-III, and it achieves the state-of-the-art performance compared with baselines.
What problem does this paper attempt to address?