EHR-Based Mobile and Web Platform for Chronic Disease Risk Prediction Using Large Language Multimodal Models

Chun-Chieh Liao,Wei-Ting Kuo,I-Hsuan Hu,Yen-Chen Shih,Jun-En Ding,Feng Liu,Fang-Ming Hung
2024-06-26
Abstract:Traditional diagnosis of chronic diseases involves in-person consultations with physicians to identify the disease. However, there is a lack of research focused on predicting and developing application systems using clinical notes and blood test values. We collected five years of Electronic Health Records (EHRs) from Taiwan's hospital database between 2017 and 2021 as an AI database. Furthermore, we developed an EHR-based chronic disease prediction platform utilizing Large Language Multimodal Models (LLMMs), successfully integrating with frontend web and mobile applications for prediction. This prediction platform can also connect to the hospital's backend database, providing physicians with real-time risk assessment diagnostics. The demonstration link can be found at <a class="link-external link-https" href="https://www.youtube.com/watch?v=oqmL9DEDFgA" rel="external noopener nofollow">this https URL</a>.
Software Engineering,Artificial Intelligence,Computation and Language
What problem does this paper attempt to address?
The paper aims to address the issues of chronic disease prediction and application system development. Specifically, it points out that traditional chronic disease diagnosis relies on face-to-face consultations between patients and doctors, which is not only time-consuming but also wastes medical resources. Therefore, the research team utilized Electronic Health Records (EHR) data, combined with Large Multimodal Language Models (LLMMs), to develop an EHR-based chronic disease risk prediction platform. This platform integrates front-end web and mobile applications, enabling real-time risk assessment and can connect to hospital back-end databases to provide doctors with instant risk diagnosis information. The main contributions of the research include: 1. Utilizing large multimodal language models to predict various chronic diseases; 2. Providing an interpretable early diabetes prediction platform; 3. Developing a multimodal health data prediction language model platform with real-time mobile and web data collection capabilities.