Efficient and Personalized Mobile Health Event Prediction via Small Language Models

Xin Wang,Ting Dang,Vassilis Kostakos,Hong Jia

2024-09-17

Abstract:Healthcare monitoring is crucial for early detection, timely intervention, and the ongoing management of health conditions, ultimately improving individuals' quality of life. Recent research shows that Large Language Models (LLMs) have demonstrated impressive performance in supporting healthcare tasks. However, existing LLM-based healthcare solutions typically rely on cloud-based systems, which raise privacy concerns and increase the risk of personal information leakage. As a result, there is growing interest in running these models locally on devices like mobile phones and wearables to protect users' privacy. Small Language Models (SLMs) are potential candidates to solve privacy and computational issues, as they are more efficient and better suited for local deployment. However, the performance of SLMs in healthcare domains has not yet been investigated. This paper examines the capability of SLMs to accurately analyze health data, such as steps, calories, sleep minutes, and other vital statistics, to assess an individual's health status. Our results show that, TinyLlama, which has 1.1 billion parameters, utilizes 4.31 GB memory, and has 0.48s latency, showing the best performance compared other four state-of-the-art (SOTA) SLMs on various healthcare applications. Our results indicate that SLMs could potentially be deployed on wearable or mobile devices for real-time health monitoring, providing a practical solution for efficient and privacy-preserving healthcare.

Computation and Language,Artificial Intelligence,Computers and Society,Machine Learning

What problem does this paper attempt to address?

The main problem this paper attempts to address is the risk of privacy leakage, high computational demands, and excessive latency when deploying large language models (LLMs) on mobile devices for health event prediction. Specifically, existing LLM-based medical solutions typically rely on cloud systems, which not only increase the risk of personal privacy leakage but also make it impractical to deploy them on local mobile devices due to the large number of parameters and memory usage of LLMs. Additionally, the high latency of LLMs in handling real-time health monitoring applications is another significant challenge.

To address these issues, the paper explores the potential application of small language models (SLMs) in health data prediction. SLMs have fewer training parameters, making them more suitable for running on mobile devices with limited computational resources while protecting user privacy. However, the performance of SLMs in the medical health field has not been fully studied. By evaluating the performance of several state-of-the-art SLMs in health event prediction tasks, the paper aims to demonstrate that SLMs can achieve comparable or even better performance than LLMs while ensuring efficiency and privacy protection.