PharmacyGPT: The AI Pharmacist

Zhengliang Liu,Zihao Wu,Mengxuan Hu,Bokai Zhao,Lin Zhao,Tianyi Zhang,Haixing Dai,Xianyan Chen,Ye Shen,Sheng Li,Quanzheng Li,Xiang Li,Brian Murray,Tianming Liu,Andrea Sikora

2024-10-04

Abstract:In this study, we introduce PharmacyGPT, a novel framework to assess the capabilities of large language models (LLMs) such as ChatGPT and GPT-4 in emulating the role of clinical pharmacists. Our methodology encompasses the utilization of LLMs to generate comprehensible patient clusters, formulate medication plans, and forecast patient outcomes. We conduct our investigation using real data acquired from the intensive care unit (ICU) at the University of North Carolina Chapel Hill (UNC) Hospital. Our analysis offers valuable insights into the potential applications and limitations of LLMs in the field of clinical pharmacy, with implications for both patient care and the development of future AI-driven healthcare solutions. By evaluating the performance of PharmacyGPT, we aim to contribute to the ongoing discourse surrounding the integration of artificial intelligence in healthcare settings, ultimately promoting the responsible and efficacious use of such technologies.

Computation and Language

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve

This paper aims to explore the potential application of large language models (LLMs) in the management of pharmacotherapy in the intensive care unit (ICU). Specifically, the paper introduces PharmacyGPT, a new framework based on LLMs (such as ChatGPT and GPT-4) to evaluate these models' capabilities in simulating the role of a clinical pharmacist. The main research objectives include:

1. **Generating Understandable Patient Clusters**: Creating meaningful patient groups by generating patient embedding vectors through LLMs and using hierarchical clustering methods.
2. **Formulating Medication Plans**: Utilizing LLMs to generate medication plans based on patient information.
3. **Predicting Patient Outcomes**: Predicting key indicators such as in-hospital mortality, ICU length of stay, and APACHE II scores through LLMs.

### Research Background and Motivation

In recent years, significant progress has been made in the application of large language models across various fields, but their application in specific domains (such as pharmacy) still requires further research. PharmacyGPT is the first study to apply LLMs to ICU pharmacotherapy management, aiming to explore the practical application capabilities and limitations of these models in the field of pharmacy.

### Main Contributions

1. **Proposing the PharmacyGPT Framework**: Enhancing the performance of LLMs in the field of pharmacy through dynamic prompting and iterative optimization techniques.
2. **Generating Explainable Patient Clusters**: Using GPT-3 to generate patient embedding vectors and creating meaningful patient groups through hierarchical clustering methods.
3. **Predicting Patient Outcomes**: Using ChatGPT and GPT-4 to predict patient in-hospital mortality and APACHE II scores.
4. **Formulating Medication Plans**: Using GPT-4 to generate medication plans for ICU patients and comparing them with actual treatment plans.

### Conclusion

This study demonstrates the potential application value of LLMs in the field of pharmacy but also points out their limitations in handling complex clinical information and time-series data. Future work can focus on addressing data imbalance issues, improving model architectures, and creating pharmacy datasets more suitable for LLMs to further enhance the application effectiveness of these models in the field of pharmacy.