From Beginner to Expert: Modeling Medical Knowledge into General LLMs

Qiang Li,Xiaoyan Yang,Haowen Wang,Qin Wang,Lei Liu,Junjie Wang,Yang Zhang,Mingyuan Chu,Sen Hu,Yicheng Chen,Yue Shen,Cong Fan,Wangshu Zhang,Teng Xu,Jinjie Gu,Jing Zheng,Guannan Zhang Ant Group

2024-01-07

Abstract:Recently, large language model (LLM) based artificial intelligence (AI) systems have demonstrated remarkable capabilities in natural language understanding and generation. However, these models face a significant challenge when it comes to sensitive applications, such as reasoning over medical knowledge and answering medical questions in a physician-like manner. Prior studies attempted to overcome this challenge by increasing the model size (>100B) to learn more general medical knowledge, while there is still room for improvement in LLMs with smaller-scale model sizes (<100B). In this work, we start from a pre-trained general LLM model (AntGLM-10B) and fine-tune it from a medical beginner towards a medical expert (called AntGLM-Med-10B), which leverages a 3-stage optimization procedure, i.e., general medical knowledge injection, medical domain instruction tuning, and specific medical task adaptation. Our contributions are threefold: (1) We specifically investigate how to adapt a pre-trained general LLM in medical domain, especially for a specific medical task. (2) We collect and construct large-scale medical datasets for each stage of the optimization process. These datasets encompass various data types and tasks, such as question-answering, medical reasoning, multi-choice questions, and medical conversations. (3) Specifically for multi-choice questions in the medical domain, we propose a novel Verification-of-Choice approach for prompting engineering, which significantly enhances the reasoning ability of LLMs. Remarkably, by combining the above approaches, our AntGLM-Med-10B model can outperform the most of LLMs on PubMedQA, including both general and medical LLMs, even when these LLMs have larger model size.

Computation and Language

What problem does this paper attempt to address?

The paper aims to address the challenges of applying large language models (LLMs) in the medical field, particularly in enhancing the ability to reason with doctor-level medical knowledge and answer medical questions. Although current large language models perform well in natural language understanding and generation, they still exhibit significant shortcomings when dealing with sensitive applications such as medical reasoning. The paper proposes a three-stage optimization process to adjust a pre-trained general LLM (AntGLM-10B) into a model with specialized medical knowledge (AntGLM-Med-10B). The specific steps include:

1. **General Medical Knowledge Injection**: Injecting foundational medical knowledge into the model through continued pre-training.
2. **Medical Domain Instruction Fine-Tuning**: Enhancing the model's ability to handle various types of medical tasks.
3. **Specific Medical Task Adaptation**: Fine-tuning the model for specific medical tasks.

The paper particularly introduces a new method called "Verification-of-Choice" (VoC) for prompt engineering in multiple-choice questions, significantly enhancing the model's reasoning capabilities. Additionally, the researchers constructed a large-scale medical dataset to support each optimization stage and demonstrated that their model outperformed several larger-scale LLM models on the PubMedQA dataset, showcasing its effectiveness and potential in the medical field.