LLMs are not Zero-Shot Reasoners for Biomedical Information Extraction

Aishik Nagar,Viktor Schlegel,Thanh-Tung Nguyen,Hao Li,Yuping Wu,Kuluhan Binici,Stefan Winkler

2024-08-22

Abstract:Large Language Models (LLMs) are increasingly adopted for applications in healthcare, reaching the performance of domain experts on tasks such as question answering and document summarisation. Despite their success on these tasks, it is unclear how well LLMs perform on tasks that are traditionally pursued in the biomedical domain, such as structured information extration. To breach this gap, in this paper, we systematically benchmark LLM performance in Medical Classification and Named Entity Recognition (NER) tasks. We aim to disentangle the contribution of different factors to the performance, particularly the impact of LLMs' task knowledge and reasoning capabilities, their (parametric) domain knowledge, and addition of external knowledge. To this end we evaluate various open LLMs -- including BioMistral and Llama-2 models -- on a diverse set of biomedical datasets, using standard prompting, Chain-of-Thought (CoT) and Self-Consistency based reasoning as well as Retrieval-Augmented Generation (RAG) with PubMed and Wikipedia corpora. Counter-intuitively, our results reveal that standard prompting consistently outperforms more complex techniques across both tasks, laying bare the limitations in the current application of CoT, self-consistency and RAG in the biomedical domain. Our findings suggest that advanced prompting methods developed for knowledge- or reasoning-intensive tasks, such as CoT or RAG, are not easily portable to biomedical tasks where precise structured outputs are required. This highlights the need for more effective integration of external knowledge and reasoning mechanisms in LLMs to enhance their performance in real-world biomedical applications.

Computation and Language,Artificial Intelligence,Machine Learning

What problem does this paper attempt to address?

The paper is primarily dedicated to addressing the performance evaluation and enhancement of large language models (LLMs) in biomedical information extraction tasks. Specifically, the researchers focus on how to evaluate and improve the performance of LLMs in medical classification and named entity recognition (NER) tasks without the need for additional training data (i.e., zero-shot setting).

The paper identifies three main issues:
1. **Dependence on training sets in existing methods**: Most methods for improving LLM performance rely on training data, which is often impractical in real-world applications, especially when quick responses to new tasks are required.
2. **Lack of research on zero-shot capabilities**: Although there is some research on zero-shot learning, most of it focuses on tasks like question answering, and the effectiveness of such methods for structured prediction tasks like medical information extraction remains unknown.
3. **Practical application limitations of large proprietary models**: Many studies use large-scale commercial models like ChatGPT or GPT-4, but due to high computational costs and privacy protection issues, these models are difficult to deploy in actual medical scenarios.

To address these issues, the paper systematically evaluates the performance of different techniques (such as Chain-of-Thought reasoning, self-consistency, retrieval-augmented generation, etc.) in medical classification and NER tasks to explore how to better utilize external knowledge and reasoning mechanisms to enhance the performance of LLMs. The study finds that standard prompting generally outperforms complex reasoning techniques in this zero-shot setting, and the scale of the model (e.g., the number of parameters) has a significant impact on zero-shot task performance. Additionally, the research emphasizes that when dealing with highly specialized biomedical vocabulary, the model needs to have stronger contextual understanding and disambiguation capabilities.