Abstract:Abstract Motivation Large Language Models (LLMs) have the potential to revolutionize the field of Natural Language Processing (NLP), excelling not only in text generation and reasoning tasks but also in their ability for zero/few-shot learning, swiftly adapting to new tasks with minimal fine-tuning. LLMs have also demonstrated great promise in biomedical and healthcare applications. However, when it comes to Named Entity Recognition (NER), particularly within the biomedical domain, LLMs fall short of the effectiveness exhibited by fine-tuned domain-specific models. One key reason is that NER is typically conceptualized as a sequence labeling task, whereas LLMs are optimized for text generation and reasoning tasks. Results We developed an instruction-based learning paradigm that transforms biomedical NER from a sequence labeling task into a generation task. This paradigm is end-to-end and streamlines the training and evaluation process by automatically repurposing pre-existing biomedical NER datasets. We further developed BioNER-LLaMA using the proposed paradigm with LLaMA-7B as the foundational LLM. We conducted extensive testing on BioNER-LLaMA across three widely recognized biomedical NER datasets, consisting of entities related to diseases, chemicals, and genes. The results revealed that BioNER-LLaMA consistently achieved higher F1-scores ranging from 5% to 30% compared to the few-shot learning capabilities of GPT-4 on datasets with different biomedical entities. We show that a general-domain LLM can match the performance of rigorously fine-tuned PubMedBERT models and PMC-LLaMA, biomedical-specific language model. Our findings underscore the potential of our proposed paradigm in developing general-domain LLMs that can rival SOTA performances in multi-task, multi-domain scenarios in biomedical and health applications. Availability Datasets and other resources are available at https://github.com/BIDS-Xu-Lab/BioNER-LLaMA. Supplementary information Supplementary data are available at Bioinformatics online.

A novel bundling learning paradigm for named entity recognition

Win-Win Cooperation: Bundling Sequence and Span Models for Named Entity Recognition

Improving Biomedical Named Entity Recognition with a Unified Multi-Task MRC Framework

An End-to-End Scalable Iterative Sequence Tagging with Multi-Task Learning.

Dataset-aware multi-task learning approaches for biomedical named entity recognition

BTPK-based learning: An Interpretable Method for Named Entity Recognition

Named Entity Recognition via Machine Reading Comprehension: A Multi-Task Learning Approach

Multi-Task Learning in Natural Language Processing: An Overview

Towards Malay named entity recognition: an open-source dataset and a multi-task framework

A Multi-task Approach for Machine Reading Comprehension Form Named Entity Recognition Tasks

Named entity recognition model based on Multi‐BiLSTM and competition mechanism

A Neural Span-Based Continual Named Entity Recognition Model

Leveraging Multi-Level Semantic Understanding in a Unified NER Model

End-to-end Named Entity Recognition and Relation Extraction using Pre-trained Language Models

S-NER: A Concise and Efficient Span-Based Model for Named Entity Recognition

Advancing entity recognition in biomedicine via instruction tuning of large language models

A Unified MRC Framework for Named Entity Recognition

Multi-task Transformer with Relation-attention and Type-attention for Named Entity Recognition

Complex Named Entity Recognition via Deep Multi-task Learning from Scratch.

Language model based on deep learning network for biomedical named entity recognition