Abstract:Few-shot named entity recognition (NER) systems recognize entities using a few labeled training examples. The general pipeline consists of a span detector to identify entity spans in text and an entity-type classifier to assign types to entities. Current span detectors rely on extensive manual labeling to guide training. Almost every span detector requires initial training on basic span features followed by adaptation to task-specific features. This process leads to repetitive training of the basic span features among span detectors. Additionally, metric-based entity-type classifiers, such as prototypical networks, typically employ a specific metric that gauges the distance between the query sample and entity-type referents, ultimately assigning the most probable entity type to the query sample. However, these classifiers encounter the sample dependency problem, primarily stemming from the limited samples available for each entity-type referent. To address these challenges, we proposed an improved few-shot NER pipeline. First, we introduce a steppingstone span detector that is pre-trained on open-domain Wikipedia data. It can be used to initialize the pipeline span detector to reduce the repetitive training of basic features. Second, we leverage a large language model (LLM) to set reliable entity-type referents, eliminating reliance on few-shot samples of each type. Our model exhibits superior performance with fewer training steps and human-labeled data compared with baselines, as demonstrated through extensive experiments on various datasets. Particularly in fine-grained few-shot NER settings, our model outperforms strong baselines, including ChatGPT. We will publicly release the code, datasets, LLM outputs, and model checkpoints.

Label-Description Enhanced Network for Few-Shot Named Entity Recognition.

Label Semantics for Few Shot Named Entity Recognition

A Unified Label-Aware Contrastive Learning Framework for Few-Shot Named Entity Recognition

CEPTNER: Contrastive learning Enhanced Prototypical network for Two-stage few-shot Named Entity Recognition

Large-Scale Label Interpretation Learning for Few-Shot Named Entity Recognition

Chinese Name Entity Recognition with Label Semantics

SLNER: Chinese Few-Shot Named Entity Recognition with Enhanced Span and Label Semantics

CLINER: exploring task-relevant features and label semantic for few-shot named entity recognition

BANER: Boundary-Aware LLMs for Few-Shot Named Entity Recognition

Few-shot Named Entity Recognition with Entity-level Prototypical Network Enhanced by Dispersedly Distributed Prototypes

Few-Shot Named Entity Recognition Via Meta-Learning (extended Abstract).

Label Refinement Via Contrastive Learning for Distantly-Supervised Named Entity Recognition.

CLLMFS: A Contrastive Learning enhanced Large Language Model Framework for Few-Shot Named Entity Recognition

Label Attention Network for Structured Prediction

Few-shot Named Entity Recognition with Self-describing Networks

SEE-Few: Seed, Expand and Entail for Few-shot Named Entity Recognition

HEProto: A Hierarchical Enhancing ProtoNet Based on Multi-Task Learning for Few-shot Named Entity Recognition

Structure and Label Constrained Data Augmentation for Cross-domain Few-shot NER

Fighting Against the Repetitive Training and Sample Dependency Problem in Few-Shot Named Entity Recognition