Abstract:Few-shot named entity recognition (NER) systems recognize entities using a few labeled training examples. The general pipeline consists of a span detector to identify entity spans in text and an entity-type classifier to assign types to entities. Current span detectors rely on extensive manual labeling to guide training. Almost every span detector requires initial training on basic span features followed by adaptation to task-specific features. This process leads to repetitive training of the basic span features among span detectors. Additionally, metric-based entity-type classifiers, such as prototypical networks, typically employ a specific metric that gauges the distance between the query sample and entity-type referents, ultimately assigning the most probable entity type to the query sample. However, these classifiers encounter the sample dependency problem, primarily stemming from the limited samples available for each entity-type referent. To address these challenges, we proposed an improved few-shot NER pipeline. First, we introduce a steppingstone span detector that is pre-trained on open-domain Wikipedia data. It can be used to initialize the pipeline span detector to reduce the repetitive training of basic features. Second, we leverage a large language model (LLM) to set reliable entity-type referents, eliminating reliance on few-shot samples of each type. Our model exhibits superior performance with fewer training steps and human-labeled data compared with baselines, as demonstrated through extensive experiments on various datasets. Particularly in fine-grained few-shot NER settings, our model outperforms strong baselines, including ChatGPT. We will publicly release the code, datasets, LLM outputs, and model checkpoints.

Handling Negative Samples Problems in Span-Based Nested Named Entity Recognition

Span-Based Nested Named Entity Recognition with Pretrained Language Model

A segment enhanced span-based model for nested named entity recognition

Dealing with negative samples with multi-task learning on span-based joint entity-relation extraction

HTMapper: Bidirectional Head-Tail Mapping for Nested Named Entity Recognition

Recognizing Nested Entities from Flat Supervision: A New NER Subtask, Feasibility and Challenges

Few-shot nested named entity recognition

Joint Learning of Token Context and Span Feature for Span-Based Nested NER

S-NER: A Concise and Efficient Span-Based Model for Named Entity Recognition

Locate and Label: A Two-stage Identifier for Nested Named Entity Recognition

A Sequence-to-Set Network for Nested Named Entity Recognition.

Better Sampling of Negatives for Distantly Supervised Named Entity Recognition

Research on Named Entity Recognition Based on Multi-Task Learning and Biaffine Mechanism

Global Span Semantic Dependency Awareness and Filtering Network for nested named entity recognition

Fighting Against the Repetitive Training and Sample Dependency Problem in Few-shot Named Entity Recognition

Rethinking Negative Instances for Generative Named Entity Recognition

An Embarrassingly Easy but Strong Baseline for Nested Named Entity Recognition

Bi-directional context-aware network for the nested named entity recognition

Nested Entity Recognition Method Based on Multidimensional Features and Fuzzy Localization

Full-span named entity recognition with boundary regression