Abstract:Few-shot named entity recognition (NER) systems recognize entities using a few labeled training examples. The general pipeline consists of a span detector to identify entity spans in text and an entity-type classifier to assign types to entities. Current span detectors rely on extensive manual labeling to guide training. Almost every span detector requires initial training on basic span features followed by adaptation to task-specific features. This process leads to repetitive training of the basic span features among span detectors. Additionally, metric-based entity-type classifiers, such as prototypical networks, typically employ a specific metric that gauges the distance between the query sample and entity-type referents, ultimately assigning the most probable entity type to the query sample. However, these classifiers encounter the sample dependency problem, primarily stemming from the limited samples available for each entity-type referent. To address these challenges, we proposed an improved few-shot NER pipeline. First, we introduce a steppingstone span detector that is pre-trained on open-domain Wikipedia data. It can be used to initialize the pipeline span detector to reduce the repetitive training of basic features. Second, we leverage a large language model (LLM) to set reliable entity-type referents, eliminating reliance on few-shot samples of each type. Our model exhibits superior performance with fewer training steps and human-labeled data compared with baselines, as demonstrated through extensive experiments on various datasets. Particularly in fine-grained few-shot NER settings, our model outperforms strong baselines, including ChatGPT. We will publicly release the code, datasets, LLM outputs, and model checkpoints.

A simple but effective span-level tagging method for discontinuous named entity recognition

A Neural Span-Based Continual Named Entity Recognition Model

SpanNER: Named Entity Re-/Recognition As Span Prediction

A Unified Generative Framework for Various NER Subtasks

Locate and Label: A Two-stage Identifier for Nested Named Entity Recognition

S-NER: A Concise and Efficient Span-Based Model for Named Entity Recognition

Bi-directional context-aware network for the nested named entity recognition

An Effective Transition-based Model for Discontinuous NER

A fast and sound tagging method for discontinuous named-entity recognition

A segment enhanced span-based model for nested named entity recognition

Fighting Against the Repetitive Training and Sample Dependency Problem in Few-shot Named Entity Recognition

Full-span named entity recognition with boundary regression

Pronounce Differently, Mean Differently: A Multi-Tagging-scheme Learning Method for Chinese NER Integrated with Lexicon and Phonetic Features

Global Span Semantic Dependency Awareness and Filtering Network for nested named entity recognition

A Boundary Offset Prediction Network for Named Entity Recognition

Boosting Span-based Joint Entity and Relation Extraction via Squence Tagging Mechanism

Span-based joint entity and relation extraction augmented with sequence tagging mechanism

Deep Span Representations for Named Entity Recognition

A Local Information Perception Enhancement–Based Method for Chinese NER

Hybrid Multi-stage Decoding for Few-shot NER with Entity-aware Contrastive Learning