Abstract:Named entity recognition (NER) aims to identify and classify specific entities mentioned in textual sentences. Most existing superior NER models employ the standard fully supervised paradigm, which requires a large amount of annotated data during training. In order to maintain performance with insufficient annotation resources (i.e., low resources), in-context learning (ICL) has drawn a lot of attention, due to its plug-and-play nature compared to other methods (e.g., meta-learning and prompt learning). In this manner, how to retrieve high-correlated demonstrations for target sentences serves as the key to emerging ICL ability. For the NER task, the correlation implies the consistency of both ontology (i.e., generalized entity type) and context (i.e., sentence semantic), which is ignored by previous NER demonstration retrieval techniques. To address this issue, we propose ConsistNER, a novel three-stage framework that incorporates ontological and contextual information for low-resource NER. Firstly, ConsistNER employs large language models (LLMs) to pre-recognize potential entities in a zero-shot manner. Secondly, ConsistNER retrieves the sentence-specific demonstrations for each target sentence based on the two following considerations: (1) Regarding ontological consistency, demonstrations are filtered into a candidate set based on ontology distribution. (2) Regarding contextual consistency, an entity-aware self-attention mechanism is introduced to focus more on the potential entities and semantic-correlated tokens. Finally, ConsistNER feeds the retrieved demonstrations for all target sentences into LLMs for prediction. We conduct experiments on four widely-adopted NER datasets, including both general and specific domains. Experimental results show that ConsistNER achieves a 6.01%-26.37% and 3.07%-21.18% improvement over the state-of-the-art baselines on Micro-F1 scores under 1- and 5-shot settings, respectively.

A Dual-Contrastive Framework for Low-Resource Cross-Lingual Named Entity Recognition

Dual Contrastive Learning for Cross-domain Named Entity Recognition

mCL-NER: Cross-Lingual Named Entity Recognition via Multi-view Contrastive Learning

DualNER: A Dual-Teaching framework for Zero-shot Cross-lingual Named Entity Recognition

A Low-Resource Chinese Named Entity Recognition Method Combining Chinese Glyph Features and Contrastive Learning

CLLMFS: A Contrastive Learning enhanced Large Language Model Framework for Few-Shot Named Entity Recognition

Enhanced Meta-Learning for Cross-lingual Named Entity Recognition with Minimal Resources.

Converse Attention Knowledge Transfer for Low-Resource Named Entity Recognition

A Unified Label-Aware Contrastive Learning Framework for Few-Shot Named Entity Recognition

NerCo: A Contrastive Learning Based Two-stage Chinese NER Method

Cross-Lingual Named Entity Recognition Based on Attention and Adversarial Training

LightNER: A Lightweight Generative Framework with Prompt-guided Attention for Low-resource NER

Neural Cross-Lingual Named Entity Recognition with Minimal Resources

Improving Self-training for Cross-lingual Named Entity Recognition with Contrastive and Prototype Learning

Low-Resource Named Entity Recognition with Cross-Lingual, Character-Level Neural Conditional Random Fields

CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation

CGCL: A Novel Collaborative Graph Contrastive Learning Network for Chinese NER

ConsistNER: Towards Instructive NER Demonstrations for LLMs with the Consistency of Ontology and Context

TransAdv: A Translation-based Adversarial Learning Framework for Zero-Resource Cross-Lingual Named Entity Recognition.

CLINER: exploring task-relevant features and label semantic for few-shot named entity recognition

Uncertainty-Aware Contrastive Learning for Semi-Supervised Named Entity Recognition