Abstract:Cross-lingual Named Entity Recognition (NER) has recently become a research hotspot because it can alleviate the data-hungry problem for low-resource languages. However, few researches have focused on the scenario where the source-language labeled data is also limited in some specific domains. A common approach for this scenario is to generate more training data through translation or generation-based data augmentation method. Unfortunately, we find that simply combining source-language data and the corresponding translation cannot fully exploit the translated data and the improvements obtained are somewhat limited. In this paper, we describe our novel dual-contrastive framework ConCNER for cross-lingual NER under the scenario of limited source-language labeled data. Specifically, based on the source-language samples and their translations, we design two contrastive objectives for cross-language NER at different grammatical levels, namely Translation Contrastive Learning (TCL) to close sentence representations between translated sentence pairs and Label Contrastive Learning (LCL) to close token representations within the same labels. Furthermore, we utilize knowledge distillation method where the NER model trained above is used as the teacher to train a student model on unlabeled target-language data to better fit the target language. We conduct extensive experiments on a wide variety of target languages, and the results demonstrate that ConCNER tends to outperform multiple baseline methods. For reproducibility, our code for this paper is available at <a class="link-external link-https" href="https://github.com/GKLMIP/ConCNER" rel="external noopener nofollow">this https URL</a>.

Cross-Lingual Contrastive Learning for Fine-Grained Entity Typing for Low-Resource Languages

Type-enriched Hierarchical Contrastive Strategy for Fine-Grained Entity Typing

How Can Cross-lingual Knowledge Contribute Better to Fine-Grained Entity Typing?

Few-Shot Fine-Grained Entity Typing with Automatic Label Interpretation and Instance Generation

Generative Entity Typing with Curriculum Learning

OntoType: Ontology-Guided and Pre-Trained Language Model Assisted Fine-Grained Entity Typing

From Ultra-Fine to Fine: Fine-tuning Ultra-Fine Entity Typing Models to Fine-grained

A Chinese Corpus for Fine-grained Entity Typing

Put It Back: Entity Typing with Language Model Enhancement

Cross-Lingual Type Inference.

Alleviate Dataset Shift Problem in Fine-Grained Entity Typing with Virtual Adversarial Training

Label Noise Reduction in Entity Typing by Heterogeneous Partial-Label Embedding

A Three-Stage Curriculum Learning Framework with Hierarchical Label Smoothing for Fine-Grained Entity Typing.

Multi-view Contrastive Learning for Entity Typing over Knowledge Graphs

Translation and Fusion Improves Zero-shot Cross-lingual Information Extraction

Calibrated Seq2seq Models for Efficient and Generalizable Ultra-fine Entity Typing

A Dual-Contrastive Framework for Low-Resource Cross-Lingual Named Entity Recognition

Cross-Lingual Named Entity Recognition Based on Attention and Adversarial Training

Improving Distantly-supervised Entity Typing with Compact Latent Space Clustering

Prompt-Learning for Fine-Grained Entity Typing

Liberal Entity Extraction: Rapid Construction of Fine-Grained Entity Typing Systems