Named Entity Recognition for Nepali Language

Oyesh Mann Singh,Ankur Padia,Anupam Joshi
DOI: https://doi.org/10.1109/cic48465.2019.00031
2019-12-01
Abstract:Named Entity Recognition (NER) has been studied for many languages like English, German, Spanish, and others but virtually no studies have focused on the Nepali language. One key reason is the lack of an appropriate, annotated dataset. In this paper, we describe a Nepali NER dataset that we created. We discuss and compare the performance of various machine learning models on this dataset. We also propose a novel NER scheme for Nepali and show that this scheme, based on grapheme-level representations, outperforms character-level representations when combined with BiLSTM models. Our best models obtain an overall F1 score of 86.89, which is a significant improvement on previously reported performance in literature.
What problem does this paper attempt to address?