Abstract:Named entity recognition (NER) is a vital task in spoken language understanding, which aims to identify mentions of named entities in text e.g., from transcribed speech. Existing neural models for NER rely mostly on dedicated word-level representations, which suffer from two main shortcomings. First, the vocabulary size is large, yielding large memory requirements and training time. Second, these models are not able to learn morphological or phonological representations. To remedy the above shortcomings, we adopt a neural solution based on bidirectional LSTMs and conditional random fields, where we rely on subword units, namely characters, phonemes, and bytes. For each word in an utterance, our model learns a representation from each of the subword units. We conducted experiments in a real-world large-scale setting for the use case of a voice-controlled device covering four languages with up to 5.5M utterances per language. Our experiments show that (1) with increasing training data, performance of models trained solely on subword units becomes closer to that of models with dedicated word-level embeddings (91.35 vs 93.92 F1 for English), while using a much smaller vocabulary size (332 vs 74K), (2) subword units enhance models with dedicated word-level embeddings, and (3) combining different subword units improves performance.

Rule-based Recognition of Vietnamese Named Entities

Vietnamese Named Entity Recognition using Token Regular Expressions and Bidirectional Inference

Basic Grammar Rule and Maximum Entropy Based Hybrid Model for Named Entity Recognition

End-to-end Recurrent Neural Network Models for Vietnamese Named Entity Recognition: Word-level vs. Character-level

Error Analysis for Vietnamese Named Entity Recognition on Deep Neural Network Models

Attentive Neural Network for Named Entity Recognition in Vietnamese

Research on Named Entity Recognition from Biomedical Literature

Named Entity Recognition for English Language Using Deep Learning Based Bi Directional LSTM-RNN

A BERT based Chinese Named Entity Recognition method on ASEAN News

Neural Named Entity Recognition from Subword Units

A Survey on Arabic Named Entity Recognition: Past, Recent Advances, and Future Trends

Chinese named entity recognition: The state of the art

Chinese Named Entity Recognition with a Multi-Phase Model

A Brief History of Named Entity Recognition

Named Entity Recognition for Chinese Construction Documents

Chinese Governmental Named Entity Recognition

A Survey on Deep Learning for Named Entity Recognition

Named Entity Recognition with Bidirectional LSTM-CNNs

Named Entity Recognition by Using XLNet-BiLSTM-CRF

Query-Based Named Entity Recognition

Named Entity Recognition in Multi-level Contexts