Wide & Deep Learning for improving Named Entity Recognition via Text-Aware Named Entity Normalization

Ying Han,Wei Chen,Xiaoliang Xiong,Qiang Li,Zhen Qiu,Tengjiao Wang

2018-01-01

Abstract:Multiple representations of the same entity often appear together in the results of named entity recognition(NER), such as “the United States” and “the U.S.”, named entity normalization(NEN) was introduced to normalize synonymy of names to the concepts they refer to. Traditionally, NER and NEN are conducted as a pipelined way, which ignores the relevance between NER and NEN, so that the effective information of NEN cannot be fed back to NER to help it. Inspired by wide & deep learning in recommender systems, we proposed a model named TANER which combined the advantages of deep neural networks to learn implicit high-order contextual features for NER, and the advantages of linear models to memory explicit low-order textual features for NEN, thus TANER conducted NER and NEN simultaneously, and improved NER with the help of NEN. In addition, unlike other NEN methods that rely on knowledge bases or dictionaries, TANER is able to normalize newly defined entities in the text. Experiments on true dataset showed that TANER significantly improves the recall rate, and achieved promising results compared to the state-of-the-art approaches.