Abstract:Chatbots such as Xiaoice have gained huge popularity in recent years. Users frequently mention their favorite works such as songs and movies in conversations with chatbots. Detecting these entities can help design better chat strategies and improve user experience. Existing named entity recognition methods are mainly designed for formal texts, and their performance on the informal chatbot conversation texts may not be optimal In addition, these methods rely on massive manually annotated data for model training. In this article, we propose a neural approach to detect entities of works for Chinese chatbot. Our approach is based on a language model (LM) long-short term memory (LSTM) convolutional neural network (CNN) conditional random value (CRF), or LM-LSTM-CNN-CRF, framework, which contains a language model to generate context-aware character embeddings, a Bi-LSTM network to learn contextual character representations from global contexts, a CNN to learn character representations from local contexts, and a CRF layer to jointly decode the character label sequence. In addition, we propose an automatic text annotation method via quote marks to reduce the effort of manual annotation. Besides, we propose an iterative data purification method to improve the quality of the automatically constructed labeled data. Massive experiments on a real-world dataset validate that our approach can achieve good performance on entity detection for Chinese chatbots.

Character-Aware Convolutional Neural Networks for Paraphrase Identification.

A Deep Network Model for Paraphrase Detection in Short Text Messages

Bidirectional Long Short-Term Memory with Gated Relevance Network for Paraphrase Identification

Character-level Convolutional Networks for Text Classification

Empirical Study on Character Level Neural Network Classifier for Chinese Text.

A Convolutional Neural Network for Modelling Sentences

Neural paraphrasing by automatically crawled and aligned sentence pairs

CNN-Based Chinese NER with Lexicon Rethinking

Ercnn: Enhanced Recurrent Convolutional Neural Networks For Learning Sentence Similarity

ABCNN: Attention-Based Convolutional Neural Network for Modeling Sentence Pairs.

An Efficient Cross-lingual Model for Sentence Classification Using Convolutional Neural Network.

A Character-Aware Encoder for Neural Machine Translation.

Paraphrase Identification with Deep Learning: A Review of Datasets and Methods

Paraphrase Identification with External Memory and SRL Knowledge

Character-based Neural Machine Translation

Character-Based Parsing with Convolutional Neural Network.

Detecting Entities of Works for Chinese Chatbot

A Multi-cascaded Model with Data Augmentation for Enhanced Paraphrase Detection in Short Texts

DLCEncDec : A Fully Character-Level Encoder-Decoder Model for Neural Responding Conversation.

Cross-lingual paraphrase identification