Abstract:Words provide a useful source of information for Chinese NLP, and word segmentation has been taken as a pre-processing step for most downstream tasks. For many NLP tasks, however, word segmentation can introduce noise and lead to error propagation. The rise of neural representation learning models allows sentence-level semantic information to be collected from characters directly. As a result, it is an empirical question whether a fully character-based model should be used instead of first performing word segmentation. We investigate a neural representation that simultaneously encodes character and word information without the need for segmentation. In particular, candidate words are found in a sentence by matching with a pre-defined lexicon. A lattice structured LSTM is used to encode the resulting word-character lattice, where gate vectors are used to control information flow through words, so that the more useful words can be automatically identified by end-to-end training. We compare the performance of the resulting lattice LSTM and baseline sequence LSTM structures over both character sequences and automatically segmented word sequences. Results on NER show that the character-word lattice model can significantly improve the performance. In addition, as a general sentence representation architecture, character-word lattice LSTM can also be used for learning contextualized representations. To this end, we compare lattice LSTM structure with its sequential LSTM counterpart, namely ELMo. Results show that our lattice version of ELMo gives better language modeling performances. On Chinese POS-tagging, chunking and syntactic parsing tasks, the resulting contextualized Chinese embeddings also give better performance than ELMo trained on the same data.

Chinese textual entailment recognition model based on contextual feature extraction

Chinese Textual Entailment Recognition Enhanced With Word Embedding

Recognizing Entailment in Chinese Texts with Feature Combination

A Context-Enriched Neural Network Method for Recognizing Lexical Entailment.

Chinese Textual Entailment Recognition Based on Syntactic Tree Clipping

Recognizing Text Entailment Via Bidirectional Lstm Model With Inner-Attention

Max-Cosine Matching Based Neural Models for Recognizing Textual Entailment

A Local Information Perception Enhancement–Based Method for Chinese NER

Lattice LSTM for Chinese Sentence Representation

Co-driven Recognition of Semantic Entailment Based on Fusion of Transformer and HowNet Sememe Knowledge

Hierarchical Lexicon Embedding Architecture for Chinese Named Entity Recognition

Hierarchical LSTM with char-subword-word tree-structure representation for Chinese named entity recognition

Hierarchical Contextualized Representation for Named Entity Recognition.

A Classification Model for Semantic Entailment Recognition with Feature Combination.

Chinese Text Sentiment Classification Based on LSTM Word-Tag Relational Network Model

Implicit Discourse Relation Recognition with Context-aware Character-enhanced Embeddings

A Chinese named entity recognition model incorporating recurrent cell and information state recursion

A Convolution BiLSTM Neural Network Model for Chinese Event Extraction

Textual Entailment Recognition with Semantic Features from Empirical Text Representation

Adaptive Region Embedding for Text Classification.

Embedding WordNet Knowledge for Textual Entailment.