Abstract:Distributed word representation has demonstrated its advantages in many natural language processing tasks. Such as named entity recognition, entity relation extraction, and text classification. Traditional one-hot word representation represents a word as a high-dimensional and sparse vector. Instead, distributed word representation represents a word as a low-dimensional and dense vector, which are more suitable as inputs of deep neural networks. Furthermore, distributed word representation can express the semantic relatedness and syntactic regularities between different words. Word embedding is a kind of distributed word representation technology, which is very popular and useful in many natural language processing tasks. Recently, more and more researches have focused on learning word embeddings with internal morphological knowledge in words, such as character, sub-words, and other kinds of morphological information. For example, Chinese characters contain rich semantic information related to words they compose. Thus, characters can help improving the representation of words. In this paper, we present a character-enhanced Chinese word embeddings model (CCWE). In the model, we train character and word embeddings simultaneously in two parallel tasks. The framework of our model is based-on Skip-Gram. We evaluate CCWE on word similarity, analogical reasoning, text classification, and named entity recognition. The results demonstrate that our model can learn both better Chinese word and character embeddings than other baseline models.

Exploring Chinese Word Embedding with Similar Context and Reinforcement Learning

Using Context-to-Vector with Graph Retrofitting to Improve Word Embeddings

Learning Chinese Word Embeddings from Stroke, Structure and Pinyin of Characters

Learning Context-Specific Word/Character Embeddings.

Chinese Word Embeddings with Subwords

Learning Effective Word Embedding Using Morphological Word Similarity

Improved Learning of Chinese Word Embeddings with Semantic Knowledge.

cw2vec: Learning Chinese Word Embeddings with Stroke n-gram Information

VCWE: Visual Character-Enhanced Word Embeddings

An Exploration Of Semantic Relations In Neural Word Embeddings Using Extrinsic Knowledge

Visual Exploration and Comparison of Word Embeddings.

A Character-Enhanced Chinese Word Embedding Model.

Joint Learning of Character and Word Embeddings.

Learning word embeddings from dependency relations

SCoEmbeddings: encoding sentiment information into contextualized embeddings for sentiment analysis

Recurrent Neural Network Language Model With Structured Word Embeddings For Speech Recognition

Deriving Word Vectors from Contextualized Language Models using Topic-Aware Mention Selection

Learning word representation by jointly using neighbor and syntactic contexts

Learning Word Embeddings from Intrinsic and Extrinsic Views

Category Enhanced Word Embedding.

Embedded Representation of Relation Words with Visual Supervision