Abstract:Learning Chinese word embeddings is important in many tasks of Chinese language information processing, such as entity linking, entity extraction, and knowledge graph. A Chinese word consists of Chinese characters, which can be decomposed into sub-characters (radical, component, stroke, etc). Similar to roots in English words, sub-characters also indicate the origins and basic semantics of Chinese characters. So, many researches follow the approaches designed for learning embeddings of English words to improve Chinese word embeddings. However, some Chinese characters sharing the same sub-characters have different meanings. Furthermore, with more cultural interaction and the popularization of the Internet and web, many neologisms, such as transliterated loanwords and network terms, are emerging, which are only close to the pronunciation of their characters, but far from their semantics. Here, a tripartite weighted graph is proposed to model the semantic relationship among words, characters, and sub-characters, in which the semantic relationship is evaluated according to the Chinese linguistic information. So, the semantic relevance hidden in lower components (sub-characters, characters) can be used to further distinguish the semantics of corresponding higher components (characters, words). Then, the tripartite weighted graph is fed into our Chinese word embedding model insideCC to reveal the semantic relationship among different language components, and learn the embeddings of words. Extensive experimental results on multiple corpora and datasets verify that our proposed methods outperform the state-of-the-art counterparts by a significant margin.

Pronunciation-Enhanced Chinese Word Embedding

Improve Word Embedding Using Both Writing and Pronunciation.

Enhanced Double-Carrier Word Embedding Via Phonetics and Writing

Learning Chinese Word Embeddings from Stroke, Structure and Pinyin of Characters

Integrating Character Representations into Chinese Word Embedding

Learning Chinese Word Embeddings by Discovering Inherent Semantic Relevance in Sub-characters

Joint Learning of Character and Word Embeddings.

Enhancing Chinese Word Embeddings From Relevant Derivative Meanings Of Main-Components In Characters

Chinese Word Embeddings with Subwords

Learning Chinese Word Embeddings from Character Structural Information

Improve Chinese Word Embeddings by Exploiting Internal Structure.

Component-Enhanced Chinese Character Embeddings

Multi-prototype Chinese Character Embedding

An Adaptive Wordpiece Language Model For Learning Chinese Word Embeddings

Combination Methods of Chinese Character and Word Embeddings in Deep Learning

Chinese Embedding via Stroke and Glyph Information: A Dual-channel View

Enhancing Chinese Intent Classification by Dynamically Integrating Character Features into Word Embeddings with Ensemble Techniques

Attention-Based Multi-Layer Chinese Word Embedding

A Character-Enhanced Chinese Word Embedding Model.

VCWE: Visual Character-Enhanced Word Embeddings

Multiple Character Embeddings for Chinese Word Segmentation