Abstract:Learning Chinese word embeddings is important in many tasks of Chinese language information processing, such as entity linking, entity extraction, and knowledge graph. A Chinese word consists of Chinese characters, which can be decomposed into sub-characters (radical, component, stroke, etc). Similar to roots in English words, sub-characters also indicate the origins and basic semantics of Chinese characters. So, many researches follow the approaches designed for learning embeddings of English words to improve Chinese word embeddings. However, some Chinese characters sharing the same sub-characters have different meanings. Furthermore, with more cultural interaction and the popularization of the Internet and web, many neologisms, such as transliterated loanwords and network terms, are emerging, which are only close to the pronunciation of their characters, but far from their semantics. Here, a tripartite weighted graph is proposed to model the semantic relationship among words, characters, and sub-characters, in which the semantic relationship is evaluated according to the Chinese linguistic information. So, the semantic relevance hidden in lower components (sub-characters, characters) can be used to further distinguish the semantics of corresponding higher components (characters, words). Then, the tripartite weighted graph is fed into our Chinese word embedding model insideCC to reveal the semantic relationship among different language components, and learn the embeddings of words. Extensive experimental results on multiple corpora and datasets verify that our proposed methods outperform the state-of-the-art counterparts by a significant margin.

Combination Methods of Chinese Character and Word Embeddings in Deep Learning

Enhanced Double-Carrier Word Embedding Via Phonetics and Writing

Joint Learning of Character and Word Embeddings.

Learning Chinese Word Embeddings by Discovering Inherent Semantic Relevance in Sub-characters

Integrating Character Representations into Chinese Word Embedding

Effective Character-Augmented Word Embedding for Machine Reading Comprehension.

VCWE: Visual Character-Enhanced Word Embeddings

A Chinese Question Answering Approach Integrating Count-based and Embedding-based Features

A Character-Enhanced Chinese Word Embedding Model.

Multi-prototype Chinese Character Embedding

Improving Word Embeddings via Combining with Complementary Languages.

Hierarchical Joint Learning for Chinese Word Embeddings

Pronunciation-Enhanced Chinese Word Embedding

Learning Chinese-Japanese Bilingual Word Embedding by Using Common Characters.

Chinese Word Embeddings with Subwords

Enhancing Chinese Intent Classification by Dynamically Integrating Character Features into Word Embeddings with Ensemble Techniques

Component-Enhanced Chinese Character Embeddings

Learning Chinese Word Embeddings from Stroke, Structure and Pinyin of Characters

An Adaptive Wordpiece Language Model For Learning Chinese Word Embeddings

Multiple Character Embeddings for Chinese Word Segmentation

Learning Chinese Word Embeddings from Character Structural Information