Hierarchical Joint Learning for Chinese Word Embeddings

Zhe Wang,Qiong Wang,Yechao Bai,Xinggan Zhang
DOI: https://doi.org/10.1109/icsidp47821.2019.9172912
2019-01-01
Abstract:In recent years, some methods of learning Chinese word embedding based on the characters and sub-characters information have been proposed and achieve state-of-art results. Generally speaking, good embedding of characters and sub-characters can help learn better embedding of words. However, current methods utilizing characters and sub-characters information, such as character-based CWE and sub-character-based JWE, only learn embedding of characters and sub-characters by predicting the target word. We believe it's not enough to improve the quality of characters and sub-characters embedding, so we propose a method called HJWE which predicts the target word, characters and sub-characters in the target word at the same time. The experiment result shows that our method performs best on the word similarity, word analogy and text classification tasks.
What problem does this paper attempt to address?