cw2vec: Learning Chinese Word Embeddings with Stroke n-gram Information

Shaosheng Cao,Wei Lu,Jun Zhou,Xiaolong Li
DOI: https://doi.org/10.1609/aaai.v32i1.12029
2018-04-27
Proceedings of the AAAI Conference on Artificial Intelligence
Abstract:We propose cw2vec, a novel method for learning Chinese word embeddings. It is based on our observation that exploiting stroke-level information is crucial for improving the learning of Chinese word embeddings. Specifically, we design a minimalist approach to exploit such features, by using stroke n-grams, which capture semantic and morphological level information of Chinese words. Through qualitative analysis, we demonstrate that our model is able to extract semantic information that cannot be captured by existing methods. Empirical results on the word similarity, word analogy, text classification and named entity recognition tasks show that the proposed approach consistently outperforms state-of-the-art approaches such as word-based word2vec and GloVe, character-based CWE, component-based JWE and pixel-based GWE.
What problem does this paper attempt to address?