VCWE: Visual Character-Enhanced Word Embeddings

Chi Sun,Xipeng Qiu,Xuanjing Huang
DOI: https://doi.org/10.48550/arXiv.1902.08795
2019-02-23
Computation and Language
Abstract:Chinese is a logographic writing system, and the shape of Chinese characters contain rich syntactic and semantic information. In this paper, we propose a model to learn Chinese word embeddings via three-level composition: (1) a convolutional neural network to extract the intra-character compositionality from the visual shape of a character; (2) a recurrent neural network with self-attention to compose character representation into word embeddings; (3) the Skip-Gram framework to capture non-compositionality directly from the contextual information. Evaluations demonstrate the superior performance of our model on four tasks: word similarity, sentiment analysis, named entity recognition and part-of-speech tagging.
What problem does this paper attempt to address?