Mining Coherent Topics in Documents Using Word Embeddings and Large-Scale Text Data
Liang Yao,Yin Zhang,Qinfei Chen,Hongze Qian,Baogang Wei,Zhifeng Hu
DOI: https://doi.org/10.1016/j.engappai.2017.06.024
IF: 8
2017-01-01
Engineering Applications of Artificial Intelligence
Abstract:Probabilistic topic models have been extensively used to extract low-dimension aspects from document collections. However, such models without any human knowledge often generate topics that are not interpretable. Recently, a number of knowledge-based topic models have been proposed, which enable users to input prior domain knowledge to produce more meaningful and coherent topics. Word embeddings, on the other hand, can automatically capture both semantic and syntactic information of words from a large amount of documents, and can be used to measure word similarities. In this paper, we incorporate word embeddings obtained from a large number of domains into topic modeling. By combining Latent Dirichlet Allocation, a widely used topic model with Skip-Gram, a well-known framework for learning word vectors, we improve the semantic coherence significantly. Our evaluation results using product review documents from 100 domains will demonstrate the effectiveness of our method.