Abstract:Topic models have many important applications in fields such as Natural Language Processing. Topic embedding modelling aims at introducing word and topic embeddings into topic models to describe correlations between topics. Existing topic embedding methods use documents alone, which suffer from the topical fuzziness problem brought by the introduction of embeddings of semantic fuzzy words, e.g. polysemous words or some misleading academic terms. Links often exist between documents which form document networks. The use of links may alleviate this semantic fuzziness, but they are sparse and noisy which may meanwhile mislead topics. In this paper, we utilize community structure to solve these problems. It can not only alleviate the topical fuzziness of topic embeddings since communities are often believed to be topic related, but also can overcome the drawbacks brought by the sparsity and noise of networks (because community is a high-order network information). We give a new generative topic embedding model which incorporates documents (with topics) and network (with communities) together, and uses probability transition to describe the relationship between topics and communities to make it robust when topics and communities do not match. An efficient variational inference algorithm is then proposed to learn the model. We validate the superiority of our new approach on two tasks, document classifications and visualization of topic embeddings, respectively.

Incorporating Knowledge Graph Embeddings into Topic Modeling

Incorporating Probabilistic Knowledge into Topic Models.

Short Text Understanding by Leveraging Knowledge into Topic Model.

Mining Coherent Topics in Documents Using Word Embeddings and Large-Scale Text Data

Integration of Neural Embeddings and Probabilistic Models in Topic Modeling

Knowledge Base Enhanced Topic Modeling

Knowledge-Aware Bayesian Deep Topic Model

Topic Modeling over Short Texts by Incorporating Word Embeddings

Grounding Topic Models with Knowledge Bases.

Topic-Based Embeddings for Learning from Large Knowledge Graphs

A Novel Topic Model for Documents by Incorporating Semantic Relations Between Words

Incorporating Entity Correlation Knowledge into Topic Modeling

Concept over Time: the Combination of Probabilistic Topic Model with Wikipedia Knowledge.

A Co-Embedding Model with Variational Auto-Encoder for Knowledge Graphs

Representing Mixtures of Word Embeddings with Mixtures of Topic Embeddings

Efficient Methods for Incorporating Knowledge into Topic Models

Graph-Structured Topic Modeling for Documents with Spatial or Covariate Dependencies

Incorporating Biterm Correlation Knowledge into Topic Modeling for Short Texts

A Novel Generative Topic Embedding Model by Introducing Network Communities

Deep Relational Topic Modeling Via Graph Poisson Gamma Belief Network.

Incorporating Text into the Triple Context for Knowledge Graph Embedding.