Abstract:Probabilistic topic models are unsupervised generative models which model document content as a two-step generation process, that is, documents are observed as mixtures of latent concepts or topics, while topics are probability distributions over vocabulary words. Recently, a significant research effort has been invested into transferring the probabilistic topic modeling concept from monolingual to multilingual settings. Novel topic models have been designed to work with parallel and comparable texts. We define multilingual probabilistic topic modeling (MuPTM) and present the first full overview of the current research, methodology, advantages and limitations in MuPTM. As a representative example, we choose a natural extension of the omnipresent LDA model to multilingual settings called bilingual LDA (BiLDA). We provide a thorough overview of this representative multilingual model from its high-level modeling assumptions down to its mathematical foundations. We demonstrate how to use the data representation by means of output sets of (i) per-topic word distributions and (ii) per-document topic distributions coming from a multilingual probabilistic topic model in various real-life cross-lingual tasks involving different languages, without any external language pair dependent translation resource: (1) cross-lingual event-centered news clustering, (2) cross-lingual document classification, (3) cross-lingual semantic similarity, and (4) cross-lingual information retrieval. We also briefly review several other applications present in the relevant literature, and introduce and illustrate two related modeling concepts: topic smoothing and topic pruning. In summary, this article encompasses the current research in multilingual probabilistic topic modeling. By presenting a series of potential applications, we reveal the importance of the language-independent and language pair independent data representations by means of MuPTM. We provide clear directions for future research in the field by providing a systematic overview of how to link and transfer aspect knowledge across corpora written in different languages via the shared space of latent cross-lingual topics, that is, how to effectively employ learned per-topic word distributions and per-document topic distributions of any multilingual probabilistic topic model in various cross-lingual applications.

Mptm: A Topic Model For Multi-Part Documents

A Multilayer Correlated Topic Model

Mining Coherent Topics in Documents Using Word Embeddings and Large-Scale Text Data

Hierarchical Topic Modeling with Nested Hierarchical Dirichlet Process

Probabilistic Topic Modeling for Comparative Analysis of Document Collections

Multi-environment Topic Models

Analyses of Multi-collection Corpora via Compound Topic Modeling

Statistical Topic Models for Multi-Label Document Classification

Semantic Multi-Grain Mixture Topic Model for Text Analysis.

Representing Mixtures of Word Embeddings with Mixtures of Topic Embeddings

Probabilistic Topic Modeling in Multilingual Settings: an Overview of Its Methodology and Applications.

Multi-modal Multi-view Topic-opinion Mining for Social Event Analysis.

PTM: A Topic Model for the Inferring of the Penalty

A Topic Model for Co-Occurring Normal Documents and Short Texts.

SentTopic-MultiRank: a Novel Ranking Model for Multi-Document Summarization.

A probabilistic graphical model for topic and preference discovery on social media

Online Subset Topic Modeling For Interactive Documents Exploration

Short Text Topic Modeling With Flexible Word Patterns

Modeling Documents with Event Model

A Novel Topic Model for Documents by Incorporating Semantic Relations Between Words

Collaborative Topic Modeling for Text Tensors