Abstract:Latent Dirichlet allocation (LDA) is a popular method for analyzing large text corpora, but it suffers from instability due to its reliance on random initialization. This results in different outcomes for replicated runs, hindering reproducibility. To address this, we introduce LDAPrototype, a new approach for selecting the most representative LDA run from multiple replications on the same dataset. LDAPrototype enhances the reliability of LDA conclusions by ensuring greater similarity between replications compared to traditional LDA runs or models chosen based on perplexity or NPMI. A key feature of LDAPrototype is its use of a novel model similarity measure called S-CLOP (Similarity of multiple sets by Clustering with LOcal Pruning). It is based on topic similarities, for which we compare the usage of measures like the thresholded Jaccard coefficient, cosine similarity, Jensen-Shannon divergence, and rank-biased overlap. The effectiveness of LDAPrototype is demonstrated through its application to six real datasets, including newspaper articles and tweets. The results show improved reproducibility and reliability in topic modeling outcomes. LDAPrototype's approach is noteworthy for its practical applicability, comprehensibility, ease of implementation, and computational efficiency. Furthermore, the algorithm's concept can be generalized to other topic modeling procedures that characterize topics through word distributions, making it a versatile tool in text data analysis.

Algorithms of the LDA model [REPORT]

LDA Revisited

Sparse Hybrid Variational-Gibbs Algorithm for Latent Dirichlet Allocation.

A Spectral Algorithm for Latent Dirichlet Allocation

An Online Inference Algorithm For Labeled Latent Dirichlet Allocation

A More Time-Efficient Gibbs Sampling Algorithm Based on SparseLDA for Latent Dirichlet Allocation

A Fast Algorithm for Posterior Inference with Latent Dirichlet Allocation

LDAPrototype: a model selection algorithm to improve reliability of latent Dirichlet allocation

Labeled Phrase Latent Dirichlet Allocation and Its Online Learning Algorithm

Langevin Autoencoders for Learning Deep Latent Variable Models

WarpLDA: a Simple and Efficient O(1) Algorithm for Latent Dirichlet Allocation.

On Privacy Protection of Latent Dirichlet Allocation Model Training.

Efficient Probabilistic Latent Semantic Analysis with Sparsity Control

Incremental Variational Inference for Latent Dirichlet Allocation

Novel mixture allocation models for topic learning

A Probabilistic Recommendation Method Inspired by Latent Dirichlet Allocation Model

Variable Selection for Latent Dirichlet Allocation

Latent Dirichlet Allocation - An approach for topic discovery

Factor Analysis, Probabilistic Principal Component Analysis, Variational Inference, and Variational Autoencoder: Tutorial and Survey

Latent Variable Modelling Using Variational Autoencoders: A survey

Streaming Gibbs Sampling for LDA Model