Abstract:Topic modelling is a machine learning technique that is extensively used in Natural Language Processing (NLP) applications to infer topics within unstructured textual data. Latent Dirichlet Allocation (LDA) is one of the most used topic modeling techniques that can automatically detect topics from a huge collection of text documents. However, the LDA-based topic models alone do not always provide promising results. Clustering is one of the effective unsupervised machine learning algorithms that are extensively used in applications including extracting information from unstructured textual data and topic modeling. A hybrid model of Bidirectional Encoder Representations from Transformers (BERT) and Latent Dirichlet Allocation (LDA) in topic modeling with clustering based on dimensionality reduction have been studied in detail. As the clustering algorithms are computationally complex, the complexity increases with the higher number of features, the PCA, t-SNE and UMAP based dimensionality reduction methods are also performed. Finally, a unified clustering-based framework using BERT and LDA is proposed as part of this study for mining a set of meaningful topics from the massive text corpora. The experiments are conducted to demonstrate the effectiveness of the cluster-informed topic modeling framework using BERT and LDA by simulating user input on benchmark datasets. The experimental results show that clustering with dimensionality reduction would help infer more coherent topics and hence this unified clustering and BERT-LDA based approach can be effectively utilized for building topic modeling applications.

Web Service Clustering Method Based on Word Vector and Biterm Topic Model

An Intelligent Web Service Discovery Framework Based on Improved Biterm Topic Model

Document Clustering Based on Probabilistic Topic Model

A Web service clustering method based on topic enhanced Gibbs sampling algorithm for the Dirichlet Multinomial Mixture model and service collaboration graph

A Web Service Clustering Method Based on Semantic Similarity and Multidimensional Scaling Analysis

A Method to Enhance Web Service Clustering by Integrating Label-Enhanced Functional Semantics and Service Collaboration

Clustering Web Services to Facilitate Service Discovery

Exploiting User Tagging for Web Service Co-Clustering.

WTCluster: utilizing tags for web services clustering

Wt-Lda: User Tagging Augmented Lda For Web Service Clustering

Semantic Web Service Discovery Based on LDA Clustering.

Performance Evaluation of Semantic Approaches for Automatic Clustering of Similar Web Services

Co-Clustering WSDL Documents to Bootstrap Service Discovery

Short Text Topic Modeling With Flexible Word Patterns

Modeling over Short Texts

A Linguistic Feature Based Text Clustering Method.

bi-directional Bayesian probabilistic model based hybrid grained semantic matchmaking for Web service discovery

An integrated clustering and BERT framework for improved topic modeling

An Evaluation on Feature Selection for Text Clustering

CDW: A Text Clustering Model for Diverse Versions Discovery.

CS-BTM: a semantics-based hot topic detection method for social network