Abstract:Sentence clustering plays a central role in various text-processing activities and has received extensive attention for measuring semantic similarity between compared sentences. However, relatively little focus has been placed on evaluating clustering performance using available similarity measures that adopt low-dimensional continuous representations. Such representations are crucial in domains like sentence clustering, where traditional word co-occurrence representations often achieve poor results when clustering semantically similar sentences that share no common words. This article presents a new implementation that incorporates a sentence similarity measure based on the notion of embedding representation for evaluating the performance of three types of text clustering methods: partitional clustering, hierarchical clustering, and fuzzy clustering, on standard textual datasets. This measure derives its semantic information from pre-training models designed to simulate human knowledge about words in natural language. The article also compares the performance of the used similarity measure by training it on two state-of-the-art pre-training models to investigate which yields better results. We argue that the superior performance of the selected clustering methods stems from their more effective use of the semantic information offered by this embedding-based similarity measure. Furthermore, we use hierarchical clustering, the best-performing method, for a text summarization task and report the results. The implementation in this article demonstrates that incorporating the sentence embedding measure leads to significantly improved performance in both text clustering and text summarization tasks.

An Incremental Algorithm of Text Clustering Based on Semantic Sequences

An incremental clustering algorithm based on semantic concepts

A Novel Text Clustering Algorithm Based on Inner Product Space Model of Semantic

Semantic Sequence Kin: A Method of Document Copy Detection

Clustering Text Data Streams

Document Clustering Based on Semantic Smoothing Approach

Clustering Massive Text Data Streams by Semantic Smoothing Model

A Clustering Algorithm for Short Documents Based On Concept Similarity

Cluseq: Efficient And Effective Sequence Clustering

FICW: Frequent Itemset Based Text Clustering with Window Constraint

Clustering-based Semantic Retrieval Algorithm

Feature Dimension Reduction Short Text Clustering Combined with Semantic and Statistics

Text Clustering Based on Asymmetric Similarity

Semantic Correlation Network Based Text Clustering

Algorithm and Experiment Research of Textual Document Clustering Based on Improved K-means

Semantic Smoothing for Model-based Document Clustering

Improved GA-based Text Clustering Algorithm

Discriminating Subsequence Discovery for Sequence Clustering

Text Stream Clustering Algorithm Based on Adaptive Feature Selection.

Experimental study on short-text clustering using transformer-based semantic similarity measure

A Text Clustering Algorithm Using an Online Clustering Scheme for Initialization