Abstract:Sentence clustering plays a central role in various text-processing activities and has received extensive attention for measuring semantic similarity between compared sentences. However, relatively little focus has been placed on evaluating clustering performance using available similarity measures that adopt low-dimensional continuous representations. Such representations are crucial in domains like sentence clustering, where traditional word co-occurrence representations often achieve poor results when clustering semantically similar sentences that share no common words. This article presents a new implementation that incorporates a sentence similarity measure based on the notion of embedding representation for evaluating the performance of three types of text clustering methods: partitional clustering, hierarchical clustering, and fuzzy clustering, on standard textual datasets. This measure derives its semantic information from pre-training models designed to simulate human knowledge about words in natural language. The article also compares the performance of the used similarity measure by training it on two state-of-the-art pre-training models to investigate which yields better results. We argue that the superior performance of the selected clustering methods stems from their more effective use of the semantic information offered by this embedding-based similarity measure. Furthermore, we use hierarchical clustering, the best-performing method, for a text summarization task and report the results. The implementation in this article demonstrates that incorporating the sentence embedding measure leads to significantly improved performance in both text clustering and text summarization tasks.

BOWL: Bag of Word Clusters Text Representation Using Word Embeddings.

Local Word Bag Model for Text Categorization

Taming Wild High Dimensional Text Data with a Fuzzy Lash

Semantic Word Cloud Generation Based on Word Embeddings

Visual Words Refining Exploiting Spatial Co-Occurrence Table

Visual Exploration and Comparison of Word Embeddings.

Analysis of Word Embeddings Using Fuzzy Clustering

Bag-of-Embeddings for Text Classification.

Word2Box: Capturing Set-Theoretic Semantics of Words using Box Embeddings

Enhancing Interpretable Clauses Semantically using Pretrained Word Representation

Discriminative Image Representation for Classification

Concept chain based text clustering

Using Word Embedding for Bio-Event Extraction.

Learning Descriptive Visual Representation by Semantic Regularized Matrix Factorization.

A comparative study for wordnet guided text representation

Study on text representation method based on deep learning and topic information

Building Pair-Wise Visual Word Tree For Efficent Image Re-Ranking

Document Classification with Spherical Word Vectors

Spherical Paragraph Model.

Learning Ordered Word Representations

Experimental study on short-text clustering using transformer-based semantic similarity measure