Abstract:Short text clustering is a significant yet challenging task, where short texts generated from the Internet are extremely sparse, noisy, and ambiguous. The sparse nature makes traditional clustering methods, e.g., k-means family and topic modeling, much less effective. Fortunately, recent arts of document distance, e.g., word mover’s distance, and document representation, e.g., BERT, can accurately measure the similarities of short texts, especially their nearest neighbors. Inspired by those arts and observations, we induce short text clusters by directly factorizing the informative affinity matrix of nearest neighbors into the product of the cluster assignment matrix, following the intuition that neighboring short texts tend to be assigned to the same cluster. However, due to the noisy nature of short texts, many of them can be regarded as outliers or near outliers, resulting in many noisy neighboring similarities within the affinity matrix. To further alleviate this problem, we enhance the affinity matrix factorization by (1) incorporating a sparse noisy matrix to directly capture noisy neighboring similarities and (2) regularizing the cluster assignment matrix by ℓ _2,1 norm to eliminate hard-to-clustering short texts (called pseudo-outliers), so as to indirectly neglect noisy neighboring similarities corresponding to them. After this factorization for pre-clustering, we train a classifier over the resulting clusters and adopt it to assign each pseudo-outlier to one cluster finally. We call this novel clustering method as anomaly-aware symmetric non-negative matrix factorization ( A^2 snmf). Experimental results on benchmark short text datasets demonstrate that A^2 snmf performs very competitively with the existing baseline methods. The code is available at the website https://github.com/wizardbo/A3SNMF_functions .

TCUAP: A Novel Approach of Text Clustering Using Asymmetric Proximity.

Text Clustering Based on Asymmetric Similarity

Semantic Correlation Network Based Text Clustering

Anomaly Aware Symmetric Non-negative Matrix Factorization for Short Text Clustering

A New Fuzzy Text Clustering Method Based On Nonnegative Factor Analysis

Text Clustering with Seeds Affinity Propagation

DIAS: A Disassemble-Assemble Framework for Highly Sparse Text Clustering

Text Clustering Approach Based on Maximal Frequent Term Sets

Text Clustering Via Particle Swarm Optimization

Improved ROCK for text clustering using asymmetric proximity

A Semi-Supervised Text Clustering Based on Strong Classification Features Affinity Propagation

A way for applying conceptual knowledge derived from a traditional dictionary to text clustering

Concept chain based text clustering

Adaptive Centroid-Based Clustering Algorithm for Text Document Data.

Quantum clustering — A novel method for text analysis

Clustering Method Using Hypergraph Models Based on Set Pair Analysis

A Hierarchical Text Clustering Algorithm with Cognitive Situation Dimensions.

A Novel Self-Adaptive Affinity Propagation Clustering Algorithm Based on Density Peak Theory and Weighted Similarity

A Lda-Based Algorithm For Length-Aware Text Clustering

A Linguistic Feature Based Text Clustering Method.

A Practical Algorithm for Solving the Sparseness Problem of Short Text Clustering