Abstract:Text clustering aims to organize a vast collection of documents into meaningful and coherent clusters, thereby facilitating the extraction of valuable insights. While current frameworks for text clustering try to minimize the anisotropy of pre-trained language models through contrastive learning of text embeddings, the approach of treating in-batch samples as negatives is suboptimal. The K-means algorithm offers a way to sample both hard negatives and false negatives. However, relying solely on a single measure of semantic similarity between distributions and using coarse-grained weighting for negative pairs may potentially limit performance. Furthermore, considering the very similar distribution in text clusters due to rich semantics, the Mahalanobis distance-based Gaussian Mixture Model (GMM) is prone to falling into local optima due to one Gaussian model, having a smaller weight, may gradually merging into another during the parameter evaluation by the EM algorithm. To tackle these challenges, we propose a model named JourTC: Jo int u nsupervised contrastive learning and r obust GMM for T ext C lustering. In the contrastive learning phase, hard negatives, potential false negatives, and their corresponding global similarity-aware weights are determined through posterior probabilities derived from a Robust GMM (RGMM). This RGMM utilizes the entropy of each individual Gaussian model as a metric and adaptively adjusts the posterior probabilities of samples based on the Gaussian models with both maximum and minimum entropy to diminish the influence of low-entropy Gaussian models. Extensive experiments have shown that JourTC can be seamlessly integrated into existing text clustering frameworks, leading to a notable improvement in accuracy. Our code is publicly available. 1

Pseudo-Supervised Approach for Text Clustering Based on Consensus Analysis

Neural Text Clustering with Document-Level Attention Based on Dynamic Soft Labels

Selective Pseudo-label Clustering

An end-to-end Neural Network Framework for Text Clustering

Weakly-Supervised Neural Text Classification

Collaborative Decision-Reinforced Self-Supervision for Attributed Graph Clustering

An Unsupervised Learning Short Text Clustering Method

Pseudo-supervised Deep Subspace Clustering

Graph Contrastive Learning via Cluster-refined Negative Sampling for Semi-supervised Text Classification

Deep Learning with Nonparametric Clustering

Neural Text Classification by Jointly Learning to Cluster and Align

Research on Neural Network Clustering Algorithm for Short Text

A Small-Sample Text Classification Model Based on Pseudo-Label Fusion Clustering Algorithm

Boosting Pseudo-Labeling With Curriculum Self-Reflection for Attributed Graph Clustering

TeC: A Novel Method for Text Clustering with Large Language Models Guidance and Weakly-Supervised Contrastive Learning

Few-Shot Text Classification with Edge-Labeling Graph Neural Network-Based Prototypical Network.

Grouped Text Clustering Using Non-Parametric Gaussian Mixture Experts

Toward Effective Semi-supervised Node Classification with Hybrid Curriculum Pseudo-labeling

Joint unsupervised contrastive learning and robust GMM for text clustering

Using Clustering Analysis to Improve Semi-Supervised Classification.