Abstract:Classifying the same event reported by different countries is of significant importance for public opinion control and intelligence gathering. Due to the diverse types of news, relying solely on transla-tors would be costly and inefficient, while depending solely on translation systems would incur considerable performance overheads in invoking translation interfaces and storing translated texts. To address this issue, we mainly focus on the clustering problem of cross-lingual news. To be specific, we use a combination of sentence vector representations of news headlines in a mixed semantic space and the topic probability distributions of news content to represent a news article. In the training of cross-lingual models, we employ knowledge distillation techniques to fit two semantic spaces into a mixed semantic space. We abandon traditional static clustering methods like K-Means and AGNES in favor of the incremental clustering algorithm Single-Pass, which we further modify to better suit cross-lingual news clustering scenarios. Our main contributions are as follows: (1) We adopt the English standard BERT as the teacher model and XLM-Roberta as the student model, training a cross-lingual model through knowledge distillation that can represent sentence-level bilingual texts in both Chinese and English. (2) We use the LDA topic model to represent news as a combina-tion of cross-lingual vectors for headlines and topic probability distributions for con-tent, introducing concepts such as topic similarity to address the cross-lingual issue in news content representation. (3) We adapt the Single-Pass clustering algorithm for the news context to make it more applicable. Our optimizations of Single-Pass include ad-justing the distance algorithm between samples and clusters, adding cluster merging operations, and incorporating a news time parameter.

CLGVSM: Adapting Generalized Vector Space Model to Cross-lingual Document Clustering.

Cross-Lingual Document Clustering Based on Similarity Space Model

Document Representation with Statistical Word Senses in Cross-Lingual Document Clustering

Inducing Word Senses for Cross-lingual Document Clustering

Generalized Clustering and Multi-Manifold Learning with Geometric Structure Preservation

Learning Explicit and Implicit Latent Common Spaces for Audio-Visual Cross-Modal Retrieval

Semantic smoothing of document models for agglomerative clustering

Research on Multilingual News Clustering Based on Cross-Language Word Embeddings

Regularized clustering for documents.

GraphVL: Graph-Enhanced Semantic Modeling via Vision-Language Models for Generalized Class Discovery

Exploring LDA-Based Document Model for Geographic Information Retrieval

Multimodal LLM Enhanced Cross-lingual Cross-modal Retrieval

Cross-modal Contrastive Learning for Generalizable and Efficient Image-text Retrieval

Text-Video Retrieval with Global-Local Semantic Consistent Learning

Unsupervised Cross-view Subspace Clustering via Adaptive Contrastive Learning

Improving Multilingual Models with Language-Clustered Vocabularies

CLIP-GCD: Simple Language Guided Generalized Category Discovery

Joint unsupervised contrastive learning and robust GMM for text clustering

Visual-Text Cross Alignment: Refining the Similarity Score in Vision-Language Models

Cross-Lingual Mixture Model for Sentiment Classification.

Semantic Smoothing for Model-based Document Clustering