Abstract:One of the key obstacles in making learning protocols realistic in applications is the need to supervise them, a costly process that often requires hiring domain experts. We consider the framework to use the world knowledge as indirect supervision. World knowledge is general-purpose knowledge, which is not designed for any specific domain. Then the key challenges are how to adapt the world knowledge to domains and how to represent it for learning. In this paper, we provide an example of using world knowledge for domain dependent document clustering. We provide three ways to specify the world knowledge to domains by resolving the ambiguity of the entities and their types, and represent the data with world knowledge as a heterogeneous information network. Then we propose a clustering algorithm that can cluster multiple types and incorporate the sub-type information as constraints. In the experiments, we use two existing knowledge bases as our sources of world knowledge. One is Freebase, which is collaboratively collected knowledge about entities and their organizations. The other is YAGO2, a knowledge base automatically extracted from Wikipedia and maps knowledge to the linguistic knowledge base, WordNet. Experimental results on two text benchmark datasets (20newsgroups and RCV1) show that incorporating world knowledge as indirect supervision can significantly outperform the state-of-the-art clustering algorithms as well as clustering algorithms enhanced with world knowledge features.

Research on Chinese Document Dynamic Clustering Under Controlled Vocabularies

Document Clustering Based on Probabilistic Topic Model

Chinese Documents Categorization Based on N-gram Information

Adaptive encoding-based evolutionary approach for Chinese document clustering

A Clustering Algorithm for Short Documents Based On Concept Similarity

Multi-documents Automatic Abstracting Based on Text Clustering and Semantic Analysis

Influence of Part-of-Speech on Chinese and English Document Clustering

Chinese Document Categorization without Dictionary Support and Segmentation Processing

Constrained Coclustering for Textual Documents.

Regularized clustering for documents.

Chinese Documents Classification Based on N-Grams

World Knowledge as Indirect Supervision for Document Clustering

A VECTOR SPACE MODEL BASED DOCUMENT CLASSIFICATION SYSTEM [J]

CDW: A Text Clustering Model for Diverse Versions Discovery.

English-Chinese Corpus Collection and Artificial Intelligence Translation Based on Dynamic Clustering Model

A CHINESE DOCUMENT CATEGORIZATION SYSTEM WITHOUT DICTIONARY SUPPORT AND SEGMENTATION PROCESSING

Towards effective document clustering: A constrained K-means based approach

CLGVSM: Adapting Generalized Vector Space Model to Cross-lingual Document Clustering.

Topic-driven Clustering for Document Datasets

Concept chain based text clustering

Hierarchical Classification of Chinese Documents Based on N-grams