Abstract:Sentence clustering plays a pivotal role in theme-based summarization, which discovers topic themes defined as the clusters of highly related sentences to avoid redundancy and cover more diverse information. As the length of sentences is short and the content it contains is limited, the bag-of-words cosine similarity traditionally used for document clustering is no longer suitable. Special treatment for measuring sentence similarity is necessary. In this article, we study the sentence-level clustering problem. After exploiting concept- and context-enriched sentence vector representations, we develop two co-clustering frameworks to enhance sentence-level clustering for theme-based summarization—integrated clustering and interactive clustering—both allowing word and document to play an explicit role in sentence clustering as independent text objects rather than using word or concept as features of a sentence in a document set. In each framework, we experiment with two-level co-clustering (i.e., sentence-word co-clustering or sentence-document co-clustering) and three-level co-clustering (i.e., document-sentence-word co-clustering). Compared against concept- and context-oriented sentence-representation reformation, co-clustering shows a clear advantage in both intrinsic clustering quality evaluation and extrinsic summarization evaluation conducted on the Document Understanding Conferences (DUC) datasets. (Xiaoyan Cai is now at College of Information Engineering, Northwest A&F University.)

Extended Strategies For Document Clustering With Word Co-Occurrences

Enriching Document Representation with the Deviations of Word Co-occurrence Frequencies

Coupled Term-Term Relation Analysis for Document Clustering

Mining Coherent Topics in Documents Using Word Embeddings and Large-Scale Text Data

Document Clustering Method Based on Frequent Co-occurring Words.

Joint Probability Consistent Relation Analysis for Document Representation.

Sparse Poisson coding for high dimensional document clustering

Enhancing sentence-level clustering with integrated and interactive frameworks for theme-based summarization

A comparative study of feature weighting methods for document co-clustering.

Enhancing diversity and coverage of document summaries through subspace clustering and clustering-based optimization

A Practical Algorithm for Solving the Sparseness Problem of Short Text Clustering

Document Clustering Based on Word Sense Cluster

Co-Clustering With Manifold And Double Sparse Representation

Word Embedding of Dimensionality Reduction for Document Clustering

Regularized bi-directional co-clustering

A Statistics-Based Semantic Relation Analysis Approach For Document Clustering

A feature selection algorithm for document clustering based on word co-occurrence frequency

Enhancing sentence-level clustering with ranking-based clustering framework for theme-based summarization

A Semantic approach for effective document clustering using WordNet

Combining co-clustering with noise detection for theme-based summarization

A Clustering Algorithm for Short Documents Based On Concept Similarity