Abstract:A major computational burden, while performing document clustering, is the calculation of similarity measure between a pair of documents. Similarity measure is a function that assigns a real number between 0 and 1 to a pair of documents, depending upon the degree of similarity between them. A value of zero means that the documents are completely dissimilar whereas a value of one indicates that the documents are practically identical. Traditionally, vector-based models have been used for computing the document similarity. The vector-based models represent several features present in documents. These approaches to similarity measures, in general, cannot account for the semantics of the document. Documents written in human languages contain contexts and the words used to describe these contexts are generally semantically related. Motivated by this fact, many researchers have proposed seman-tic-based similarity measures by utilizing text annotation through external thesauruses like WordNet (a lexical database). In this paper, we define a semantic similarity measure based on documents represented in topic maps. Topic maps are rapidly becoming an industrial standard for knowledge representation with a focus for later search and extraction. The documents are transformed into a topic map based coded knowledge and the similarity between a pair of documents is represented as a correlation between the common patterns (sub-trees). The experimental studies on the text mining datasets reveal that this new similarity measure is more effective as compared to commonly used similarity measures in text clustering.

Study on Topic Partition Based on Sequential Paragraphic Similarity

Study on Topic Partition in Automatic Abstracting System

Text structure partition for automatic summarization

An adaptive method for text domain similarity calculation

An automatic approach for efficient text segmentation

A Topic Partition Algorithm Based on Average Sentence Similarity for Interactive Text

Topic Decomposition and Summarization.

Topic Modeling Based Text Summarization Approach

Research on Text Segmentation Based on Topic Analysis

Research on Automatic Summarization Based on Rules and Statistics for Chinese Texts

Topic Analysis for Topic-Focused Multi-Document Summarization

Subtopic-based Multi-Document Summarization

Automatic Text Summarization Based on Word Order

Document Similarity for Texts of Varying Lengths via Hidden Topics

Multi-documents Automatic Abstracting Based on Text Clustering and Semantic Analysis

Multi-Document Automatic Summarization Based on the Hierarchical Topics

A Semi-Structured Document Model for Text Mining.

Research on the Text Similarity Algorithms in Automatic Scoring of Subjective Questions

Beyond topical similarity: a structural similarity measure for retrieving highly similar documents

An improved semantic similarity measure for document clustering based on topic maps

Paragraph Vector Based Topic Model for Language Model Adaptation.