Abstract:Topic detection aims to discover valuable topics from the massive online news. It can help people to capture what is happening in real world and alleviate the burden of information overload. It also has great significance since the online news is experiencing an explosive growth. Topic detection is typically transformed into a document clustering problem, whose core idea is to cluster news documents that report on the same topic to the same group based on document similarity. Due to the complex structure and long length of news documents, the similarity measurement of news is very challenging. Existing term-based methods represent news documents based on a set of informative keywords in the document with a vector space model (VSM) and then the relationship between documents is calculated by cosine similarity. However, VSM ignores the relationship between words and has sparse semantics, which leads to low precision of topic detection. In recent years, the probabilistic methods and the graph analytical methods have been proposed for topic detection. However, both of them have high time complexity. To cope with these problems, we first present a novel document representation approach based on graphical decomposition, which decomposes each news document into different semantic units and then relationship between the semantic units is constructed to form a capsule semantic graph (CSG). The CSG can retain the relationship between words and alleviate the sparse semantics compared to VSM representation. We next introduce the graph kernel to measure the similarity between the CSGs based on their substructures. Finally, we use an incremental clustering method to cluster the news documents, in which the documents are represented by CSGs and the similarity between documents is calculated by graph kernel. The experiment results on three standard datasets show that our method obtains higher precision, recall and F1 score than several state-of-the-art methods. Moreover, the experiment results on a large news dataset show that our CSG-SM has lower time complexity than probabilistic methods and graph analytical methods. (c) 2021 Elsevier Inc. All rights reserved.

Topic Detection Based on Group Average Hierarchical Clustering.

Topic Detection Technique Based on Text Mining

News topic detection based on hierarchical clustering and named entity.

A Fast Hierarchical Topic Detection Method

A Topic Detection Approach Through Hierarchical Clustering on Concept Graph

Improved hierarchical topic detection

A graphical decomposition and similarity measurement approach for topic detection from online news

Online topic detection and tracking of financial news based on hierarchical clustering

A Novel Hybrid Clustering Algorithm for Topic Detection on Chinese Microblogging

Research of Automatic Topic Detection Based on Incremental Clustering

Topic Detection for Emergency Events Based on FCM Document Clustering

A spatiotemporal clustering approach improved by topic burstiness for event detection

Topic detection research based on content analysis

A Topic Detection Approach Based on Multi-Level Clustering

Unsupervised Web Topic Detection Using A Ranked Clustering-Like Pattern Across Similarity Cascades

An Online Hot Topics Detection Approach Using the Improved Ant Colony Text Clustering Algorithm

Research on Text Hierarchical Topic Identification Algorithm Based on the Dynamic Diverse Thresholds Clustering

Research on Topic Detection and Tracking for Online News Texts

A New Topic Detection and Tracking Approach Combining Periodic Classification and Single-Pass Clustering

Researching on A Method of Topic Detection Based on Word Correlation Graph

Topic Detection with Hypergraph Partition Algorithm