Abstract:Topic detection aims to discover valuable topics from the massive online news. It can help people to capture what is happening in real world and alleviate the burden of information overload. It also has great significance since the online news is experiencing an explosive growth. Topic detection is typically transformed into a document clustering problem, whose core idea is to cluster news documents that report on the same topic to the same group based on document similarity. Due to the complex structure and long length of news documents, the similarity measurement of news is very challenging. Existing term-based methods represent news documents based on a set of informative keywords in the document with a vector space model (VSM) and then the relationship between documents is calculated by cosine similarity. However, VSM ignores the relationship between words and has sparse semantics, which leads to low precision of topic detection. In recent years, the probabilistic methods and the graph analytical methods have been proposed for topic detection. However, both of them have high time complexity. To cope with these problems, we first present a novel document representation approach based on graphical decomposition, which decomposes each news document into different semantic units and then relationship between the semantic units is constructed to form a capsule semantic graph (CSG). The CSG can retain the relationship between words and alleviate the sparse semantics compared to VSM representation. We next introduce the graph kernel to measure the similarity between the CSGs based on their substructures. Finally, we use an incremental clustering method to cluster the news documents, in which the documents are represented by CSGs and the similarity between documents is calculated by graph kernel. The experiment results on three standard datasets show that our method obtains higher precision, recall and F1 score than several state-of-the-art methods. Moreover, the experiment results on a large news dataset show that our CSG-SM has lower time complexity than probabilistic methods and graph analytical methods. (c) 2021 Elsevier Inc. All rights reserved.

Generating the Theme Overview Based on Clue Chain from Online News

Visual Exploration of Internet News Via Sentiment Score and Topic Models

Topic Clues Extraction of Network News Based on Conditional Random Fields

Generating Breakpoint-based Timeline Overview for News Topic Retrospection.

Discovering Newsworthy Themes from Sequenced Data: A Step Towards Computational Journalism

Exploring the Interactions of Storylines from Informative News Events.

Combining co-clustering with noise detection for theme-based summarization

Unsupervised Story Discovery from Continuous News Streams via Scalable Thematic Embedding

Multimedia News Summarization in Search

Sketch the Storyline with CHARCOAL: A Non-Parametric Approach.

Research of Automatic News Summary Report with Topic

CrowdStory

News video event topic analysis based on stories

Summarizing Events from Massive News Reports on the Web

Cross Community News Event Summary Generation Based on Collaborative Ranking

Enhancing news organization for convenient retrieval and browsing

A graphical decomposition and similarity measurement approach for topic detection from online news

Personalized News Recommendation Based on Articles Chain Building

Automatic Online News Issue Construction in Web Environment

KEYWORD AND NAME ENTITY IDENTIFICATION BASED NEWS TOPIC THREAD EXTRACTION

Growing Story Forest Online from Massive Breaking News