Abstract:Extracting keywords from a text set is an important task. Most of the previous studies extract keywords from a single text. Using the key topics in the text collection, the association relationship between the topic and the topic in the cross-text, and the association relationship between the words and the words in the cross-text has not played an important role in the previous method of extracting keywords from the text collection. In order to improve the accuracy of extracting keywords from text collections, using the semantic relationship between topics and topics in texts and highlighting the semantic relationship between words and words under the key topics, this article proposes an unsupervised method for mining keywords from short text collections. In this method, a two level semantic association model is used to link the semantic relations between topics and the semantic relations between words, and extract the key words based on the combined action. First, the text is represented with LDA; the authors used word2vec to calculate the semantic association between topic and topic, and build a semantic relation graph between topics, that is the upper level graph, and use a graph ranking algorithm to calculate each topic score. In the lower layer, the semantic association between words and words is calculated by using the topic scores and the relationship between topics in the upper network allow a graph to be constructed. Using a graph sorting algorithm sorts the words in short text sets to determine the keywords. The experimental results show that the method is better for extracting keywords from the text set, especially in short articles. In the text, the important topics, the relationship between topics and the correlation between words can improve the accuracy of extracting keywords from the text set.

Research on Topic Oriented Search Engine Based on Data Mining Technology

Query Subtopic Mining Via Subtractive Initialization of Non-negative Sparse Latent Semantic Analysis

Research on Web Mining Technique Facing Electronic Business and Application

Information Retrieval System Based on Data Warehouse and Data Mining Technology

Design and Implementation of Domain-Oriented Intelligent Searchengine

Topic Detection Technology for Chinese Text Based on Statistics and Semantic Information

Mining Subtopics from Text Fragments for a Web Query

Research on social network based on meta-search engine

A Research of Data Mining Technologies on Web Search

Mining Keywords from Short Text Based on LDA-Based Hierarchical Semantic Graph Model.

Research and Design of Information Retrieval System Based on Web Data Mining

Research of Vertical Search Engine Incorporating with Ontology Filtering and Text Mining

Multi-Dimension Topic Mining Based on Hierarchical Semantic Graph Model

Mining Query Subtopics from Search Log Data

TopicMine: User-Guided Topic Mining by Category-Oriented Embedding

Image annotation using search and mining technologies.

A Cluster-based Approach on Mining Text Preference

Mechanism of Automatic Extraction and Similar Retrieval for Chinese Texts

Intelligent Chinese Web Search Engines for Special Topics

Research of Semantic Web Mining

Towards Next Generation Web Information Retrieval