Abstract:Document representation is the basis of language modeling. Its goal is to turn natural language text that flows into a structured form that can be stored and processed by a computer. The bag-of-words model is used by most of the text-representation methods that are currently available. And yet, they do not consider how phrases are used in the text, which hurts the performance of tasks that use natural language processing later on. Representing the meaning of text by phrases is a promising area of future research, but it is hard to do well because phrases are organized in a hierarchy and mining efficiency is low. In this paper, we put forward a method called hierarchical text semantic representation using the knowledge graph (HTSRKG), which uses syntactic structure features to find hierarchical phrases and knowledge graphs to improve how phrases are evaluated. First, we use CKY and PCFG to build the syntax tree sentence by sentence. Second, we walk through the parse tree using the hierarchical routing process to obtain the mixed phrase semantics in passages. Finally, the introduction of the knowledge graph improves the efficiency of text semantic extraction and the accuracy of text representation. This gives us a solid foundation for tasks involving natural language processing that come after. Extensive testing on actual datasets shows that HTSRKG surpasses baseline approaches with respect to text semantic representation, and the results of a recent benchmarking study support this.

A Phrase-Based Method For Hierarchical Clustering Of Web Snippets

Analysis and Implementation of Extraction Algorithm of Web Hierarchy Structure

An online clustering algorithm for Chinese web snippets based on Generalized Suffix Array

Learning to Cluster Web Search Results.

Hierarchical Topic Mining via Joint Spherical Tree and Text Embedding

Efficient Phrase-Based Document Similarity for Clustering

Web Search Clustering and Labeling with Hidden Topics

Suffix Tree Based Label Generation Method for Web Search Results Clustering

Clustering Web Search Results Using Semantic Information

Concept chain based text clustering

ISTC: A New Method for Clustering Search Results

An efficient clustering algorithm for large-scale topical web pages.

PCCS：A FAST CLUSTERING AND CLASSIFICATION METHOD FOR WEB DOCUMENT

On Combining Link and Contents Information for Web Page Clustering

Clustering to Find Exemplar Terms for Keyphrase Extraction.

Improving XML Search by Generating and Utilizing Informative Result Snippets

Web Documents Clustering with Interest Links

Web page clustering enhanced by summarization.

A New Suffix Tree Similarity Measure for Document Clustering

Hierarchical Clustering of WWW Image Search Results Using Visual, Textual and Link Information

Knowledge Graph-Based Hierarchical Text Semantic Representation