Abstract:Link analysis algorithms have been extensively used in Web information retrieval. However, current link analysis algorithms generally work on a flat link graph, ignoring the hierarchal structure of the Web graph. They often suffer from two problems: the sparsity of link graph and biased ranking of newly-emerging pages. In this paper, we propose a novel ranking algorithm called Hierarchical Rank as a solution to these two problems, which considers both the hierarchical structure and the link structure of the Web. In this algorithm, Web pages are first aggregated based on their hierarchical structure at directory, host or domain level and link analysis is performed on the aggregated graph. Then, the importance of each node on the aggregated graph is distributed to individual pages belong to the node based on the hierarchical structure. This algorithm allows the importance of linked Web pages to be distributed in the Web page space even when the space is sparse and contains new pages. Experimental results on the .GOV collection of TREC 2003 and 2004 show that hierarchical ranking algorithm consistently outperforms other well-known ranking algorithms, including the PageRank, BlockRank and LayerRank. In addition, experimental results show that link aggregation at the host level is much better than link aggregation at either the domain or directory levels.

Analysis and Implementation of Extraction Algorithm of Web Hierarchy Structure

Automatic Extraction Of Commodity Attributes On Webpages Based On Hierarchical Structure

A Link Structure Based Website Topic Hierarchy Extracting Approach

Categorization and Extraction of Web Pages Based on Hierarchy

Web Information Segmentation Method Based on DOM Structure Tree

Exploiting the Hierarchical Structure for Link Analysis.

Research and Application of Web Topology Structure Extraction Technology

Web topology search based on multithread recursive model

STUDY AND IMPLEMENTATION OF DYNAMIC WEB INFORMATION EXTRACTION BASED ON TREE MODEL ALGORITHM

Web Content Extraction Using Clustering with Web Structure.

Web Page Classification Based on Extracting Hierarchy from Web Site

An approach for deep web interface schema extraction based on hierarchical semantic annotation

An Effective Schema Extraction Algorithm On The Deep Web

Design and Realization of Web-Based Product Structure Tree

An Algorithm on Web Article Automatic Extraction Based on DOM Structure

Tag Tree Template for Web Information and Schema Extraction.

A Method of Web Information Extraction Based on Classification Algorithm

Website Structure Optimization System Model and Algorithms

Extracting Content Structure For Web Pages Based On Visual Representation

Web Content Refining Algorithm Based on Website Topological Information

The Structure Patterns of Web Resources' Hierarchical Organization