Abstract:Precise web page classification can be achieved by evaluating features of web pages, and the structural features of web pages are effective complements to their textual features. Various classifiers have different characteristics, and multiple classifiers can be combined to allow classifiers to complement one another. In this study, a web page classification method based on heterogeneous features and a combination of multiple classifiers is proposed. Different from computing the frequency of HTML tags, we exploit the tree-like structure of HTML tags to characterize the structural features of a web page. Heterogeneous textual features and the proposed tree-like structural features are converted into vectors and fused. Confidence is proposed here as a criterion to compare the classification results of different classifiers by calculating the classification accuracy of a set of samples. Multiple classifiers are combined based on confidence with different decision strategies, such as voting, confidence comparison, and direct output, to give the final classification results. Experimental results demonstrate that on the Amazon dataset, 7-web-genres dataset, and DMOZ dataset, the accuracies are increased to 94.2%, 95.4%, and 95.7%, respectively. The fusion of the textual features with the proposed structural features is a comprehensive approach, and the accuracy is higher than that when using only textual features. At the same time, the accuracy of the web page classification is improved by combining multiple classifiers, and is higher than those of the related web page classification algorithms.

Real-time Page Classification Oriented Algorithm on Topic Extraction

Web Page Classification Based on Heterogeneous Features and a Combination of Multiple Classifiers.

Extracting Web Content by Exploiting Multi-Category Characteristics

Exploiting Multi-Category Characteristics and Unified Framework to Extract Web Content

Analysis and Implementation of Extraction Algorithm of Web Hierarchy Structure

Hierarchical Online NMF for Detecting and Tracking Topic Hierarchies in a Text Stream

A Knowledge-Based Semisupervised Hierarchical Online Topic Detection Framework.

A Web Site Mining Algorithm Using the Multiscale Tree Representation Model

An efficient clustering algorithm for large-scale topical web pages.

Web Page Topic Recognition Algorithm based on Ensemble Learning

Tag Tree Template for Web Information and Schema Extraction.

Website Crawling for Specific Topics

DOM-Based Automatic Extraction of Topical Information from Web Pages

A Web Site Representation and Mining Algorithm Using the Multiscale Tree Model

A Predication-Based Approach for Effective Resource Discovery in Topical Web

Towards A Quality-Oriented Real-Time Web Crawler

Two-phase Web Site Classification Based on Hidden Markov Tree Models.

On-Line Topical Importance Estimation: an Effective Focused Crawling Algorithm Combining Link and Content Analysis

A Method of Web Information Extraction Based on Classification Algorithm

Multi-grain hierarchical topic extraction algorithm for text mining

Web Page's Blocks Based Topical Crawler