Abstract:Most classification algorithms are best at categorizing the Web documents into a few categories, such as the top two levels in the Open Directory Project. Such a classification method does not give very detailed topic-related class information for the user because the first two levels are often too coarse. However, classification on a large-scale hierarchy is known to be intractable for many target categories with cross-link relationships among them. In this paper, we propose a novel deep-classification approach to categorize Web documents into categories in a large-scale taxonomy. The approach consists of two stages: a search stage and a classification stage. In the first stage, a category-search algorithm is used to acquire the category candidates for a given document. Based on the category candidates, we prune the large-scale hierarchy to focus our classification effort on a small subset of the original hierarchy. As a result, the classification model is trained on the small subset before being applied to assign the category for a new document. Since the category candidates are sufficiently close to each other in the hierarchy, a statistical-language-model based classifier using n-gram features is exploited. Furthermore, the structure of the taxonomy can be utilized in this stage to improve the performance of classification. We demonstrate the performance of our proposed algorithms on the Open Directory Project with over 130,000 categories. Experimental results show that our proposed approach can reach 51.8% on the measure of Mi-F1 at the 5th level, which is 77.7% improvement over top-down based SVM classification algorithms.

A FAST ALGORITHM FOR LARGE SCALE WEB PAGE CLASSIFICATION

Web Page Classification Based on Heterogeneous Features and a Combination of Multiple Classifiers.

Automatic Fast Classification of Product-Images with Class-Specific Descriptor

An Efficient Centroid Based Chinese Web Page Classifier

Predicting Web Page Performance Level Based on Web Page Characteristics

An Efficient Centroid Based Chinese Web

A multiclass classification framework for document categorization

A class-feature-centroid classifier for text categorization

Web document classifier design based on fast classification network

Fast text categorization based on collaborative work in the semantic and class spaces

CUCS: A Web Page Classification Algorithm for Large Training Set

Collaborative Work with Linear Classifier and Extreme Learning Machine for Fast Text Categorization

An experimental study on large-scale web categorization.

Deep Classification in Large-Scale Text Hierarchies

UPCA: an Efficient URL-Pattern Based Algorithm for Accurate Web Page Classification.

Locality Sensitive Hashing Based Service Classification

Study on Chinese Web Page Classification Based on SVM

Design and Implementation of Web Page Classification Tool Based on Word Vector.

PCCS：A FAST CLUSTERING AND CLASSIFICATION METHOD FOR WEB DOCUMENT

Web Document Classification Techniques

A New Method of Class Centriod Vectors Classification Based on the Feedback