Abstract:To help the growing qualitative and quantitative demands for information from the WWW, efficient automatic Web page classifiers are urgently needed. However, a classifier applied to the WWW faces a huge-scale dimensionality problem since it must handle millions of Web pages, tens of thousands of features, and hundreds of categories. When it comes to practical implementation, reducing the dimensionality is a critically important challenge. In this paper, we propose a fuzzy ranking analysis paradigm together with a novel relevance measure, discriminating power measure (DPM), to effectively reduce the input dimensionality from tens of thousands to a few hundred with zero rejection rate and small decrease in accuracy. The two-level promotion method based on fuzzy ranking analysis is proposed to improve the behavior of each relevance measure and combine those measures to produce a better evaluation of features. Additionally, the DPM measure has low computation cost and emphasizes on both positive and negative discriminating features. Also, it emphasizes classification in parallel order, rather than classification in serial order. In our experimental results, the fuzzy ranking analysis is useful for validating the uncertain behavior of each relevance measure. Moreover, the DPM reduces input dimensionality from 10,427 to 200 with zero rejection rate and with less than 5% decline (from 84.5% to 80.4%) in the test accuracy. Furthermore, to consider the impacts on classification accuracy for the proposed DPM, the experimental results of China Time and Reuter-21578 datasets have demonstrated that the DPM provides major benefit to promote document classification accuracy rate. The results also show that the DPM indeed can reduce both redundancy and noise features to set up a better classifier.

Hierarchical Contaminated Web Page Classification Based on Meta Tag Denoising Disposal

Web Page Classification Based on Heterogeneous Features and a Combination of Multiple Classifiers.

A Label Noise Robust Stacked Auto-Encoder Algorithm for Inaccurate Supervised Classification Problems

Two-phase Web Site Classification Based on Hidden Markov Tree Models.

Noise is the Fatal Poison: A Noise-aware Network for Noisy Dataset Classification

A FAST ALGORITHM FOR LARGE SCALE WEB PAGE CLASSIFICATION

Study and System Implementation of Chinese Web-page Classification

An Online Contaminant Classification Method Based on MF-DCCA Using Conventional Water Quality Indicators

Efficient Deep Image Denoising Via Class Specific Convolution

An Efficient Centroid Based Chinese Web Page Classifier

Online Classification Of Contaminants Based On Multi-Classification Support Vector Machine Using Conventional Water Quality Sensors

A classification method for web extraction

Chinese Web-page Classification Study

A Classification Method for Web Information Extraction

An Efficient Centroid Based Chinese Web

A Web Site Mining Algorithm Using the Multiscale Tree Representation Model

A systematic framework to discover pattern for web spam classification

Hierarchically Classifying Chinese Web Documents Without Dictionary Support And Segmentation Procedure

Two novel feature selection approaches for web page classification

A boosted semi-supervised learning framework for web page filtering

An approach for webpage classification based on kinship-relationship knowledge network