Abstract:Online databases maintain a collection of structured domain-specific documents dynamically generated in response to users' queries instead of being accessed by static URLs. Categorizing deep webs according to their object domains is a critical step to integrate such sources. While existing methods focus on supervised or post-query methodologies, we propose a more practical pre-query algorithm operating in an unsupervised manner. Given the domain number, our two phase approach firstly investigates the hidden domain distribution for each query form using topic models and each query form's object domain can be identified preliminarily. In this phase, we construct our training set composing the query forms deemed to have already been categorized correctly, and beside, the deep webs needed to be reclassified are also selected in this phase. In the second phase, we train a classifier with String Kernel methods to reclassify the uncertain deep webs to improve the overall performance. The advantage of our algorithm over previous ones is that we capture the semantic structure for each query form. Based on the two phase architecture, our framework works in an unsupervised manner and achieves satisfactory results. Experiments on the TEL-8 dataset from the UIUC Web integration repository1 show the effectiveness and efficiency of our algorithm.

Automatic Identifying Query Interfaces of Deep Web Based on Preclassification-Svm

DEEP WEB DATA SOURCES CLASSIFICATION BASED ON TEXT VSM OF QUERY INTERFACE

Research on Deep Web Classification Based on Domain Feature Text

Effective Approach to Deep Web Entries Identification

Attributes extraction of Deep Web query interface based on DOM

A Feature-Weighted Instance-Based Learner for Deep Web Search Interface Identification

Research on detecting and classifying Deep Web interfaces

Efficient SVM Chinese Web Page Classifier Based on Pre-Classification

A Machine Learning Approach Classification of Deep Web Sources

Study on Chinese Web Page Classification Based on SVM

Web Document Classification Based on Svm

Deep Web Search Interface Identification: A Semi-Supervised Ensemble Approach

Effective Schema Extraction of Query Interfaces on the Deep Web

Understanding the Search Interfaces of the Deep Web Based on Domain Model

Integration of Query Interfaces for Deep Web Databases

Combining Topic Models and String Kernel for Deep Web Categorization

Semi-automatic Algorithem Based on Web Service Classification

Focused Deep Web Entrance Crawling by Form Feature Classification

An SVM-based machine learning method for accurate internet traffic classification

Research on Deep Web Interface Querying for E-Travel Domain

Semi-automatic Web Service Classification Using Machine Learning