Abstract:An ever increasing amount of valuable information is stored in web databases, "hidden" behind search interfaces. A new application area emerge for information retrieval and integration. There may be hundreds or thousands of web databases providing data of relevance to a particular domain on the web. So a primary challenge to internet-scale hidden web database integration is to determine in which web databases to include in the integration system with the aim of making the system contain as much high-quality data as possible and the least degree of overlap. In this paper, we present an approach to iteratively select and integrate candidate web database. The core of this approach is a benefit function that evaluates how much benefit the web database brings to a given status of an integration system by integrating it. We devise a benefit function based on the volume and quality of those new data that added to integration system by integrating the web database. We show in practice how to efficiently apply our approach to select and integrate web database. Our experiments on real hidden web databases indicate that the selected and integrated result of web databases produced by our approach yields an integration system with a significant higher utilities than a wide range of other strategies.

Quality-Based Data Source Selection for Web-Scale Deep Web Data Integration

Ontology-Based Deep Web Data Sources Selection

Data Source Selection for Large-Scale Deep Web Data Integration

DSSM: A Data Sources Selection Model for Deep Web

The Ranking of Deep Web Sources Based on Data Quality

Quality Estimation of Deep Web Data Sources for Data Fusion

Utility Maximization Model for Deep Web Source Selection and Integration.

Data source selection with similar theme in Deep Web integrated system

A Survey of Deep Web Data Integration

Sources Selection Methodology For Hidden Web Data Integration

DEEP WEB DATA SOURCES CLASSIFICATION BASED ON TEXT VSM OF QUERY INTERFACE

Research on Deep Web Classification Based on Domain Feature Text

Ontology-Assisted Deep Web Source Selection

A Quality Estimation Model of Deep Web Data Sources

Data source selection for information integration in big data era

Efficient Quality-Driven Source Selection from Massive Data Sources

Efficient Selection and Integration of Hidden Web Database.

A Deep Web Data Integration System for Book Searching Domain

An Automatic Discovery Technology of Deep Web Data Sources Based on Semantic

Domain-Specific Deep Web Sources Discovery

Efficient Top-k Data Sources Ranking for Query on Deep Web