Abstract:The massive information on the Web has become an important information source for people. How to extract information from semi structured or unstructured HTML pages receives much attention. However, the original intention of web pages is not to be processed by application automatically, but to be browsed by humans. It is difficult to design a precise web data wrapper with high applicability. Roughly, existing methods can be classified into interactive based wrapper generation and automatically wrapper generation, but the former method lacks applicability while the latter method lacks the precision of extraction. This paper proposes a novel two phase semi automatically precise web extracting method. The method tries to reduce the interactive work in wrapper generation process as much as possible while maintain the precision of extraction result at the same time. In addition, with the increase of extracted web pages, the automaticity in the process will also be improved. Compared with the existing methods, the method proposed in this paper takes both the precision of query result and the applicability of wrapper into account. The method has been validated in authors’ prototype, which has extracted 1,200 thousand web pages successfully.

STUDY AND IMPLEMENTATION OF DYNAMIC WEB INFORMATION EXTRACTION BASED ON TREE MODEL ALGORITHM

Analysis and Implementation of Extraction Algorithm of Web Hierarchy Structure

Web Information Segmentation Method Based on DOM Structure Tree

The Technology of Extracting Content Information from Web Page Based on DOM Tree

Tag Tree Template for Web Information and Schema Extraction.

Automatic Extraction Of Commodity Attributes On Webpages Based On Hierarchical Structure

Content Extraction of Web Pages Based on Characteristic Symbols

Detecting and Monitoring Dynamic Content Blocks of a Web Page by Merging its Historical Versions ∗

Solution for Automatic Web Review Extraction

Application and Design of Web Information Extraction System Based on Pattern Discovery

A Method of Web Information Extraction Based on Classification Algorithm

DOM-Based Automatic Extraction of Topical Information from Web Pages

An Efficient Valid Page Crawling Approach for Websites with Dynamic Scripts

Dynamic web page segmentation method

Dynamic mining for web navigation patterns based on markov model

DeSeA: A Page Segmentation Based Algorithm for Information Extraction

An Internet Information Extracting System Based on Agent Mechanism

HIDDEN WEBPAGE INFORMATION EXTRACTION ALGORITHM USING DOM STATE TRANSFER

System Model of Incremental Spider for the Chinese Web and Its Implementation

Web Data Extraction System Based on Label Library

Ontology-Based Two-Phase Semi-Automatic Web Extracting