Web Information Extraction Using Ontology and Rule Expression

张成洪,王向安,古晓洪

DOI: https://doi.org/10.3969/j.issn.1000-3428.2004.05.022

2004-01-01

Abstract:Under Ontology standard, the paper provides a scheme of rules expression based on Perl rules. This solution can effectively extract and integrate information from Web by rules file in this format. It introduces process of implementation.

What problem does this paper attempt to address?

Ontology-Based Information Extraction from Web Sources

周明建,高济,李飞

DOI: https://doi.org/10.3321/j.issn:1003-9775.2004.04.027

2004-01-01

Abstract:Based on the ontology, this paper regards the hierarchy of information to be extracted as the path of information extraction, defines an information item ontology of Web page and automatic creates a construction ontology by parsing the Web page. Using these two ontologies, an approach to semi-automatically generate information extraction rules is presented for efficiently collecting information from Web.
Extraction Rule Language for Web Information Extraction and Integration

Wu Wei,Shengsheng Shi,Yulong Liu,Haitao Wang,Chunfeng Yuan,Yihua Huang

DOI: https://doi.org/10.1109/WISA.2013.21

2013-01-01

Abstract:The Web is the largest data source that contains a lot of valuable information of interests to users or applications. However, how to automatically navigate and extract useful data from web pages is an important issue to study. There have been a number of existing studies on this area. However, most of them do not take enough consideration on complete process of web information extraction and lack of powerful rule expression ability to describe the navigation, extraction and integration rules. In this paper, we study and propose a new web information extraction rule language toward a general model for web information extraction and integration. We first introduce a source data objects to extract different type of web data records. Then we adopt the XML to define the target data entity structure and use scripts to perform target data record integration. The results show that our extraction rule language can provide powerful and flexible ability to describe extraction logic to achieve accurate web data records extraction from complex web pages.
Automatic Web Information Extraction Based On Rules

Fanghuai Hu,Tong Ruan,Zhiqing Shao,Jun Ding

DOI: https://doi.org/10.1007/978-3-642-24434-6_21

2011-01-01

Abstract:Web Information Extraction is the initial step of effective web mining. In this article a few heuristic rules which describe the characteristics of the main content of web pages are summarized. The rules are constructed by some pre-defined terms and metrics, which can be considered as reusable and extensible for different kinds of HTML pages. Afterwards, a probabilistic model which utilizes the rules and metrics is suggested and the corresponding algorithm is implemented. The algorithm is tested on 1000 randomly selected web pages. The experiment shows that the algorithm is more precise and more applicable to the diverse structure of different web sites than other algorithms.
Research on Automated Web Navigation and Data Integration Rules for Web Infor-mation Extraction

Haitao WANG,Zhiliang ZHANG,Yuhua SUN,Chunfeng YUAN,Yihua HUANG

DOI: https://doi.org/10.3778/j.issn.1673-9418.1310017

2014-01-01

Abstract:Web contains large amount of valuable data information. Many Web information extraction techniques have been studied in past decade. However, most of existing studies and systems focus on data extraction processing from acquired Web pages, and ignore or simplify the automated navigation and data integration processes. To solve the problem, this paper proposes a three-stage Web information extraction model including automated navigation, data extraction and data integration. Based on this model, this paper designs a navigation model along with an auto-mated navigation rule language. Furthermore, this paper proposes an ETI (extraction-transformation-integration) model and an integration and workflow control rule language, which can effectively maintain the complex relation-ship for cross-page data record and provide flexible workflow control. Extraction results show that the proposed rule language and the implemented system can effectively achieve Web page navigation and data extraction.
Ontology-based Intelligent Information Extraction System on the Semantic Web

Qian Hong,Li Weihua,Lu Fangguo,Han Guilai

DOI: https://doi.org/10.1109/wcica.2004.1343092

2004-01-01

Abstract:This paper presents an intelligent information extraction system based on ontology on the semantic Web. It describes the kernel architecture of the system, and introduces the formal representation of ontology in detail. It also describes the ontology mapping and ontology evolution process. Lastly, the paper shows the structure of the intelligent information extraction system.
Extracting Information from Ontology-based WEB Table

王放,顾宁,吴国文

DOI: https://doi.org/10.3969/j.issn.1000-1220.2003.12.022

2003-01-01

Abstract:This paper presents a method that extracts information from tables of WEB documents based on ontology. In the extracting information process, the ontology becomes perfection by learning gradually, in the same time the ability of ontology's description is enhanced, and the system's automatic level is improved step by step.
Research and Application of Web Information Retrieval Based on Ontology

Qi Shen,Meng Zhang,Qingming Song,Yan Tang

DOI: https://doi.org/10.2991/iccnce.2013.106

2013-01-01

Abstract:This paper is mainly about the design of web information retrieval module based on ontology, using ontology technology, from the current web service mechanism based on the syntax level raised to the level of knowledge (or concept). First, the paper introduces the concept of the ontology, and then completes the architecture of the web information retrieval module based on ontology, with the technology of information extraction and semantic extension. This technology applies to web information retrieval, providing more accurate, intelligent web information retrieval service for the users, and improve the recall and precision ratio.
Ontology-based Document Extraction Processing

Ning Gu,Fang Wang,Guowen Wu

DOI: https://doi.org/10.1109/cscwd.2002.1047650

2003-01-01

Abstract:It is a key point on how to describe and store Web documents after information extraction in collaborative learning. By presenting definitions of ontology and using ontology-based semantic description, this paper takes elements of extraction documents corresponding to ontology concepts, and uses distance functions to bound both relations, thus the category of table elements is determined.
The Web information extraction technology research based on XML description

Shai Fei,Wang Jia,Pan Chao

2007-01-01

Abstract:The Internet has become the people's access to information, services made one of the important channels. The data’s biggest feature on the Web is of semi-structured. Since the main organization forms of information on the network is HTML format, and HTML Markup Language only describe the manifestations of data, do not describe the meaning and structure . Therefore, the computer can not be automaticly identified. And XML is a kind of semantic -oriented language, its generation provided the conditions to solve this problem, in another words,the latter is better to identified by computer. Therefore this paper analyzed said data extraction process by the identification of XML.
A Rule-Based Information Extraction System for Human-Readable Semi-Structured Scientific Documents

Gang Chen,Baoran An,Sifeng Zeng

DOI: https://doi.org/10.1109/iccsnt.2015.7490711

2015-01-01

Abstract:The explosion of data over the past twenty years has fostered a huge amount of research in processing semi-structured documents like HTML and XML documents on Web. Nevertheless, the explosion of semi-structured documents that originate from outside the Web domain is more challenging. The data of semi-structured documents are everywhere: in scientific research reports, official journals, electronic health records and any records from other domains. Different from HTML and XML, semi-structured record is usually human-readable and has its own internal schema. On account of the incredible increase of data volumes, the traditional methods of studying on these data cannot meet the needs of high performance and flexible access. Relational database technique is a good alternative technique for managing and organizing data. In this paper, we aim at (1) revealing the semantic structure in human-readable scientific records (HSR), and (2) presenting a transformation system that converts HSR into structured relational database. Our approach identifies the relevant logical sub-structures and objects in HSR according to specific templates. We don't target "the best" methods but provide an available framework for facilitating the semi-structured HSR analysis tasks. The evaluation to the system shows its ability to enable the efficient transformation of HSR and therefore contributes to the increasing corpus of semi-structured HSR documents.
Design and Implementation of Domain Ontology for Information Extraction

于江德,李学钰,樊孝忠

DOI: https://doi.org/10.3969/j.issn.1001-0548.2008.05.028

2008-01-01

Abstract:Domain ontology plays an important role in the system of information extraction. In this paper,after a discuss of the relation of domain ontology and information extraction,the design principles and steps of domain ontology in the system of information extraction are proposed. The domain ontology about monitor is implemeneted in a prototype system of information extraction,and the domain ontology is applied to some tasks of information extraction,including named entity recognition,extraction pattern acquisition,and thematic concept extraction. The application results show that the principles and steps are feasible.
Information Extraction Model For Vegetable Products Web Pages Based On Ontology And Dom

Juan Liu,Ming Zhao,Li Kang,Xiaoshuan Zhang

2008-01-01

Abstract:This paper studies information extraction of special domain based on ontology and document object model (DOM). In this paper, we present an ontology-based vegetable information extraction model, which fully considers the features of Web information and Web documents in the field of agricultural vegetable products. Combining ontology and DOM extraction algorithm, it extracts useful information from Web pages in the agricultural Website. The analytical module of document changes Web pages into ruled pages, and then the analytical module of Web pages structure convert pages into the DOM tree. The DOM tree extraction algorithm obtains information from the spots in the DOM tree. In the process of extraction information, domain ontology assists to construct the extraction rules at all times. This information extraction rules are based on the domain ontology and on DOM path through being attached to syntax information and learning samples. It implements information extraction through traveling DOM tree. The main contribution of this paper is to the agricultural vegetable ontology that is composed of the all kinds of vegetable classes and hierarchy relationship of vegetable products classes. The domain ontology is filled with the property of classes and instances reflected in the classes. The model offers a better solution in the information extraction of synonyms to the semantic question and provides the basis for Semantic Information Retrieval of the agricultural products. The test of system shows that the model can extract vegetable products from Web pages and solves the synonymous problem better.
Heterogeneous Deep Web Data Extraction Using Ontology Evolution.

Kerui Chen,Jinchao Zhao,Wanli Zuo,Fengling He,Yongheng Chen

DOI: https://doi.org/10.4156/jcit.vol5.issue8.23

2010-01-01

Abstract:This paper proposed a complex ontology evolution based method of extracting data, and also completely designed an extraction system, which consists of four important components: Resolver, Extractor, Consolidator and the ontology construction components. The system gives priority to the construction of mini-ontology. When the user submits query keywords to the deep web query interface, the returned result will pass through the prior three components; after that, the final execution result will be returned to user in a unified form. This paper adopted an extraction method that is different from the general ontology extraction. More specifically, the ontology used in extraction here is dynamic evolution, which can adapt various data source better. Experimental results proved that this method could effectively extract the data in the query result pages.
Design and Implementation of Ontology-based Information Processing System

Chen Zhuangsheng,QU Yuzhong

DOI: https://doi.org/10.3969/j.issn.1000-3428.2005.11.059

2005-01-01

Abstract:The semantic Web is the W3C’s vision of the next generation Web. Ontology, as an essential element, is very important. Web ontology languages which are used to define and instantiate Web ontologies, especially OWL designed by W3C, will play a crucial role. This paper discusses the design and implementation of an ontology-based information processing system, and analyses the advantages of this system: extensibility, flexibility of query and logically reasoning.
Recognition of Web Page Relation Based on Ontology

FAN Wen-Bin,DING Yan,PAN Jin-Gui

DOI: https://doi.org/10.3969/j.issn.1002-137X.2005.11.011

2005-01-01

Computer Science

Abstract:This paper analyzes semantic relation among large amount of web pages in WWW, which can realize intelli- gent query and provide characteristic services when applied to search engine When recognizing the relation of web pa- ges, this paper realizes the automatic production of rules through relation entity and sample sets defined in Ontology and recognition based on rules. Based on the idea of FOIL and the method of SRV, we reduce the training process of rules when training rules through sample sets. Through regulating and comparing the valve of characteristic selection, we can get the optimization rule sets and simplify the process of judgment when precision is improved.
NET Based Web Information Extraction Method

WANG Wen-Guang,RAN Chun-Yu,WAN Shu-Zhen,WANG Wei,ZENG Gao-Yang

2007-01-01

Abstract:We live in an information society.Each kind of information inflates suddenly.How to get information which the users are interested in is becoming more and more important.This paper introduces a way to extract information from web based on HTTP Request/Response model by using DOM,Regular expression and database technology.
Metadata Extracting for HTML Document Based on Rules

狄涤,周竞扬,潘金贵

DOI: https://doi.org/10.3969/j.issn.1000-3428.2004.09.034

2004-01-01

Abstract:This paper proposes a metadata extracting method for HTML document based on rules. After introducing syntax and semantics of the rules, design of rule library is discussed. Based on the method aforementioned, a system named MEDES(metadata extracting system) is developed, which can perform automatic metadata extraction from HTML documents. The experiment results are evaluated, and the future work are discussed in the end.
Extracting Objects from the Web.

Zaiqing Nie,Fei Wu,Ji-Rong Wen,Wei-Ying Ma

DOI: https://doi.org/10.1109/ICDE.2006.69

2006-01-01

Abstract:Extracting and integrating object information from the Web is of great significance for Web data management. The existing Web information extraction techniques cannot provide satisfactory solution to the Web object extraction task since objects of the same type are distributed in diverse Web sources, whose structures are highly heterogeneous. In this paper, we propose a novel approach called Object-Level Information Extraction (OLIE) to extract Web objects. This approach extends a classic information extraction algorithm, Conditional Random Fields (CRF), by adding Web-specific information. The experimental results show OLIE can significantly improve the Web object extraction accuracy.
Attribute Value Extraction Based on Rule Matching

Yue Han,Weihong Han,Shudong Li,Zhen Wang

DOI: https://doi.org/10.1007/978-981-15-8101-4_10

2020-01-01

Abstract:Faced with the explosive growth of Internet information today, the Internet is full of public opinion information, which contains rich and valuable data and covers a large amount of false information. How to extract key information from the information published on the Internet is the content of this paper. Since the accuracy of the factual information provided by the encyclopedic text on the Internet is higher than other texts, and for the resume text of the character, the encyclopedic knowledge covers a large amount of unstructured information, and the information has high accuracy. The work of this research is based on the knowledge of Chinese network encyclopedia to obtain key information. The main method is to conduct experiments based on the rule matching mode and the method of extracting attribute values by the language technology platform tool of Harbin Institute of Technology. The experimental results prove the feasibility and accuracy of the extraction effect.
Web Information Extraction Via Web Views

Wee Keong Ng,Zehua Liu,Zhao Li,Ee Peng Lim

DOI: https://doi.org/10.4018/978-1-59140-208-4.ch007

2004-01-01

Abstract:With the explosion of information on the Web, traditional ways of browsing and keyword searching of information over web pages no longer satisfy the demanding needs of web surfers. Web information extraction has emerged as an important research area that aims to automatically extract information from target web pages and convert them into a structured format for further processing. The main issues involved in the extraction process include: (1) the definition of a suitable extraction language; (2) the definition of a data model representing the web information source; (3) the generation of the data model, given a target source; and (4) the extraction and presentation of information according to a given data model. In this chapter, we discuss the challenges of these issues and the approaches that current research activities have taken to revolve these issues. We propose several classification schemes to classify existing approaches of information extraction from different perspectives. Among the existing works, we focus on the Wiccap system — a software system that enables ordinary end-users to obtain information of interest in a simple and efficient manner by constructing personalized web views of information sources.

Web Information Extraction Using Ontology and Rule Expression

Ontology-Based Information Extraction from Web Sources

Extraction Rule Language for Web Information Extraction and Integration

Automatic Web Information Extraction Based On Rules

Research on Automated Web Navigation and Data Integration Rules for Web Infor-mation Extraction

Ontology-based Intelligent Information Extraction System on the Semantic Web

Extracting Information from Ontology-based WEB Table

Research and Application of Web Information Retrieval Based on Ontology

Ontology-based Document Extraction Processing

The Web information extraction technology research based on XML description

A Rule-Based Information Extraction System for Human-Readable Semi-Structured Scientific Documents

Design and Implementation of Domain Ontology for Information Extraction

Information Extraction Model For Vegetable Products Web Pages Based On Ontology And Dom

Heterogeneous Deep Web Data Extraction Using Ontology Evolution.

Design and Implementation of Ontology-based Information Processing System

Recognition of Web Page Relation Based on Ontology

NET Based Web Information Extraction Method

Metadata Extracting for HTML Document Based on Rules

Extracting Objects from the Web.

Attribute Value Extraction Based on Rule Matching

Web Information Extraction Via Web Views