Open information extraction from the web

Oren Etzioni,Michele Banko,Stephen Soderland,Daniel S. Weld

DOI: https://doi.org/10.1145/1409360.1409378

IF: 22.7

2008-12-01

Communications of the ACM

Abstract:Targeted IE methods are transforming into open-ended techniques.

computer science, theory & methods, software engineering, hardware & architecture

What problem does this paper attempt to address?

OpenUE: an Open Toolkit of Universal Extraction from Text

Ningyu Zhang,Shumin Deng,Zhen Bi,Haiyang Yu,Jiacheng Yang,Mosha Chen,Fei Huang,Wei Zhang,Huajun Chen

DOI: https://doi.org/10.18653/v1/2020.emnlp-demos.1

2020-01-01

Abstract:Natural language processing covers a wide variety of tasks with token-level or sentence-level understandings. In this paper, we provide a simple insight that most tasks can be represented in a single universal extraction format. We introduce a prototype model and provide an open-source and extensible toolkit called OpenUE for various extraction tasks. OpenUE allows developers to train custom models to extract information from the text and supports quick model validation for researchers. Besides, OpenUE provides various functional modules to maintain sufficient modularity and extensibility. Except for the toolkit, we also deploy an online demo(1) with restful APIs to support real-time extraction without training and deploying. Additionally, the online system can extract information in various tasks, including relational triple extraction, slot & intent detection, event extraction, and so on.
A Survey on Neural Open Information Extraction: Current Status and Future Directions

Shaowen Zhou,Bowen Yu,Aixin Sun,Cheng Long,Jingyang Li,Haiyang Yu,Jian Sun,Yongbin Li

DOI: https://doi.org/10.48550/arXiv.2205.11725

2022-05-24

Computation and Language

Abstract:Open Information Extraction (OpenIE) facilitates domain-independent discovery of relational facts from large corpora. The technique well suits many open-world natural language understanding scenarios, such as automatic knowledge base construction, open-domain question answering, and explicit reasoning. Thanks to the rapid development in deep learning technologies, numerous neural OpenIE architectures have been proposed and achieve considerable performance improvement. In this survey, we provide an extensive overview of the-state-of-the-art neural OpenIE models, their key design decisions, strengths and weakness. Then, we discuss limitations of current solutions and the open issues in OpenIE problem itself. Finally we list recent trends that could help expand its scope and applicability, setting up promising directions for future research in OpenIE. To our best knowledge, this paper is the first review on this specific topic.
Open Information Extraction: A Review of Baseline Techniques, Approaches, and Applications

Serafina Kamp,Morteza Fayazi,Zineb Benameur-El,Shuyan Yu,Ronald Dreslinski

2023-10-18

Abstract:With the abundant amount of available online and offline text data, there arises a crucial need to extract the relation between phrases and summarize the main content of each document in a few words. For this purpose, there have been many studies recently in Open Information Extraction (OIE). OIE improves upon relation extraction techniques by analyzing relations across different domains and avoids requiring hand-labeling pre-specified relations in sentences. This paper surveys recent approaches of OIE and its applications on Knowledge Graph (KG), text summarization, and Question Answering (QA). Moreover, the paper describes OIE basis methods in relation extraction. It briefly discusses the main approaches and the pros and cons of each method. Finally, it gives an overview about challenges, open issues, and future work opportunities for OIE, relation extraction, and OIE applications.

Information Retrieval
A Survey on Open Information Extraction from Rule-based Model to Large Language Model (meta)

Pai Liu,Wenyang Gao,Wenjie Dong,Lin Ai,Ziwei Gong,Songfang Huang,Zongsheng Li,Ehsan Hoque,Julia Hirschberg,Yue Zhang

2024-04-26

Abstract:Open Information Extraction (OpenIE) represents a crucial NLP task aimed at deriving structured information from unstructured text, unrestricted by relation type or domain. This survey paper provides an overview of OpenIE technologies spanning from 2007 to 2024, emphasizing a chronological perspective absent in prior surveys. It examines the evolution of task settings in OpenIE to align with the advances in recent technologies. The paper categorizes OpenIE approaches into rule-based, neural, and pre-trained large language models, discussing each within a chronological framework. Additionally, it highlights prevalent datasets and evaluation metrics currently in use. Building on this extensive review, the paper outlines potential future directions in terms of datasets, information sources, output formats, methodologies, and evaluation metrics.

Computation and Language
Transformer Based Network for Open Information Extraction

Jiabao Han,Hongzhi Wang

DOI: https://doi.org/10.1016/j.engappai.2021.104262

IF: 8

2021-01-01

Engineering Applications of Artificial Intelligence

Abstract:Research on Open Information Extraction (Open IE) has made great progress in recent years; it is the task that detects a group of structured, machine-readable statements usually represented in triple form or n-ary relation statements. Open IE is among the core areas of the territory of Natural Language Processing (NLP), and these extractions decompose grammatically complex sentences in a corpus into the relationships they represent, which can be leveraged for various downstream tasks. Even though a lot of work has been done in this direction, there are still many issues with the existing strategies. Most of the previous Open IE systems employ a group of artificially constructed patterns to detect and extract relational tuples from a sentence in a corpus, and these patterns are either automatically learned from annotated training examples or hand-crafted. Such an approach faces some issues, the first is that it requires a lot of manpower. Secondly, they used many NLP tools, therefore, error accumulation in the procedure can negatively impact the results. In this paper, we propose an Open IE approach based on the Transformer architecture. To verify our approach, we make a study using a large and public benchmark dataset, and the experimental results showed that our model achieves a better performance than many existing baselines.
Dave: Extracting Domain Attributes And Values From Text Corpus

Yongxin Shen,Zhixu Li,Wenling Zhang,An Liu,Xiaofang Zhou

DOI: https://doi.org/10.1007/978-3-319-96890-2_35

2018-01-01

Abstract:Open Information Extraction (OpenIE) has been studied extensively, targeting at extracting structured information from free text. In this paper, we work on a novel OpenIE problem defined as Domain-specified Attribute-Value Extraction: Given a text corpus and a domain Knowledge Base (KB) with a number of domain attributes and corresponding attribute values, the task is to extend the KB by identifying more domain attributes and attribute values from the text corpus. Existing solutions adopted from the other OpenIE problems rely heavily on either using deep linguistic parsing or identifying effective lexical patterns. However, linguistic parsing does not always work well especially on short texts, while learning lexical patterns is too strict to reach a high extraction recall. In this paper, we propose an effective graph-based iterative extraction approach based on the cooccurrence between attribute terms and attribute value terms in the same sentences. Our experiments performed on two large real world data collections demonstrate that our method outperforms state-of-the-art approaches in reaching 10% higher extraction precision and recall.
milIE: Modular & Iterative Multilingual Open Information Extraction

Bhushan Kotnis,Kiril Gashteovski,Daniel Oñoro Rubio,Vanesa Rodriguez-Tembras,Ammar Shaker,Makoto Takamoto,Mathias Niepert,Carolin Lawrence

DOI: https://doi.org/10.48550/arXiv.2110.08144

2022-04-26

Abstract:Open Information Extraction (OpenIE) is the task of extracting (subject, predicate, object) triples from natural language sentences. Current OpenIE systems extract all triple slots independently. In contrast, we explore the hypothesis that it may be beneficial to extract triple slots iteratively: first extract easy slots, followed by the difficult ones by conditioning on the easy slots, and therefore achieve a better overall extraction. Based on this hypothesis, we propose a neural OpenIE system, milIE, that operates in an iterative fashion. Due to the iterative nature, the system is also modular -- it is possible to seamlessly integrate rule based extraction systems with a neural end-to-end system, thereby allowing rule based systems to supply extraction slots which milIE can leverage for extracting the remaining slots. We confirm our hypothesis empirically: milIE outperforms SOTA systems on multiple languages ranging from Chinese to Arabic. Additionally, we are the first to provide an OpenIE test dataset for Arabic and Galician.

Computation and Language,Artificial Intelligence
Extracting Objects from the Web.

Zaiqing Nie,Fei Wu,Ji-Rong Wen,Wei-Ying Ma

DOI: https://doi.org/10.1109/ICDE.2006.69

2006-01-01

Abstract:Extracting and integrating object information from the Web is of great significance for Web data management. The existing Web information extraction techniques cannot provide satisfactory solution to the Web object extraction task since objects of the same type are distributed in diverse Web sources, whose structures are highly heterogeneous. In this paper, we propose a novel approach called Object-Level Information Extraction (OLIE) to extract Web objects. This approach extends a classic information extraction algorithm, Conditional Random Fields (CRF), by adding Web-specific information. The experimental results show OLIE can significantly improve the Web object extraction accuracy.
Template-Independent Web Object Extraction

Zaiqing Nie,Fei Wu,Ji-Rong Wen,Wei-Ying Ma

2006-01-01

Abstract:There are various kinds of objects embedded in static Web pages and online Web databases. Extracting and integrating these ob- jects from the Web is of great significance for Web data manage- ment. The existing Web information extraction (IE) techniques cannot provide satisfactory solution to the Web object extraction task since objects of the same type are distributed in diverse Web sources, whose structures are highly heterogeneous. The classic information extraction (IE) methods, which are designed for pro- cessing plain text documents, also fail to meet our requirements. In this paper, we propose a novel approach called Object-Level Information Extraction (OLIE) to extract Web objects. This ap- proach extends a classic IE algorithm, Conditional Random Fields (CRF), by adding Web-specific information. It is essentially a com- bination of Web IE and classic IE. Specifically, visual information on the Web pages is used to select appropriate atomic elements for extraction and also to distinguish attributes, and structured information from external Web databases is applied to assist the extraction process. The experimental results show OLIE can sig- nificantly improve the Web object extraction accuracy.
Open Spatial Information Query Based-on Web Text

Hao Sun,Moe Key

2010-01-01

Abstract:In this paper,language features of spatial information in web texts are firstly analyzed.Then essential methods about online extraction and matching of spatial information and are studied.On the basis of GIS spatial databases,a framework and several methods about expanding the abilities of spatial information query are proposed by keeping data acquisition method in an open style.Related case studies were performed to verify the correctness of the methods.
Efficient Data Learning for Open Information Extraction with Pre-trained Language Models

Zhiyuan Fan,Shizhu He

2024-06-26

Abstract:Open Information Extraction (OpenIE) is a fundamental yet challenging task in Natural Language Processing, which involves extracting all triples (subject, predicate, object) from a given sentence. While labeling-based methods have their merits, generation-based techniques offer unique advantages, such as the ability to generate tokens not present in the original sentence. However, these generation-based methods often require a significant amount of training data to learn the task form of OpenIE and substantial training time to overcome slow model convergence due to the order penalty. In this paper, we introduce a novel framework, OK-IE, that ingeniously transforms the task form of OpenIE into the pre-training task form of the T5 model, thereby reducing the need for extensive training data. Furthermore, we introduce an innovative concept of Anchor to control the sequence of model outputs, effectively eliminating the impact of order penalty on model convergence and significantly reducing training time. Experimental results indicate that, compared to previous SOTA methods, OK-IE requires only 1/100 of the training data (900 instances) and 1/120 of the training time (3 minutes) to achieve comparable results.

Computation and Language,Artificial Intelligence
Generative adversarial networks for open information extraction

Jiabao Han,Hongzhi Wang

DOI: https://doi.org/10.1007/s43674-021-00006-8

2021-01-01

Advances in Computational Intelligence

Abstract:Open information extraction (Open IE) is a core task of natural language processing (NLP). Even many efforts have been made in this area, and there are still many problems that need to be tackled. Conventional Open IE approaches use a set of handcrafted patterns to extract relational tuples from the corpus. Secondly, many NLP tools are employed in their procedure; therefore, they face error propagation. To address these problems and inspired by the recent success of Generative Adversarial Networks (GANs), we employ an adversarial training architecture and name it Adversarial-OIE. In Adversarial-OIE, the training of the Open IE model is assisted by a discriminator, which is a (Convolutional Neural Network) CNN model. The goal of the discriminator is to differentiate the extraction result generated by the Open IE model from the training data. The goal of the Open IE model is to produce high-quality triples to cheat the discriminator. A policy gradient method is leveraged to co-train the Open IE model and the discriminator. In particular, due to insufficient training, the discriminator usually leads to the instability of GAN training. We use the distant supervision method to generate training data for the Adversarial-OIE model to solve this problem. To demonstrate our approach, an empirical study on two large benchmark dataset shows that our approach significantly outperforms many existing baselines.
Information Exploration on the World Wide Web

Xindong Wu,Sameer Pradhan,Jian Chen,Troy Milner,Jason Lowder

DOI: https://doi.org/10.1016/b978-012443895-8/50020-9

2002-01-01

Abstract:Over the past 10 years, the World Wide Web (WWW) has grown exponentially. Commercial sites such as Lycos, Alta Vista, Web Crawler, and many others are search engines that help web users find information on the web. These commercial sites use indexing software agents to index as much of the web as possible. Currently, the web is indexed mainly on its visible information: headings, subheadings, titles, images, metadata, and text. Information retrieval from indexes is usually via one of the search engines, where submission of keywords as a query returns a list of web resources related to the query. A search engine can still easily return a large number of webpages for a single search and it is time consuming for the user to go through the list of pages just to find the information. To address this problem, advanced information exploration with data-mining capacities is a direction for research and development. This chapter introduces the two most popular web browsers: Netscape Communicator and Internet Explorer, and also some leading search engines. It also reviews some research efforts on advanced web-information exploration using data-mining facilities.
Web Information Extraction Via Web Views

Wee Keong Ng,Zehua Liu,Zhao Li,Ee Peng Lim

DOI: https://doi.org/10.4018/978-1-59140-208-4.ch007

2004-01-01

Abstract:With the explosion of information on the Web, traditional ways of browsing and keyword searching of information over web pages no longer satisfy the demanding needs of web surfers. Web information extraction has emerged as an important research area that aims to automatically extract information from target web pages and convert them into a structured format for further processing. The main issues involved in the extraction process include: (1) the definition of a suitable extraction language; (2) the definition of a data model representing the web information source; (3) the generation of the data model, given a target source; and (4) the extraction and presentation of information according to a given data model. In this chapter, we discuss the challenges of these issues and the approaches that current research activities have taken to revolve these issues. We propose several classification schemes to classify existing approaches of information extraction from different perspectives. Among the existing works, we focus on the Wiccap system — a software system that enables ordinary end-users to obtain information of interest in a simple and efficient manner by constructing personalized web views of information sources.
DocOIE: A Document-level Context-Aware Dataset for OpenIE

Kuicai Dong,Yilin Zhao,Aixin Sun,Jung-Jae Kim,Xiaoli Li

DOI: https://doi.org/10.18653/v1/2021.findings-acl.210

2021-01-01

Abstract:Open Information Extraction (OpenIE) aims to extract structured relational tuples (subject, relation, object) from sentences and plays critical roles for many downstream NLP applications. Existing solutions perform extraction at sentence level, without referring to any additional contextual information. In reality, however, a sentence typically exists as part of a document rather than standalone; we often need to access relevant contextual information around the sentence before we can accurately interpret it. As there is no document-level context-aware OpenIE dataset available, we manually annotate 800 sentences from 80 documents in two domains (Healthcare and Transportation) to form a DocOIE dataset for evaluation. In addition, we propose DocIE, a novel document-level context-aware OpenIE model. Our experimental results based on DocIE demonstrate that incorporating document-level context is helpful in improving OpenIE performance. Both DocOIE dataset and DocIE model are released for public.
A Machine Learning Framework for Combined Information Extraction and Integration

Zaiqing Nie,Ji-Rong Wen,Wei‐Ying Ma

2004-01-01

Abstract:There are various kinds of objects embedded in static Web pages and online Web databases. Extracting and integrating these objects from the Web is of great significance for Web data management. The existing Web information extraction (IE) techniques cannot provide satisfactory solution to the Web object extraction task since objects of the same type are distributed in diverse Web sources, whose structures are highly heterogenous. The classic information extraction (IE) methods, which are designed for processing plain text documents, also fail to meet our requirements. In this paper, we propose a novel approach called Object-Level Information Extraction (OLIE) to extract Web objects. This approach extends a classic IE algorithm, Conditional Random Fields (CRF), by adding Web-specific information. It is essentially a combination of Web IE and classic IE. Specifically, visual information on the Web pages is used to select appropriate atomic elements for extraction and also to distinguish attributes, and structured information from external Web databases is applied to assist the extraction process. The experimental results show OLIE can significantly improve the Web object extraction accuracy.
Managing Knowledge on the Web - Extracting Ontology from Html Web

Timon C. Du,Feng Li,Irwin King

DOI: https://doi.org/10.1016/j.dss.2009.02.011

IF: 6.969

2009-01-01

Decision Support Systems

Abstract:In recent years, the Internet has become one of the most important sources of information, and it is now imperative that companies are able to collect, retrieve, process, and manage information from the Web. However, due to the sheer amount of information available, browsing web content by searches using keywords is inefficient, largely because unstructured HTML web pages are written for human comprehension and not for direct machine processing. For the same reason, the degree of web automation is limited. It is recognized that semantics can enhance web automation, but it will take an indefinite amount of effort to convert the current HTML Web into the Semantic Web. This study proposes a novel ontology extractor, called OntoSpider, for extracting ontology from the HTML Web. The contribution of this work is the design and implementation of a six-phase process that includes the preparation, transformation, clustering, recognition, refinement, and revision for extracting ontology from unstructured HTML pages. The extracted ontology provides structured and relevant information for applications such as e-commerce and knowledge management that can be compared and analyzed more effectively. We give detailed information on the system and provide a series of experimental results that validate the system design and illustrate the effectiveness of OntoSpider.
Ontology-Based Information Extraction from Free-Form Text

Ronald Braun

DOI: https://doi.org/10.21236/ada383044

2000-10-06

Abstract:Report developed under SBIR contract. In this Phase I SBIR research we demonstrated the feasibility of an information extraction (IE) system that can leverage semantic representations to significantly increase end-to-end recall for the IE task while maintaining or improving precision. Our end-to-end Ontology-Based IE (OBIE) system combines machine learning techniques with a novel architecture built around a shared domain ontology. This architecture enables interaction between different levels of the IE processing stream simultaneously through the shared ontology. By incorporating hierarchical knowledge in their learning algorithms, IE modules can perform their extraction tasks with greater depth and accuracy. Bootstrapping algorithms were extended to automatically learn the ontology of a new domain, to assist in training the IE components, and to reduce the burden of annotation on the end-user. Broad-coverage and rare-case extraction rules were augmented by classifiers induced from the trained ontology to shore up the precision typically lost by such rules. Performance metrics allow a preliminary characterization of recall and precision gains enabled by the proposed architecture. Our Phase I research and development of a proof-of-concept prototype demonstrated the feasibility and utility of OBIE's ontology-based IE capability and provides a solid foundation for our Phase implementation.
Ontologies and Information Extraction

Claire Nédellec,Adeline Nazarenko

DOI: https://doi.org/10.48550/arXiv.cs/0609137

2006-09-25

Abstract:This report argues that, even in the simplest cases, IE is an ontology-driven process. It is not a mere text filtering method based on simple pattern matching and keywords, because the extracted pieces of texts are interpreted with respect to a predefined partial domain model. This report shows that depending on the nature and the depth of the interpretation to be done for extracting the information, more or less knowledge must be involved. This report is mainly illustrated in biology, a domain in which there are critical needs for content-based exploration of the scientific literature and which becomes a major application domain for IE.

Artificial Intelligence,Information Retrieval
Web-scale extraction of structured data

Michael J. Cafarella,Jayant Madhavan,Alon Halevy

DOI: https://doi.org/10.1145/1519103.1519112

2009-03-20

ACM SIGMOD Record

Abstract:A long-standing goal of Web research has been to construct a unified Web knowledge base. Information extraction techniques have shown good results on Web inputs, but even most domain-independent ones are not appropriate for Web-scale operation. In this paper we describe three recent extraction systems that can be operated on the entire Web (two of which come from Google Research). The TextRunner system focuses on raw natural language text, the WebTables system focuses on HTML-embedded tables, and the deep-web surfacing system focuses on "hidden" databases. The domain, expressiveness, and accuracy of extracted data can depend strongly on its source extractor; we describe differences in the characteristics of data produced by the three extractors. Finally, we discuss a series of unique data applications (some of which have already been prototyped) that are enabled by aggregating extractedWeb information.

Open information extraction from the web

OpenUE: an Open Toolkit of Universal Extraction from Text

A Survey on Neural Open Information Extraction: Current Status and Future Directions

Open Information Extraction: A Review of Baseline Techniques, Approaches, and Applications

A Survey on Open Information Extraction from Rule-based Model to Large Language Model (meta)

Transformer Based Network for Open Information Extraction

Dave: Extracting Domain Attributes And Values From Text Corpus

milIE: Modular & Iterative Multilingual Open Information Extraction

Extracting Objects from the Web.

Template-Independent Web Object Extraction

Open Spatial Information Query Based-on Web Text

Efficient Data Learning for Open Information Extraction with Pre-trained Language Models

Generative adversarial networks for open information extraction

Information Exploration on the World Wide Web

Web Information Extraction Via Web Views

DocOIE: A Document-level Context-Aware Dataset for OpenIE

A Machine Learning Framework for Combined Information Extraction and Integration

Managing Knowledge on the Web - Extracting Ontology from Html Web

Ontology-Based Information Extraction from Free-Form Text

Ontologies and Information Extraction

Web-scale extraction of structured data