Challenges of Structured Reuse Adoption - Lessons Learned

V. Bauer

DOI: https://doi.org/10.1007/978-3-319-26844-6_3

2015-12-02

Abstract:

What problem does this paper attempt to address?

Pattern Based Term Extraction Using ACABIT System

Koichi Takeuchi,Kyo Kageura,Teruo Koyama,Béatrice Daille,Laurent Romary

DOI: https://doi.org/10.48550/arXiv.0907.2452

2009-07-15

Abstract:In this paper, we propose a pattern-based term extraction approach for Japanese, applying ACABIT system originally developed for French. The proposed approach evaluates termhood using morphological patterns of basic terms and term variants. After extracting term candidates, ACABIT system filters out non-terms from the candidates based on log-likelihood. This approach is suitable for Japanese term extraction because most of Japanese terms are compound nouns or simple phrasal patterns.

Computation and Language
An Effective System for Multi-format Information Extraction

Yaduo Liu,Longhui Zhang,Shujuan Yin,Xiaofeng Zhao,Feiliang Ren

DOI: https://doi.org/10.48550/arXiv.2108.06957

2021-08-16

Computation and Language

Abstract:The multi-format information extraction task in the 2021 Language and Intelligence Challenge is designed to comprehensively evaluate information extraction from different dimensions. It consists of an multiple slots relation extraction subtask and two event extraction subtasks that extract events from both sentence-level and document-level. Here we describe our system for this multi-format information extraction competition task. Specifically, for the relation extraction subtask, we convert it to a traditional triple extraction task and design a voting based method that makes full use of existing models. For the sentence-level event extraction subtask, we convert it to a NER task and use a pointer labeling based method for extraction. Furthermore, considering the annotated trigger information may be helpful for event extraction, we design an auxiliary trigger recognition model and use the multi-task learning mechanism to integrate the trigger features into the event extraction model. For the document-level event extraction subtask, we design an Encoder-Decoder based method and propose a Transformer-alike decoder. Finally,our system ranks No.4 on the test set leader-board of this multi-format information extraction task, and its F1 scores for the subtasks of relation extraction, event extractions of sentence-level and document-level are 79.887%, 85.179%, and 70.828% respectively. The codes of our model are available at {https://github.com/neukg/MultiIE}.
Research on Information Extraction:A Survey

李保利,陈玉忠,俞士汶

DOI: https://doi.org/10.3321/j.issn:1002-8331.2003.10.001

2003-01-01

Abstract:The research on Information Extraction aims at providing more powerful information access tools to help people overcome the problem of information overloading. Unlike Information Retrieval, Information Extraction Systems extract factual information directly from natural language texts. In the last decade, Information Extraction has become an important sub-field of Natural Language Processing. Its unique development track, i.e. accelerating research via systematical and large scale evaluation, and some successful experience, such as the effectiveness of partial-parsing techniques and the importance of fast development cycles, have made it a great and most important impetus to the research of NLP in the last decade. Moreover, Information Extraction has built a more effective connection between NLP researchers and NLP system developers. It will be helpful to review the history and investigate the state of the art of Information Extraction.
Extracting linguistic speech patterns of Japanese fictional characters using subword units

Mika Kishino,Kanako Komiya

DOI: https://doi.org/10.48550/arXiv.2203.02632

2022-03-05

Computation and Language

Abstract:This study extracted and analyzed the linguistic speech patterns that characterize Japanese anime or game characters. Conventional morphological analyzers, such as MeCab, segment words with high performance, but they are unable to segment broken expressions or utterance endings that are not listed in the dictionary, which often appears in lines of anime or game characters. To overcome this challenge, we propose segmenting lines of Japanese anime or game characters using subword units that were proposed mainly for deep learning, and extracting frequently occurring strings to obtain expressions that characterize their utterances. We analyzed the subword units weighted by TF/IDF according to gender, age, and each anime character and show that they are linguistic speech patterns that are specific for each feature. Additionally, a classification experiment shows that the model with subword units outperformed that with the conventional method.
Mutual Reinforcement Effects in Japanese Sentence Classification and Named Entity Recognition Tasks

Chengguang Gan,Qinghao Zhang,Tatsunori Mori

2023-07-21

Abstract:Information extraction(IE) is a crucial subfield within natural language processing. However, for the traditionally segmented approach to sentence classification and Named Entity Recognition, the intricate interactions between these individual subtasks remain largely uninvestigated. In this study, we propose an integrative analysis, converging sentence classification with Named Entity Recognition, with the objective to unveil and comprehend the mutual reinforcement effect within these two information extraction subtasks. To achieve this, we introduce a Sentence Classification and Named Entity Recognition Multi-task (SCNM) approach that combines Sentence Classification (SC) and Named Entity Recognition (NER). We develop a Sentence-to-Label Generation (SLG) framework for SCNM and construct a Wikipedia dataset containing both SC and NER. Using a format converter, we unify input formats and employ a generative model to generate SC-labels, NER-labels, and associated text segments. We propose a Constraint Mechanism (CM) to improve generated format accuracy. Our results show SC accuracy increased by 1.13 points and NER by 1.06 points in SCNM compared to standalone tasks, with CM raising format accuracy from 63.61 to 100. The findings indicate mutual reinforcement effects between SC and NER, and integration enhances both tasks' performance. We additionally implemented the SLG framework on single SC task. It yielded superior accuracies compared to the baseline on two distinct Japanese SC datasets. Notably, in the experiment of few-shot learning, SLG framework shows much better performance than fine-tune method. These empirical findings contribute additional evidence to affirm the efficacy of the SLG framework.

Computation and Language
Information Extraction from Resume Documents in PDF Format

Jiaze Chen,Liangcai Gao,Zhi Tang

DOI: https://doi.org/10.2352/issn.2470-1173.2016.17.drr-064

2016-01-01

Abstract:Now more and more people release their resumes through the Internet, and PDF is a wide adopted format of resume documents which contain lots of valuable information for recruitment, personal profile mining, etc. However, only a few studies have been down in this direction. Therefore, this paper focuses on the task–information extraction from resume documents in PDF format, and proposes a hierarchical extraction method. At first, this method segments a page into blocks according to heuristic rules. And then each block is classified by a Conditional Random Field (CRF) model. To take advantage of the structure and layout information of PDF documents, the classification model employs two kinds of features:content-based features and layoutbased features which are parsed from PDF documents. The experimental results show that the effectiveness of the proposed method. Especially, the layout-based features are proved to be very useful for the task, improving more than 20 percent of the average F1-score in the experiments.
Application and Design of Web Information Extraction System Based on Pattern Discovery

蔡霞,张森,周宇

DOI: https://doi.org/10.3969/j.issn.1671-7848.2003.03.011

2003-01-01

Abstract:It gives the rapid growth of public information sources on the World Wide Web, it is increasingly attractive to extract data from these sources. Current W eb sites present information on various topics in various formats. A great amoun t of effort is often required for a user to manually locate and extract useful d ata from the Web sites.A reference architecture based on pattern d iscovery is developed,which applies PAT trees to pattern discovery.The process r eq uires no human intervention and training example. Experimental result shows that it can achieve high extraction rate over popular search engines.
Recognizing Referential Links: An Information Extraction Perspective

Megumi Kameyama

DOI: https://doi.org/10.48550/arXiv.cmp-lg/9707009

1997-07-19

Abstract:We present an efficient and robust reference resolution algorithm in an end-to-end state-of-the-art information extraction system, which must work with a considerably impoverished syntactic analysis of the input sentences. Considering this disadvantage, the basic setup to collect, filter, then order by salience does remarkably well with third-person pronouns, but needs more semantic and discourse information to improve the treatments of other expression types.

Computation and Language
JaMIE: A Pipeline Japanese Medical Information Extraction System

Fei Cheng,Shuntaro Yada,Ribeka Tanaka,Eiji Aramaki,Sadao Kurohashi

DOI: https://doi.org/10.48550/arXiv.2111.04261

2021-11-08

Computation and Language

Abstract:We present an open-access natural language processing toolkit for Japanese medical information extraction. We first propose a novel relation annotation schema for investigating the medical and temporal relations between medical entities in Japanese medical reports. We experiment with the practical annotation scenarios by separately annotating two different types of reports. We design a pipeline system with three components for recognizing medical entities, classifying entity modalities, and extracting relations. The empirical results show accurate analyzing performance and suggest the satisfactory annotation quality, the effective annotation strategy for targeting report types, and the superiority of the latest contextual embedding models.
Discourse in Multimedia: A Case Study in Information Extraction

Mrinmaya Sachan,Kumar Avinava Dubey,Eduard H. Hovy,Tom M. Mitchell,Dan Roth,Eric P. Xing

DOI: https://doi.org/10.48550/arXiv.1811.05546

2018-11-14

Abstract:To ensure readability, text is often written and presented with due formatting. These text formatting devices help the writer to effectively convey the narrative. At the same time, these help the readers pick up the structure of the discourse and comprehend the conveyed information. There have been a number of linguistic theories on discourse structure of text. However, these theories only consider unformatted text. Multimedia text contains rich formatting features which can be leveraged for various NLP tasks. In this paper, we study some of these discourse features in multimedia text and what communicative function they fulfil in the context. We examine how these multimedia discourse features can be used to improve an information extraction system. We show that the discourse and text layout features provide information that is complementary to lexical semantic information commonly used for information extraction. As a case study, we use these features to harvest structured subject knowledge of geometry from textbooks. We show that the harvested structured knowledge can be used to improve an existing solver for geometry problems, making it more accurate as well as more explainable.

Computation and Language
Reference Resolution Using Semantic Patterns in Japanese Newspaper Articles

Takahiro Wakao

DOI: https://doi.org/10.48550/arXiv.cmp-lg/9410021

1994-10-24

Abstract:Reference resolution is one of the important tasks in natural language processing. In this paper, the author first determines the referents and their locations of "dousha", literally meaning "the same company", which appear in Japanese newspaper articles. Secondly, three heuristic methods, two of which use semantic information in text such as company names and their patterns, are proposed and tested on how accurately they identify the correct referents. The proposed methods based on semantic patterns show high accuracy for reference resolution of "dousha" (more than 90\%). This suggests that semantic pattern-matching methods are effective for reference resolution in newspaper articles.

Computation and Language
Configurable Customized Information Extraction and Processing Pipeline

Seok Kim,Pierce Lai,Dariyan Khan,Kevin Zhao,Brian Le,Alex Luchianov,Margaret Yu,Patrick Wang

DOI: https://doi.org/10.1142/s0218001424590122

IF: 1.261

2024-08-24

International Journal of Pattern Recognition and Artificial Intelligence

Abstract:International Journal of Pattern Recognition and Artificial Intelligence, Ahead of Print. Extracting information from scanned business documents, while a necessary commercial task, continues to be mostly done manually, requiring significant human effort. Current solutions for automated document information extraction still have limited capabilities in regards to user-required customizability and extraction of dataset-specific information, leaving the area as a very active field of research. In this paper, we propose modifications and improvements to our previously developed custom pipeline for extracting and tabulating key-value pairs from commercial invoice documents. Our design changes and additions adapt the pipeline to a wider variety of document types and use cases, primarily through the implementation of dataset-specific configuration files that promote customizability along with new technical modules that address both general and dataset-specific complexities. We compare our pipeline's performance against current machine learning and commercial solutions on a real-world dataset, and demonstrate that it is able to extract a wider variety of fields while maintaining competitive or greater accuracies compared to the alternate solutions.

computer science, artificial intelligence
Text Cohesion and Prediction of General Proficiency in Reading-Writing Integrated Tasks

Takumi Muroi,Takeshi Kato,Yuichi Ono

DOI: https://doi.org/10.1109/icalt52272.2021.00088

2021-07-01

Abstract:This paper considers the degree to which performance data can help predict Japanese EFL learners’ general receptive proficiency in an integrated reading-writing task. In the previous studies, there have been a great amount of discussions as to the use of Automatic Essay Scoring for independent tasks such as writing test. However, there is little study which deals with reading-writing integrated tasks in order to show the predictability for general linguistic proficiency. Eighty-four Japanese EFL learners participated in this study. Our finding is that the 26 cohesive indices in the TAACO processing tool account for 38% of their proficiency in random forest and XGBoost. This paper concludes that this approach for the use of performance data and cohesive indices is promising for future research. In addition, in the case of Japanese EFL learners, the result of the occurrence of determiners has implications for second language acquisition theory in terms of linguistic factors.
A Joint Learning Information Extraction Method Based on an Effective Inference Structure

Shaopeng Ma,Xiong Chen

DOI: https://doi.org/10.1088/1742-6596/1487/1/012009

2020-01-01

Journal of Physics Conference Series

Abstract:Over the past few years, natural language processing is getting much attraction from more scholars and institutions. Knowledge graph has been regarded as a crucial role in pushing natural language understanding forward. The task of information extraction is the first step to build a large-scale knowledge graph, which means to identify information from the natural language text and extract it in the form of entity and relation triplets. Some joint learning method have been proposed in this domain recently. In this paper, we inherit the idea of joint learning, use a simple, lightweight but effective structure to solve this task and compare our method with some recent algorithms on the benchmark dataset NYT and WebNLG. Results show that our method can get an improvement in F1 score.
Web Information Extraction Based on Repeated Pattern

GAO Qiang,ZHANG Jing-Zhi,GENG Hua,PAN Jin-Gui

DOI: https://doi.org/10.3969/j.issn.1002-137X.2007.04.057

2007-01-01

Computer Science

Abstract:In a data-rich, multiple-record Web page, the “useful and relevant” information items are usually arranged regularly and compactly, with similar pattern of HTML tags and consistent style of presentation. In other words, the semi-structured Web document often has its own structured features. Based on this observation, this paper presents an automatic approach to extract such kind of information. We use Suffix Tree to obtain the repeated patterns in HTML tags of the target page, and then a series of heuristic rules are applied to choose the appropriate patterns. The information items will be extracted from the instances of these patterns. Experimental results indicate that our approach works effectively in most cases.
A Japanese OCR Post-Processing Approach Based on Dictionary Matching

Chu-Yu Guo,Yuan-Yan Tang,Chang-Song Liu,Jia Duan

DOI: https://doi.org/10.1109/icwapr.2013.6599286

2013-01-01

Abstract:This paper describes a post-processing approach for Japanese character recognition based on dictionary. By the analysis of experimental data in the processing of OCR, we find that some segmentation and recognition results do not conform to the rules of lexical and just generate the character based on the shape. If the fonts of pending recognized characters are similar with the others, it will easily lead to going wrong in the processing of OCR. For these errors we put forward an idea based on the Limited Length Segmentation Matching and the Bayesian Statistical Classifier. Through the above method, most of the font recognized mistakes can be solved. By the experimental results, it can be proved that this method is an effective way to improve the recognized rate of Japanese character.
Optimising Human-Machine Collaboration for Efficient High-Precision Information Extraction from Text Documents

Bradley Butcher,Miri Zilka,Jiri Hron,Darren Cook,Adrian Weller

DOI: https://doi.org/10.1145/3652591

2024-03-26

Abstract:From science to law enforcement, many research questions are answerable only by poring over a large amount of unstructured text documents. While people can extract information from such documents with high accuracy, this is often too time-consuming to be practical. On the other hand, automated approaches produce nearly-immediate results, but are not reliable enough for applications where near-perfect precision is essential. Motivated by two use cases from criminal justice, we consider the benefits and drawbacks of various human-only, human-machine, and machine-only approaches. Finding no tool well suited for our use cases, we develop a human-in-the-loop method for fast but accurate extraction of structured data from unstructured text. The tool is based on automated extraction followed by human validation, and is particularly useful in cases where purely manual extraction is not practical. Testing on three criminal justice datasets, we find that the combination of the computer speed and human understanding yields precision comparable to manual annotation while requiring only a fraction of time, and significantly outperforms the precision of all fully automated baselines.
Natural language processing for word sense disambiguation and information extraction

K. R. Chowdhary

DOI: https://doi.org/10.48550/arXiv.2004.02256

2020-04-06

Abstract:This research work deals with Natural Language Processing (NLP) and extraction of essential information in an explicit form. The most common among the information management strategies is Document Retrieval (DR) and Information Filtering. DR systems may work as combine harvesters, which bring back useful material from the vast fields of raw material. With large amount of potentially useful information in hand, an Information Extraction (IE) system can then transform the raw material by refining and reducing it to a germ of original text. A Document Retrieval system collects the relevant documents carrying the required information, from the repository of texts. An IE system then transforms them into information that is more readily digested and analyzed. It isolates relevant text fragments, extracts relevant information from the fragments, and then arranges together the targeted information in a coherent framework. The thesis presents a new approach for Word Sense Disambiguation using thesaurus. The illustrative examples supports the effectiveness of this approach for speedy and effective disambiguation. A Document Retrieval method, based on Fuzzy Logic has been described and its application is illustrated. A question-answering system describes the operation of information extraction from the retrieved text documents. The process of information extraction for answering a query is considerably simplified by using a Structured Description Language (SDL) which is based on cardinals of queries in the form of who, what, when, where and why. The thesis concludes with the presentation of a novel strategy based on Dempster-Shafer theory of evidential reasoning, for document retrieval and information extraction. This strategy permits relaxation of many limitations, which are inherent in Bayesian probabilistic approach.

Computation and Language,Artificial Intelligence,Information Retrieval
Back to Patterns: Efficient Japanese Morphological Analysis with Feature-Sequence Trie

Naoki Yoshinaga

2023-05-30

Abstract:Accurate neural models are much less efficient than non-neural models and are useless for processing billions of social media posts or handling user queries in real time with a limited budget. This study revisits the fastest pattern-based NLP methods to make them as accurate as possible, thus yielding a strikingly simple yet surprisingly accurate morphological analyzer for Japanese. The proposed method induces reliable patterns from a morphological dictionary and annotated data. Experimental results on two standard datasets confirm that the method exhibits comparable accuracy to learning-based baselines, while boasting a remarkable throughput of over 1,000,000 sentences per second on a single modern CPU. The source code is available at <a class="link-external link-https" href="https://www.tkl.iis.u-tokyo.ac.jp/~ynaga/jagger/" rel="external noopener nofollow">this https URL</a>

Computation and Language
Relation Extraction Based on Composite Kernel Combining Pattern Similarity of Predicate-Argument Structure

Chang-Hoo Jeong,Sung-Pil Choi,Youngjoon Choi,Shiji Song,Hong-Woo Chun

2011-01-01

Abstract:Lots of valuable textual information is used to extract relations between named entities from literature. Composite kernel approach is proposed in this paper. The composite kernel approach calculates similarities based on the following information:(1) Phrase structure in convolution parse tree kernel that has shown encouraging results. (2) Predicate-argument structure patterns. In other words, the approach deals with syntactic structure as well as semantic structure using a reciprocal method. The proposed approach was evaluated using various types of test collections and it showed the better performance compared with those of previous approach using only information from syntactic structures. In addition, it showed the better performance than those of the state of the art approach.

Challenges of Structured Reuse Adoption - Lessons Learned

Pattern Based Term Extraction Using ACABIT System

An Effective System for Multi-format Information Extraction

Research on Information Extraction:A Survey

Extracting linguistic speech patterns of Japanese fictional characters using subword units

Mutual Reinforcement Effects in Japanese Sentence Classification and Named Entity Recognition Tasks

Information Extraction from Resume Documents in PDF Format

Application and Design of Web Information Extraction System Based on Pattern Discovery

Recognizing Referential Links: An Information Extraction Perspective

JaMIE: A Pipeline Japanese Medical Information Extraction System

Discourse in Multimedia: A Case Study in Information Extraction

Reference Resolution Using Semantic Patterns in Japanese Newspaper Articles

Configurable Customized Information Extraction and Processing Pipeline

Text Cohesion and Prediction of General Proficiency in Reading-Writing Integrated Tasks

A Joint Learning Information Extraction Method Based on an Effective Inference Structure

Web Information Extraction Based on Repeated Pattern

A Japanese OCR Post-Processing Approach Based on Dictionary Matching

Optimising Human-Machine Collaboration for Efficient High-Precision Information Extraction from Text Documents

Natural language processing for word sense disambiguation and information extraction

Back to Patterns: Efficient Japanese Morphological Analysis with Feature-Sequence Trie

Relation Extraction Based on Composite Kernel Combining Pattern Similarity of Predicate-Argument Structure