Abstract:Deep neural models for relation extraction tend to be less reliable when perfectly labeled data is limited, despite their success in label-sufficient scenarios. Instead of seeking more instance-level labels from human annotators, here we propose to annotate frequent surface patterns to form labeling rules. These rules can be automatically mined from large text corpora and generalized via a soft rule matching mechanism. Prior works use labeling rules in an exact matching fashion, which inherently limits the coverage of sentence matching and results in the low-recall issue. In this paper, we present a neural approach to ground rules for RE, named Nero, which jointly learns a relation extraction module and a soft matching module. One can employ any neural relation extraction models as the instantiation for the RE module. The soft matching module learns to match rules with semantically similar sentences such that raw corpora can be automatically labeled and leveraged by the RE module (in a much better coverage) as augmented supervision, in addition to the exactly matched sentences. Extensive experiments and analysis on two public and widely-used datasets demonstrate the effectiveness of the proposed Nero framework, comparing with both rule-based and semi-supervised methods. Through user studies, we find that the time efficiency for a human to annotate rules and sentences are similar (0.30 vs. 0.35 min per label). In particular, Nero’s performance using 270 rules is comparable to the models trained using 3,000 labeled sentences, yielding a 9.5x speedup. Moreover, Nero can predict for unseen relations at test time and provide interpretable predictions. We release our code1 to the community for future research.

Neural Generation of Regular Expressions from Natural Language with Minimal Domain Knowledge

Integrating regular expressions into neural networks for relation extraction

Neural Language Generation: Formulation, Methods, and Evaluation

Data Extraction via Semantic Regular Expression Synthesis

Marrying Up Regular Expressions with Neural Networks: A Case Study for Spoken Language Understanding.

Natural Language Generation Using Reinforcement Learning with External Rewards

Neural Class Expression Synthesis

InfeRE: Step-by-Step Regex Generation via Chain of Inference

Learning a Natural Language Interface with Neural Programmer

Neural Text Generation from Rich Semantic Representations

Progress in Neural NLP: Modeling, Learning, and Reasoning

Generalize Symbolic Knowledge With Neural Rule Engine

Identifying Query-Relevant Neurons in Large Language Models for Long-Form Texts

Integrating Regular Expressions with Neural Networks via DFA

Learning from Uncurated Regular Expressions

Improving Neural Question Generation using Deep Linguistic Representation

Modeling question asking using neural program generation

Recent Advances in Neural Text Generation: A Task-Agnostic Survey

NERO: A Neural Rule Grounding Framework for Label-Efficient Relation Extraction

Neural Module Networks for Reasoning over Text

Advancing Regular Language Reasoning in Linear Recurrent Neural Networks