Abstract:Relation extraction aims to identify semantic relationships between entities from the given sentences. The development of deep learning prompts a variety of neural-based relation extraction models. These models can learn features from sentences automatically, but controlling their learned patterns is equally difficult. Therefore, it is hard to take steps to improve their performance further. A possible way to modify the models is by utilizing human-defined rules to introduce rule-based knowledge and guiding the models to capture the desired features based on human intent. As an efficient human knowledge, regular expression (RE) is helpful in extracting particular targets from text, which is also logical and interpretable. A novel embedding method is proposed to transform REs into learnable representations available to neural networks (NNs). Then, the rule-based representations are investigated to be integrated into different levels of NNs. Three representative relation extraction models based on recurrent neural network (RNN), convolutional neural network (CNN), and Transformer encoder, respectively, are selected as baselines to incorporate our rule-based representations. The experimental results show that the models with rule-based information outperform their original ones on the F1-score by 3.75%, 4.06%, and 2.57%, and the identification accuracy of complex samples is also significantly improved, verifying the effectiveness of our approaches. Our work is easy to reproduce and can be generally applied to various neural networks, proving that data-driven relation extraction methods can take advantage of the rule-based knowledge provided by REs.

Design and implementation of extension neural network model

Evolving Neural Networks Using the Hybrid of Ant Colony Optimization and Bp Algorithms

Application of the Improved BP Neural Network in Ship and Ocean Engineering

A Spike-Timing Based Integrated Model for Pattern Recognition

Intelligent Evaluation of Input and Output Performance for High-Tech Industrial Zones

Designs to Improve Capability of Neural Networks to Make Structural Predictions

A New Method of the Image Pattern Recognition Based on Neural Networks.

Study on the Design of Remote Image Classifier with HighResolution and Multi-spectrum Based on Neural Net

An Improvment Methods for Building Fire Detection Based on BP Neural Network

Research and Application on BP Neural Network Algorithm

BP Calculation of Variable Structure Neural Network Model and Its Application

Integrating regular expressions into neural networks for relation extraction

[Study on the Surface EMG Pattern Classification with BP Neural Networks].

PatternNet: Visual Pattern Mining with Deep Neural Network

Object Shape Classification Based on Bayesian Optimized Neural Network

Improvements and applications of BP neural network algorithm in radar target recognition

An Improved BP Neural Network Algorithm Based on Factor Analysis

Innovative Applications of BP Neural Networks in Financial Fraud Recognition

Cell Recognition Using BP Neural Network Edge Computing

ExpNet: A Unified Network for Expert-Level Classification

Design and Selection of Construction, Parameters Andtraining Method of BP Network