Abstract:Definition Extraction (DE) is one of the well-known topics in Information Extraction that aims to identify terms and their corresponding definitions in unstructured texts. This task can be formalized either as a sentence classification task (i.e., containing term-definition pairs or not) or a sequential labeling task (i.e., identifying the boundaries of the terms and definitions). The previous works for DE have only focused on one of the two approaches, failing to model the inter-dependencies between the two tasks. In this work, we propose a novel model for DE that simultaneously performs the two tasks in a single framework to benefit from their inter-dependencies. Our model features deep learning architectures to exploit the global structures of the input sentences as well as the semantic consistencies between the terms and the definitions, thereby improving the quality of the representation vectors for DE. Besides the joint inference between sentence classification and sequential labeling, the proposed model is fundamentally different from the prior work for DE in that the prior work has only employed the local structures of the input sentences (i.e., word-to-word relations), and not yet considered the semantic consistencies between terms and definitions. In order to implement these novel ideas, our model presents a multi-task learning framework that employs graph convolutional neural networks and predicts the dependency paths between the terms and the definitions. We also seek to enforce the consistency between the representations of the terms and definitions both globally (i.e., increasing semantic consistency between the representations of the entire sentences and the terms/definitions) and locally (i.e., promoting the similarity between the representations of the terms and the definitions). The extensive experiments on three benchmark datasets demonstrate the effectiveness of our approach.1

The Integration of Dependency Relation Classification and Semantic Role Labeling Using Bilayer Maximum Entropy Markov Models

Hierarchical and Bidirectional Joint Multi-Task Classifiers for Natural Language Understanding

An MRC Framework for Semantic Role Labeling

Enhancing multi-label classification by modeling dependencies among labels.

A Unified Architecture for Semantic Role Labeling and Relation Classification

Deep Dependency Networks for Multi-Label Classification

Combining constituent and dependency syntactic views for Chinese semantic role labeling

Joint Maximum Margin and Maximum Entropy Learning of Graphical Models

Syntax-Aware Opinion Role Labeling With Dependency Graph Convolutional Networks

Syntax Aware LSTM model for Semantic Role Labeling.

A Joint Model for Definition Extraction with Syntactic Connection and Semantic Consistency

Enhanced semantic representation learning for implicit discourse relation classification

Semantic Role Labeling with Heterogeneous Syntactic Knowledge

A Mathematical Framework for Characterizing Dependency Structures of Multimodal Learning

Joint POS Tagging and Dependency Parsing with Transition-based Neural Networks

Joint Learning for Coreference Resolution with Markov Logic

Deep Dependency Networks and Advanced Inference Schemes for Multi-Label Classification

High-order Joint Constituency and Dependency Parsing

Joint Segmentation and Tagging with Coupled Sequences Labeling

Prediction of Maximal Projection for Semantic Role Labeling

Semantic Role Labeling Integrated with Multilevel Linguistic Cues and Bi-LSTM-CRF