Abstract:Definition Extraction (DE) is one of the well-known topics in Information Extraction that aims to identify terms and their corresponding definitions in unstructured texts. This task can be formalized either as a sentence classification task (i.e., containing term-definition pairs or not) or a sequential labeling task (i.e., identifying the boundaries of the terms and definitions). The previous works for DE have only focused on one of the two approaches, failing to model the inter-dependencies between the two tasks. In this work, we propose a novel model for DE that simultaneously performs the two tasks in a single framework to benefit from their inter-dependencies. Our model features deep learning architectures to exploit the global structures of the input sentences as well as the semantic consistencies between the terms and the definitions, thereby improving the quality of the representation vectors for DE. Besides the joint inference between sentence classification and sequential labeling, the proposed model is fundamentally different from the prior work for DE in that the prior work has only employed the local structures of the input sentences (i.e., word-to-word relations), and not yet considered the semantic consistencies between terms and definitions. In order to implement these novel ideas, our model presents a multi-task learning framework that employs graph convolutional neural networks and predicts the dependency paths between the terms and the definitions. We also seek to enforce the consistency between the representations of the terms and definitions both globally (i.e., increasing semantic consistency between the representations of the entire sentences and the terms/definitions) and locally (i.e., promoting the similarity between the representations of the terms and the definitions). The extensive experiments on three benchmark datasets demonstrate the effectiveness of our approach.1

DSC IIT-ISM at SemEval-2020 Task 6: Boosting BERT with Dependencies for Definition Extraction

UPB at SemEval-2020 Task 6: Pretrained Language Models for Definition Extraction

Boosting Collective Entity Linking via Type-Guided Semantic Embedding.

SemEval-2020 Task 6: Definition extraction from free text with the DEFT corpus

Defx at SemEval-2020 Task 6: Joint Extraction of Concepts and Relations for Definition Extraction

A Joint Model for Definition Extraction with Syntactic Connection and Semantic Consistency

UoB at SemEval-2020 Task 12: Boosting BERT with Corpus Level Information

Auxiliary Tasks to Boost Biaffine Semantic Dependency Parsing

IITK at SemEval-2024 Task 1: Contrastive Learning and Autoencoders for Semantic Textual Relatedness in Multilingual Texts

ITNLP at SemEval-2021 Task 11: Boosting BERT with Sampling and Adversarial Training for Knowledge Extraction

Improving Semantic Matching Through Dependency-Enhanced Pre-trained Model with Adaptive Fusion.

CS-NET at SemEval-2020 Task 4: Siamese BERT for ComVE

Enhancing Word-Level Semantic Representation via Dependency Structure for Expressive Text-to-Speech Synthesis

Learning Better Sentence Representation with Syntax Information

Enhanced Universal Dependency Parsing with Automated Concatenation of Embeddings

Semi-supervised Domain Adaptation for Dependency Parsing Via Improved Contextualized Word Representations.

Transfer Fine-Tuning: A BERT Case Study

Definition Extraction with LSTM Recurrent Neural Networks.

Sentiment Analysis of Sentence-Level using Dependency Embedding and Pre-trained BERT Model

DABERT: Dual Attention Enhanced BERT for Semantic Matching.

Dependency Parsing based Semantic Representation Learning with Graph Neural Network for Enhancing Expressiveness of Text-to-Speech