Abstract:Scientific Information Extraction (ScientificIE) is a critical task that involves the identification of scientific entities and their relationships. The complexity of this task is compounded by the necessity for domain-specific knowledge and the limited availability of annotated data. Two of the most popular datasets for ScientificIE are SemEval-2018 Task-7 and SciERC. They have overlapping samples and differ in their annotation schemes, which leads to conflicts. In this study, we first introduced a novel approach based on multi-task learning to address label variations. We then proposed a soft labeling technique that converts inconsistent labels into probabilistic distributions. The experimental results demonstrated that the proposed method can enhance the model robustness to label noise and improve the end-to-end performance in both ScientificIE tasks. The analysis revealed that label variations can be particularly effective in handling ambiguous instances. Furthermore, the richness of the information captured by label variations can potentially reduce data size requirements. The findings highlight the importance of releasing variation labels and promote future research on other tasks in other domains. Overall, this study demonstrates the effectiveness of multi-task learning and the potential of label variations to enhance the performance of ScientificIE.

Multi-Input Multi-Output Sequence Labeling for Joint Extraction of Fact and Condition Tuples from Scientific Text.

Adjacency List Oriented Relational Fact Extraction Via Adaptive Multi-task Learning.

Constructing Information-Lossless Biological Knowledge Graphs from Conditional Statements

Joint Segmentation and Tagging with Coupled Sequences Labeling

Biomedical Knowledge Graphs Construction From Conditional Statements

A Bidirectional Tree Tagging Scheme for Joint Medical Relation Extraction

Parsing Clinical Trial Eligibility Criteria for Cohort Query by a Multi-Input Multi-Output Sequence Labeling Model

Multi-layer Sequence Labeling-based Joint Biomedical Event Extraction

Improving Sequence Tagging Using Machine-Learning Techniques

Multi-Task Sequence Tagging for Emotion-Cause Pair Extraction Via Tag Distribution Refinement.

Joint Extraction of Triple Knowledge Based on Relation Priority.

Joint extraction of entities and relations using multi-label tagging and relational alignment

Boosting Span-based Joint Entity and Relation Extraction via Squence Tagging Mechanism

Fast Coupled Sequence Labeling on Heterogeneous Annotations Via Context-aware Pruning.

Solving Label Variation in Scientific Information Extraction via Multi-Task Learning

Span-based joint entity and relation extraction augmented with sequence tagging mechanism

Sentence-to-Label Generation Framework for Multi-task Learning of Japanese Sentence Classification and Named Entity Recognition

Conditional Random Fields Based Label Sequence and Information Feedback

Jointly Learning Span Extraction and Sequence Labeling for Information Extraction from Business Documents

A Probabilistic Model with Commonsense Constraints for Pattern-based Temporal Fact Extraction

Joint Extraction of Entities and Overlapping Relations using Position-Attentive Sequence Labeling