Abstract:The recent success of neural networks in NLP applications has provided a strong impetus to develop supervised models for semantic role labeling (SRL) that forego the requirement for extensive feature engineering. Recent state-of-the-art approaches require high-quality annotated datasets that are costly to obtain and almost unavailable for low-resource languages. We present a semi-supervised approach that utilizes both labeled and unlabeled data to provide performance improvement over a mere supervised SRL model. We show that our proposed semi-supervised SRL model provides larger improvement over a supervised model in the scenario where labeled training data size is small. Our SRL system leverages unlabeled data under the language modeling paradigm. We demonstrate that the incorporation of a self pretrained bidirectional language model (S-PrLM) into a SRL system can help in SRL performance improvement by learning composition functions from the unlabeled data. Previous researches have concluded that syntax information is very useful for high-performing SRL systems, so we incorporate syntax information by employing an unsupervised approach to leverage dependency path information to connect argument candidates in vector space, which helps in distinguishing arguments with similar contexts but different syntactic functions. The basic idea is to connect predicate (w(p)) with argument candidate (w(a)) with the dependency path (r) between them in the embedding space. Experiments on the CoNLL-2008 and CoNLL-2009 datasets confirm that our full SRL model outperforms previous best models in terms of F-1 score.

Second-Order Semantic Role Labeling With Global Structural Refinement

An MRC Framework for Semantic Role Labeling

High-order Refining for End-to-end Chinese Semantic Role Labeling.

High-order Semantic Role Labeling

A Full End-to-End Semantic Role Labeler, Syntax-agnostic over Syntax-aware?

Dependency or Span, End-to-end Uniform Semantic Role Labeling

End-to-end Semantic Role Labeling with Neural Transition-based Model

Encoder-Decoder Based Unified Semantic Role Labeling With Label-Aware Syntax

Semi-Supervised Semantic Role Labeling with Bidirectional Language Models

An Improving SRL Model with Word Sense Information Using an Improved Synergetic Neural Network Model.

Neural Unsupervised Semantic Role Labeling

Syntax-aware Neural Semantic Role Labeling

Semantic Role Labeling Using Recursive Neural Network

Semantic Role Labeling Integrated with Multilevel Linguistic Cues and Bi-LSTM-CRF

Deep semantic role labeling: What works and what’s next

Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures inside Arguments.

Syntax-aware Multilingual Semantic Role Labeling

A Unified Syntax-aware Framework for Semantic Role Labeling

Syntax-Enhanced Self-Attention-Based Semantic Role Labeling

Semantic Role Labeling for Learner Chinese: the Importance of Syntactic Parsing and L2-L1 Parallel Data

Research on Chinese Semantic Role Labeling Based on Ocean Big Data