Abstract:Many NLP tasks can be regarded as a selection problem from a set of options, such as classification tasks, multi-choice question answering, etc. Textual entailment (TE) has been shown as the state-of-the-art (SOTA) approach to dealing with those selection problems. TE treats input texts as premises (P), options as hypotheses (H), then handles the selection problem by modeling (P, H) pairwise. Two limitations: first, the pairwise modeling is unaware of other options, which is less intuitive since humans often determine the best options by comparing competing candidates; second, the inference process of pairwise TE is time-consuming, especially when the option space is large. To deal with the two issues, this work first proposes a contextualized TE model (Context-TE) by appending other k options as the context of the current (P, H) modeling. Context-TE is able to learn more reliable decision for the H since it considers various context. Second, we speed up Context-TE by coming up with Parallel-TE, which learns the decisions of multiple options simultaneously. Parallel-TE significantly improves the inference speed while keeping comparable performance with Context-TE. Our methods are evaluated on three tasks (ultra-fine entity typing, intent detection and multi-choice QA) that are typical selection problems with different sizes of options. Experiments show our models set new SOTA performance; particularly, Parallel-TE is faster than the pairwise TE by k times in inference. Our code is publicly available at <a class="link-external link-https" href="https://github.com/jiangshdd/LearningToSelect" rel="external noopener nofollow">this https URL</a>.

Learning class-to-class selectional preferences

Investigating Novel Verb Learning in BERT: Selectional Preference Classes and Alternation-Based Syntactic Generalization

Selectional Preferences Based on Distributional Semantic Model

Improving Statistical Machine Translation with Selectional Preferences.

A Closer Look at Recent Results of Verb Selection for Data-to-Text NLG.

Research on Chinese Selectional Preferences Acquisition

Learning to Select from Multiple Options

SP-10K: A Large-scale Evaluation Set for Selectional Preference Acquisition

Naive Bayes and Exemplar-Based approaches to Word Sense Disambiguation Revisited

Reliable Detection and Quantification of Selective Forces in Language Change

Transfer and Multi-Task Learning for Noun-Noun Compound Interpretation

Semi-supervised WSD in selectional preferences with semantic redundancy

The on-line resolution of the sentence complement/relative clause ambiguity: evidence from Spanish

When is Wall a Pared and when a Muro? -- Extracting Rules Governing Lexical Selection

Learning Formal Specifications from Membership and Preference Queries

A Sequential Model for Multi-Class Classification

A Random Walk Approach to Selectional Preferences Based on Preference Ranking and Propagation.

Evaluating Contextualized Representations of (Spanish) Ambiguous Words: A New Lexical Resource and Empirical Analysis

Learning Methods for Combining Linguistic Indicators to Classify Verbs

The Role of Verbs in Document Analysis

The effect of lexicalization biases on cross-situational statistical learning of novel verbs