Abstract:A semantic parser maps natural language commands (NLs) from the users to executable meaning representations (MRs), which are later executed in certain environment to obtain user-desired results. The fully-supervised training of such parser requires NL/MR pairs, annotated by domain experts, which makes them expensive to collect. However, weakly-supervised semantic parsers are learnt only from pairs of NL and expected execution results, leaving the MRs latent. While weak supervision is cheaper to acquire, learning from this input poses difficulties. It demands that parsers search a large space with a very weak learning signal and it is hard to avoid spurious MRs that achieve the correct answer in the wrong way. These factors lead to a performance gap between parsers trained in weakly- and fully-supervised setting. To bridge this gap, we examine the intersection between weak supervision and active learning, which allows the learner to actively select examples and query for manual annotations as extra supervision to improve the model trained under weak supervision. We study different active learning heuristics for selecting examples to query, and various forms of extra supervision for such queries. We evaluate the effectiveness of our method on two different datasets. Experiments on the WikiSQL show that by annotating only 1.8% of examples, we improve over a state-of-the-art weakly-supervised baseline by 6.4%, achieving an accuracy of 79.0%, which is only 1.3% away from the model trained with full supervision. Experiments on WikiTableQuestions with human annotators show that our method can improve the performance with only 100 active queries, especially for weakly-supervised parsers learnt from a cold start.

A Supervised Semantic Parsing with Lexicon Extension and Syntactic Constraint.

Semi-Supervised Lexicon Learning for Wide-Coverage Semantic Parsing.

Leverage External Knowledge and Self-attention for Chinese Semantic Dependency Graph Parsing

Domain Adaptation for Semantic Parsing.

A Sketch-Based System for Semantic Parsing

Enhancing Unsupervised Semantic Parsing with Distributed Contextual Representations

Semantic Parsing for English as a Second Language

Learning to Learn Semantic Parsers from Natural Language Supervision

Semantic Parsing Using Construction Categorization.

Scaling semantic parsers with on-the-fly ontology matching

Retrieval-Augmented Semantic Parsing: Using Large Language Models to Improve Generalization

How Far Are We from Effective Context Modeling ? an Exploratory Study on Semantic Parsing in Context.

Integrative Semantic Dependency Parsing Via Efficient Large-Scale Feature Selection

Improving Semantic Parsing with Enriched Synchronous Context-Free Grammars in Statistical Machine Translation

Multilingual Dependency-based Syntactic and Semantic Parsing.

Improving Unsupervised Constituency Parsing via Maximizing Semantic Information

Semi-supervised Domain Adaptation for Dependency Parsing

Semantic Parsing with Candidate Expressions for Knowledge Base Question Answering

Merging Weak and Active Supervision for Semantic Parsing

Neural Semantic Parsing with Extremely Rich Symbolic Meaning Representations