Abstract:Intelligent voice assistants, such as Apple Siri and Amazon Alexa, are widely used nowadays. These task-oriented dialogue systems require a semantic parsing module in order to process user utterances and understand the action to be performed. This semantic parsing component was initially implemented by rule-based or statistical slot-filling approaches for processing simple queries; however, the appearance of more complex utterances demanded the application of shift-reduce parsers or sequence-to-sequence models. Although shift-reduce approaches were initially considered the most promising option, the emergence of sequence-to-sequence neural systems has propelled them to the forefront as the highest-performing method for this particular task. In this article, we advance the research on shift-reduce semantic parsing for task-oriented dialogue. We implement novel shift-reduce parsers that rely on Stack-Transformers. This framework allows to adequately model transition systems on the Transformer neural architecture, notably boosting shift-reduce parsing performance. Furthermore, our approach goes beyond the conventional top-down algorithm: we incorporate alternative bottom-up and in-order transition systems derived from constituency parsing into the realm of task-oriented parsing. We extensively test our approach on multiple domains from the Facebook TOP benchmark, improving over existing shift-reduce parsers and state-of-the-art sequence-to-sequence models in both high-resource and low-resource settings. We also empirically prove that the in-order algorithm substantially outperforms the commonly-used top-down strategy. Through the creation of innovative transition systems and harnessing the capabilities of a robust neural architecture, our study showcases the superiority of shift-reduce parsers over leading sequence-to-sequence methods on the main benchmark.

Evaluating a Deterministic Shift-Reduce Neural Parser for Constituent Parsing.

A Neural Probabilistic Structured-Prediction Model for Transition-Based Dependency Parsing.

Enhancing Shift-Reduce Constituent Parsing with Action N-Gram Model.

Encoder-Decoder Shift-Reduce Syntactic Parsing

Span-Based Constituency Parsing with a Structure-Label System and Provably Optimal Dynamic Oracles

Introducing more features to improve Chinese shift-reduce parsing

High-order Joint Constituency and Dependency Parsing

Shift-Reduce Task-Oriented Semantic Parsing with Stack-Transformers

Incremental Parsing with Minimal Features Using Bi-Directional LSTM

Improved Discourse Parsing with Two-Step Neural Transition-Based Model

Two Local Models for Neural Constituent Parsing

Latent Tree Learning with Differentiable Parsers: Shift-Reduce Parsing and Chart Parsing

Keep the Structure: A Latent Shift-Reduce Parser for Semantic Parsing.

Transition-Based Discourse Parsing with Multilayer Stack Long Short Term Memory

Transition-based Dependency Parsing Using Two Heterogeneous Gated Recursive Neural Networks.

N-ary Constituent Tree Parsing with Recursive Semi-Markov Model

A Truly Joint Neural Architecture for Segmentation and Parsing

A Biologically Plausible Parser

Incremental Graph-based Neural Dependency Parsing.

Speeding Up Natural Language Parsing by Reusing Partial Results

A Fast Unified Model for Parsing and Sentence Understanding